2024-04-21T08:43:21.735 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-21T08:43:21.735 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535 --verbose --owner scheduled_leonidus@teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} --name leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/orig.config.yaml 2024-04-21T08:43:21.786 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-21T08:43:21.876 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} email: null first_in_suite: false job_id: '7666535' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 4f6bc5273643aaf5660909e85400647a8951c10b owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 7599 sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e sleep_before_teardown: 0 subset: 111/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa suite_relpath: qa suite_repo: https://github.com/leonid-s-usov/ceph-ceph suite_sha1: 4f6bc5273643aaf5660909e85400647a8951c10b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNM/4TvBgUnGLiSBW4AA32oHQQwI/zuXX2DrSrIHA5OjeWMGfseY/1ESxJ4QFMZ7LCRISZQe0wioqljW+q9Z/Q= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmmCnzLzJqcmy2jVfpo3zaQbZbOmN/O7S4RfzIgiu1Hh8VeBFhvrbdQbGdSQ9VgvNmU4snPn9+4G+SmQg1V7fQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-21_08:12:55 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-21T08:43:21.876 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa; will attempt to use it 2024-04-21T08:43:21.877 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks 2024-04-21T08:43:21.877 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-21T08:43:21.879 INFO:teuthology.task.internal:Checking packages... 2024-04-21T08:43:21.908 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a630765c1f93c6e61d9b40c4b76437611d5ef29e' 2024-04-21T08:43:21.908 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-21T08:43:21.908 INFO:teuthology.packaging:ref: None 2024-04-21T08:43:21.908 INFO:teuthology.packaging:tag: None 2024-04-21T08:43:21.908 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-21T08:43:21.908 INFO:teuthology.packaging:sha1: a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T08:43:21.908 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiescer 2024-04-21T08:43:22.134 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3154-ga630765c-1jammy 2024-04-21T08:43:22.136 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-21T08:43:22.148 INFO:teuthology.task.internal:no buildpackages task found 2024-04-21T08:43:22.148 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-21T08:43:22.162 INFO:teuthology.task.internal:Saving configuration 2024-04-21T08:43:22.180 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-21T08:43:22.191 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T08:43:22.218 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 08:37:36.079688', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIINlniGH6HRmTRcstlnTrjMvcZ8fjCQ/bAXO3n+tTvmD'} 2024-04-21T08:43:22.239 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 08:37:36.081123', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFuVuYJy2WE0QwY1zkQzncHRwEZgTUI+gyjI+EA+wDlA'} 2024-04-21T08:43:22.239 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-21T08:43:22.251 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-21T08:43:22.251 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-21T08:43:22.251 INFO:teuthology.run_tasks:Running task console_log... 2024-04-21T08:43:22.331 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff65e67e0d0>, signals=[15]) 2024-04-21T08:43:22.332 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-21T08:43:22.341 INFO:teuthology.task.internal:Opening connections... 2024-04-21T08:43:22.341 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T08:43:22.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:43:22.424 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T08:43:22.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:43:22.510 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-21T08:43:22.519 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-04-21T08:43:22.525 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-04-21T08:43:22.526 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-21T08:43:22.573 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-21T08:43:22.574 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-21T08:43:22.574 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-21T08:43:22.574 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2024-04-21T08:43:22.574 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-04-21T08:43:22.590 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-04-21T08:43:22.595 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-04-21T08:43:22.595 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="Ubuntu" 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="22.04" 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_CODENAME=jammy 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:ID=ubuntu 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE=debian 2024-04-21T08:43:22.640 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-21T08:43:22.641 INFO:teuthology.orchestra.run.smithi169.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-21T08:43:22.641 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-21T08:43:22.641 INFO:teuthology.orchestra.run.smithi169.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-21T08:43:22.641 INFO:teuthology.orchestra.run.smithi169.stdout:UBUNTU_CODENAME=jammy 2024-04-21T08:43:22.641 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-04-21T08:43:22.665 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-21T08:43:22.680 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-21T08:43:22.691 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-21T08:43:22.691 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-04-21T08:43:22.694 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-04-21T08:43:22.698 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-21T08:43:22.710 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-21T08:43:22.710 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-04-21T08:43:22.743 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-04-21T08:43:22.753 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-21T08:43:22.811 INFO:teuthology.run_tasks:Running task kernel... 2024-04-21T08:43:22.825 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-21T08:43:22.825 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-21T08:43:22.826 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T08:43:22.826 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-21T08:43:22.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:43:22.831 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-04-21T08:43:22.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:43:22.832 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-21T08:43:22.878 INFO:teuthology.orchestra.run.smithi026.stdout:5.15.0-56-generic 2024-04-21T08:43:22.878 INFO:teuthology.task.kernel:Running kernel on smithi026: 5.15.0-56-generic 2024-04-21T08:43:22.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get clean 2024-04-21T08:43:22.881 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-56-generic 2024-04-21T08:43:22.881 INFO:teuthology.task.kernel:Running kernel on smithi169: 5.15.0-56-generic 2024-04-21T08:43:22.881 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-04-21T08:43:22.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2024-04-21T08:43:23.009 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-21T08:43:23.178 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T08:43:23.188 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-21T08:43:23.188 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-21T08:43:23.269 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-21T08:43:23.301 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T08:43:23.307 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-21T08:43:23.367 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-21T08:43:23.411 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,381 kB] 2024-04-21T08:43:23.483 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-21T08:43:23.521 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [450 kB] 2024-04-21T08:43:23.525 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [242 kB] 2024-04-21T08:43:23.528 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-21T08:43:23.528 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,744 kB] 2024-04-21T08:43:23.550 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-21T08:43:23.550 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [294 kB] 2024-04-21T08:43:23.553 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T08:43:23.553 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-21T08:43:23.554 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-21T08:43:23.560 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-21T08:43:23.570 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-21T08:43:23.571 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-21T08:43:23.593 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-21T08:43:23.593 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-21T08:43:23.594 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-21T08:43:23.594 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-21T08:43:23.594 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-21T08:43:23.598 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-21T08:43:23.598 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-21T08:43:23.615 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-21T08:43:23.615 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-21T08:43:23.618 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T08:43:23.618 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-21T08:43:23.624 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-21T08:43:23.633 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-21T08:43:23.635 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-21T08:43:23.636 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-21T08:43:23.636 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-21T08:43:23.654 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-21T08:43:23.654 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-21T08:43:23.654 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-21T08:43:23.655 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-21T08:43:23.656 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-21T08:43:23.656 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-21T08:43:23.675 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-21T08:43:23.675 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-21T08:43:23.676 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-21T08:43:23.676 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-21T08:43:23.731 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-21T08:43:23.738 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,381 kB] 2024-04-21T08:43:23.873 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-21T08:43:24.156 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [450 kB] 2024-04-21T08:43:24.174 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [242 kB] 2024-04-21T08:43:24.176 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-21T08:43:24.183 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-21T08:43:24.183 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,744 kB] 2024-04-21T08:43:24.215 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [302 kB] 2024-04-21T08:43:24.230 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-21T08:43:24.231 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-21T08:43:24.233 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,806 kB] 2024-04-21T08:43:24.276 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-21T08:43:24.277 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [294 kB] 2024-04-21T08:43:24.288 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T08:43:24.306 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [305 kB] 2024-04-21T08:43:24.306 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-21T08:43:24.312 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-21T08:43:24.317 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-21T08:43:24.476 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-21T08:43:24.496 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-21T08:43:24.895 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-21T08:43:24.901 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-21T08:43:24.901 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-21T08:43:24.915 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-21T08:43:24.918 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-21T08:43:25.058 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-21T08:43:25.168 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-21T08:43:25.189 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-21T08:43:25.190 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-21T08:43:25.193 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-21T08:43:25.194 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-21T08:43:25.195 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-21T08:43:25.195 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-21T08:43:25.199 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-21T08:43:25.203 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-21T08:43:25.368 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-21T08:43:25.451 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-21T08:43:25.532 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-21T08:43:25.614 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-21T08:43:25.641 INFO:teuthology.orchestra.run.smithi026.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-21T08:43:29.152 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 13.1 MB in 2s (7,208 kB/s) 2024-04-21T08:43:30.258 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 13.1 MB in 3s (5,121 kB/s) 2024-04-21T08:43:30.472 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-21T08:43:30.490 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T08:43:30.541 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-21T08:43:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-21T08:43:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-21T08:43:30.871 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:43:30.871 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:43:30.872 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:43:30.872 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:43:30.872 INFO:teuthology.orchestra.run.smithi169.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-21T08:43:30.872 INFO:teuthology.orchestra.run.smithi169.stdout: python2.7-minimal 2024-04-21T08:43:30.872 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:43:30.873 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-21T08:43:30.873 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T08:43:30.873 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-21T08:43:30.874 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-21T08:43:30.875 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-21T08:43:30.875 INFO:teuthology.orchestra.run.smithi169.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-21T08:43:30.875 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-04-21T08:43:30.875 INFO:teuthology.orchestra.run.smithi169.stdout: thermald 2024-04-21T08:43:30.926 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-21T08:43:30.926 INFO:teuthology.orchestra.run.smithi169.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T08:43:30.926 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-21T08:43:30.926 INFO:teuthology.orchestra.run.smithi169.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-21T08:43:30.927 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-04-21T08:43:30.928 INFO:teuthology.orchestra.run.smithi169.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-21T08:43:30.985 INFO:teuthology.orchestra.run.smithi169.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T08:43:30.985 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 113 MB of archives. 2024-04-21T08:43:30.985 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-21T08:43:30.985 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-21T08:43:31.466 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-21T08:43:31.567 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-21T08:43:31.801 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-21T08:43:31.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T08:43:31.874 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-21T08:43:32.058 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-21T08:43:32.059 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-21T08:43:32.220 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:43:32.220 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:43:32.220 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:43:32.221 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:43:32.221 INFO:teuthology.orchestra.run.smithi026.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-21T08:43:32.221 INFO:teuthology.orchestra.run.smithi026.stdout: python2.7-minimal 2024-04-21T08:43:32.221 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:43:32.222 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2024-04-21T08:43:32.222 INFO:teuthology.orchestra.run.smithi026.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T08:43:32.222 INFO:teuthology.orchestra.run.smithi026.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-21T08:43:32.222 INFO:teuthology.orchestra.run.smithi026.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-21T08:43:32.223 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2024-04-21T08:43:32.223 INFO:teuthology.orchestra.run.smithi026.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-21T08:43:32.223 INFO:teuthology.orchestra.run.smithi026.stdout:Recommended packages: 2024-04-21T08:43:32.223 INFO:teuthology.orchestra.run.smithi026.stdout: thermald 2024-04-21T08:43:32.272 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2024-04-21T08:43:32.272 INFO:teuthology.orchestra.run.smithi026.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-21T08:43:32.272 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-21T08:43:32.273 INFO:teuthology.orchestra.run.smithi026.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-21T08:43:32.274 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages will be upgraded: 2024-04-21T08:43:32.274 INFO:teuthology.orchestra.run.smithi026.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-21T08:43:32.404 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-21T08:43:32.404 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-21T08:43:32.404 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-21T08:43:32.454 INFO:teuthology.orchestra.run.smithi026.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T08:43:32.454 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 113 MB of archives. 2024-04-21T08:43:32.454 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-21T08:43:32.454 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-21T08:43:32.638 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-21T08:43:32.674 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-21T08:43:33.061 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 113 MB in 2s (65.1 MB/s) 2024-04-21T08:43:33.227 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-21T08:43:33.850 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-21T08:43:34.180 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-21T08:43:35.274 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-21T08:43:35.278 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:35.534 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:36.335 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-21T08:43:36.335 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-21T08:43:36.335 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-21T08:43:36.911 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-21T08:43:37.029 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-21T08:43:37.446 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 113 MB in 5s (23.9 MB/s) 2024-04-21T08:43:37.616 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-21T08:43:37.635 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-21T08:43:37.657 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:37.754 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:38.163 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-21T08:43:38.184 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:38.230 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:39.603 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-21T08:43:39.608 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:39.696 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:42.056 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-21T08:43:42.078 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:42.178 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:42.689 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-21T08:43:42.710 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:42.751 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:44.745 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T08:43:44.890 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T08:43:45.239 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T08:43:45.351 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T08:43:45.604 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-21T08:43:45.626 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-21T08:43:45.671 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T08:43:49.278 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T08:43:49.402 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T08:43:49.744 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T08:43:49.881 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T08:43:50.184 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-21T08:43:50.206 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-21T08:43:50.250 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T08:43:51.047 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-21T08:43:51.085 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:51.122 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:53.996 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T08:43:54.118 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T08:43:54.451 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T08:43:54.573 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:54.699 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-21T08:43:54.819 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:56.018 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-21T08:43:56.056 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-21T08:43:56.093 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:56.137 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-21T08:43:56.137 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-21T08:43:56.137 INFO:teuthology.orchestra.run.smithi169.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-21T08:43:56.137 INFO:teuthology.orchestra.run.smithi169.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-21T08:43:56.288 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:57.716 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:59.350 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-21T08:43:59.476 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-21T08:43:59.602 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:43:59.667 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-21T08:43:59.667 INFO:teuthology.orchestra.run.smithi169.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-21T08:43:59.788 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-21T08:43:59.913 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-21T08:44:00.287 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-21T08:44:00.409 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:44:00.535 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-21T08:44:00.671 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:44:02.027 INFO:teuthology.orchestra.run.smithi026.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-21T08:44:02.027 INFO:teuthology.orchestra.run.smithi026.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-21T08:44:02.028 INFO:teuthology.orchestra.run.smithi026.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-21T08:44:02.028 INFO:teuthology.orchestra.run.smithi026.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-21T08:44:02.224 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:44:03.910 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:44:05.710 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-21T08:44:05.819 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-21T08:44:05.937 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-21T08:44:06.024 INFO:teuthology.orchestra.run.smithi026.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-21T08:44:06.024 INFO:teuthology.orchestra.run.smithi026.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-21T08:44:14.264 INFO:teuthology.orchestra.run.smithi169.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-21T08:44:14.264 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub' 2024-04-21T08:44:14.290 INFO:teuthology.orchestra.run.smithi169.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T08:44:14.306 INFO:teuthology.orchestra.run.smithi169.stdout:Generating grub configuration file ... 2024-04-21T08:44:14.567 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T08:44:14.589 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T08:44:14.852 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T08:44:14.858 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T08:44:14.924 INFO:teuthology.orchestra.run.smithi169.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T08:44:14.929 INFO:teuthology.orchestra.run.smithi169.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T08:44:15.085 INFO:teuthology.orchestra.run.smithi169.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T08:44:15.085 INFO:teuthology.orchestra.run.smithi169.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T08:44:15.085 INFO:teuthology.orchestra.run.smithi169.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T08:44:15.124 INFO:teuthology.orchestra.run.smithi169.stdout:done 2024-04-21T08:44:15.611 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-04-21T08:44:15.634 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-04-21T08:44:15.634 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-04-21T08:44:15.634 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.105.102 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-04-21T08:44:15.635 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-04-21T08:44:15.635 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-21T08:44:15.636 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-21T08:44:15.636 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-21T08:44:15.636 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-21T08:44:15.636 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=None, version=distro) 2024-04-21T08:44:15.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get clean 2024-04-21T08:44:15.795 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-21T08:44:16.049 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T08:44:16.049 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T08:44:16.120 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-21T08:44:16.202 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T08:44:17.405 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-21T08:44:17.423 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T08:44:17.477 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-21T08:44:17.655 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-21T08:44:17.656 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-21T08:44:17.810 INFO:teuthology.orchestra.run.smithi169.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-21T08:44:17.810 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:44:17.810 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:44:17.811 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:44:17.811 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:44:17.811 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T08:44:17.811 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T08:44:17.811 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:44:17.849 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T08:44:17.851 DEBUG:teuthology.orchestra.run.smithi169:> dpkg -s linux-image-generic 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Package: linux-image-generic 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Status: install ok installed 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Priority: optional 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Section: kernel 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Installed-Size: 21 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: amd64 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Source: linux-meta 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Version: 5.15.0.105.102 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T08:44:17.907 INFO:teuthology.orchestra.run.smithi169.stdout:Recommends: thermald 2024-04-21T08:44:17.908 INFO:teuthology.orchestra.run.smithi169.stdout:Description: Generic Linux kernel image 2024-04-21T08:44:17.908 INFO:teuthology.orchestra.run.smithi169.stdout: This package will always depend on the latest generic kernel image 2024-04-21T08:44:17.908 INFO:teuthology.orchestra.run.smithi169.stdout: available. 2024-04-21T08:44:17.908 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-21T08:44:17.951 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.oTKQtPre2I 2024-04-21T08:44:17.952 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub/grub.cfg /tmp/tmp.oTKQtPre2I 2024-04-21T08:44:18.008 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.oTKQtPre2I 2024-04-21T08:44:18.123 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.oTKQtPre2I is 10KB 2024-04-21T08:44:18.136 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.oTKQtPre2I 2024-04-21T08:44:18.141 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-21T08:44:18.197 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:44:18.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-21T08:44:18.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-21T08:44:18.263 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-21T08:44:18.263 DEBUG:teuthology.orchestra.run.smithi169:> sudo update-grub 2024-04-21T08:44:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub' 2024-04-21T08:44:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T08:44:19.411 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-04-21T08:44:19.584 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T08:44:19.590 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T08:44:19.826 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T08:44:19.831 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T08:44:19.869 INFO:teuthology.orchestra.run.smithi169.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T08:44:19.874 INFO:teuthology.orchestra.run.smithi169.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T08:44:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T08:44:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T08:44:20.011 INFO:teuthology.orchestra.run.smithi169.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T08:44:20.028 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-04-21T08:44:20.037 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-04-21T08:44:20.672 INFO:teuthology.orchestra.run.smithi026.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-21T08:44:20.672 INFO:teuthology.orchestra.run.smithi026.stdout:Sourcing file `/etc/default/grub' 2024-04-21T08:44:20.693 INFO:teuthology.orchestra.run.smithi026.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T08:44:20.710 INFO:teuthology.orchestra.run.smithi026.stdout:Generating grub configuration file ... 2024-04-21T08:44:21.076 INFO:teuthology.orchestra.run.smithi026.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T08:44:21.095 INFO:teuthology.orchestra.run.smithi026.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T08:44:21.492 INFO:teuthology.orchestra.run.smithi026.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T08:44:21.499 INFO:teuthology.orchestra.run.smithi026.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T08:44:21.582 INFO:teuthology.orchestra.run.smithi026.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T08:44:21.588 INFO:teuthology.orchestra.run.smithi026.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T08:44:21.766 INFO:teuthology.orchestra.run.smithi026.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T08:44:21.766 INFO:teuthology.orchestra.run.smithi026.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T08:44:21.766 INFO:teuthology.orchestra.run.smithi026.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T08:44:21.815 INFO:teuthology.orchestra.run.smithi026.stdout:done 2024-04-21T08:44:22.266 DEBUG:teuthology.orchestra.run.smithi026:> dpkg -s linux-image-generic 2024-04-21T08:44:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:Package: linux-image-generic 2024-04-21T08:44:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:Status: install ok installed 2024-04-21T08:44:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:Priority: optional 2024-04-21T08:44:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:Section: kernel 2024-04-21T08:44:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:Installed-Size: 21 2024-04-21T08:44:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T08:44:22.284 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: amd64 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout:Source: linux-meta 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout:Version: 5.15.0.105.102 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout:Recommends: thermald 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout:Description: Generic Linux kernel image 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout: This package will always depend on the latest generic kernel image 2024-04-21T08:44:22.285 INFO:teuthology.orchestra.run.smithi026.stdout: available. 2024-04-21T08:44:22.285 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-21T08:44:22.285 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-21T08:44:22.285 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-21T08:44:22.286 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-21T08:44:22.286 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2024-04-21T08:44:22.286 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get clean 2024-04-21T08:44:22.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2024-04-21T08:44:22.595 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T08:44:22.595 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T08:44:22.607 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-21T08:44:22.627 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T08:44:23.992 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-21T08:44:24.009 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-21T08:44:24.063 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-21T08:44:24.262 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-21T08:44:24.263 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-21T08:44:24.427 INFO:teuthology.orchestra.run.smithi026.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-21T08:44:24.427 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:44:24.427 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:44:24.427 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:44:24.428 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:44:24.428 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T08:44:24.428 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T08:44:24.428 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:44:24.467 INFO:teuthology.orchestra.run.smithi026.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-21T08:44:24.469 DEBUG:teuthology.orchestra.run.smithi026:> dpkg -s linux-image-generic 2024-04-21T08:44:24.528 INFO:teuthology.orchestra.run.smithi026.stdout:Package: linux-image-generic 2024-04-21T08:44:24.528 INFO:teuthology.orchestra.run.smithi026.stdout:Status: install ok installed 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Priority: optional 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Section: kernel 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Installed-Size: 21 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Maintainer: Ubuntu Kernel Team 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: amd64 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Source: linux-meta 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Version: 5.15.0.105.102 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Recommends: thermald 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout:Description: Generic Linux kernel image 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout: This package will always depend on the latest generic kernel image 2024-04-21T08:44:24.529 INFO:teuthology.orchestra.run.smithi026.stdout: available. 2024-04-21T08:44:24.530 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-04-21T08:44:24.573 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.sQtmgQd4ep 2024-04-21T08:44:24.573 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub/grub.cfg /tmp/tmp.sQtmgQd4ep 2024-04-21T08:44:24.647 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.sQtmgQd4ep 2024-04-21T08:44:24.760 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.sQtmgQd4ep is 10KB 2024-04-21T08:44:24.774 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.sQtmgQd4ep 2024-04-21T08:44:24.779 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-21T08:44:24.835 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:44:24.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-21T08:44:24.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-21T08:44:24.905 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-21T08:44:24.905 DEBUG:teuthology.orchestra.run.smithi026:> sudo update-grub 2024-04-21T08:44:26.159 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub' 2024-04-21T08:44:26.160 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-21T08:44:26.163 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2024-04-21T08:44:26.419 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-21T08:44:26.426 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-21T08:44:26.714 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-21T08:44:26.719 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-21T08:44:26.762 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-21T08:44:26.770 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-21T08:44:26.909 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-21T08:44:26.909 INFO:teuthology.orchestra.run.smithi026.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-21T08:44:26.909 INFO:teuthology.orchestra.run.smithi026.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-21T08:44:26.929 INFO:teuthology.orchestra.run.smithi026.stderr:done 2024-04-21T08:44:26.931 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2024-04-21T08:44:50.062 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-21T08:44:50.063 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-21T08:44:50.064 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:44:56.938 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-21T08:44:56.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-21T08:44:56.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:45:08.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-21T08:45:15.422 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-21T08:45:17.514 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-21T08:45:17.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:45:20.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-04-21T08:45:24.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-21T08:45:24.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:45:32.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-21T08:45:32.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:45:42.815 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-21T08:45:54.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-21T08:45:54.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:45:54.830 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-21T08:46:09.842 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-21T08:46:09.843 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:46:10.077 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-04-21T08:46:10.640 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-21T08:46:10.640 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-21T08:46:10.640 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-04-21T08:46:10.688 INFO:teuthology.orchestra.run.smithi026.stdout:5.15.0-105-generic 2024-04-21T08:46:10.688 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-21T08:46:10.689 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-21T08:46:10.689 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-21T08:46:11.689 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-21T08:46:11.690 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-21T08:46:11.766 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2024-04-21T08:46:11.794 DEBUG:teuthology.parallel:result is None 2024-04-21T08:46:32.590 DEBUG:teuthology.orchestra.remote:timed out 2024-04-21T08:46:47.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-21T08:46:47.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:46:47.807 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-21T08:46:48.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-21T08:46:48.359 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-21T08:46:48.359 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-04-21T08:46:48.405 INFO:teuthology.orchestra.run.smithi169.stdout:5.15.0-105-generic 2024-04-21T08:46:48.405 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-21T08:46:48.405 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-21T08:46:48.406 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-21T08:46:49.407 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-21T08:46:49.407 DEBUG:teuthology.orchestra.run.smithi169:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-21T08:46:49.477 INFO:teuthology.orchestra.run.smithi169.stdout:ttyS1 2024-04-21T08:46:49.515 DEBUG:teuthology.parallel:result is None 2024-04-21T08:46:49.515 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-21T08:46:49.522 INFO:teuthology.task.internal:Creating test directory... 2024-04-21T08:46:49.523 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T08:46:49.525 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-21T08:46:49.531 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-21T08:46:49.537 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-21T08:46:49.547 INFO:teuthology.task.internal:Creating archive directory... 2024-04-21T08:46:49.547 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T08:46:49.573 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-21T08:46:49.594 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-21T08:46:49.601 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-21T08:46:49.601 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T08:46:49.633 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-21T08:46:49.652 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T08:46:49.655 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T08:46:49.662 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T08:46:49.663 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-21T08:46:49.665 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-21T08:46:49.673 INFO:teuthology.task.internal:Configuring sudo... 2024-04-21T08:46:49.673 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T08:46:49.706 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-21T08:46:49.730 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-21T08:46:49.739 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-21T08:46:49.739 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T08:46:49.765 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-21T08:46:49.781 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T08:46:49.816 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T08:46:49.865 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:46:49.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T08:46:49.929 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-21T08:46:49.935 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-21T08:46:49.982 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:46:49.982 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-21T08:46:50.053 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-04-21T08:46:50.055 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-04-21T08:46:50.124 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-21T08:46:50.132 INFO:teuthology.task.internal:Starting timer... 2024-04-21T08:46:50.132 INFO:teuthology.run_tasks:Running task pcp... 2024-04-21T08:46:50.142 INFO:teuthology.run_tasks:Running task selinux... 2024-04-21T08:46:50.150 DEBUG:teuthology.task.selinux:Excluding smithi026: OS 'ubuntu' does not support SELinux 2024-04-21T08:46:50.151 DEBUG:teuthology.task.selinux:Excluding smithi169: OS 'ubuntu' does not support SELinux 2024-04-21T08:46:50.151 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-21T08:46:50.151 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-21T08:46:50.151 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-21T08:46:50.151 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-21T08:46:50.160 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-21T08:46:50.178 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-21T08:46:50.188 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-21T08:53:55.593 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-04-21T08:53:55.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-21T08:53:55.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:53:55.682 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-04-21T08:53:55.762 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-21T08:53:55.763 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-21T08:53:55.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-21T08:53:55.844 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-04-21T08:53:55.918 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-04-21T08:53:55.918 INFO:teuthology.run_tasks:Running task clock... 2024-04-21T08:53:55.936 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-21T08:53:55.936 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T08:53:55.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T08:53:55.940 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-21T08:53:55.940 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T08:53:55.966 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-21T08:53:55.966 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Command line: ntpd -gq 2024-04-21T08:53:55.966 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: ---------------------------------------------------- 2024-04-21T08:53:55.966 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: ntp-4 is maintained by Network Time Foundation, 2024-04-21T08:53:55.966 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-21T08:53:55.967 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: corporation. Support and training for ntp-4 are 2024-04-21T08:53:55.967 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: available at https://www.nwtime.org/support 2024-04-21T08:53:55.967 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: ---------------------------------------------------- 2024-04-21T08:53:55.967 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: proto: precision = 0.064 usec (-24) 2024-04-21T08:53:55.967 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: basedate set to 2022-02-04 2024-04-21T08:53:55.968 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: gps base set to 2022-02-06 (week 2196) 2024-04-21T08:53:55.968 INFO:teuthology.orchestra.run.smithi026.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T08:53:55.968 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T08:53:55.968 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: restrict ::: KOD does nothing without LIMITED. 2024-04-21T08:53:55.969 INFO:teuthology.orchestra.run.smithi026.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-21T08:53:55.969 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Listen and drop on 0 v6wildcard [::]:123 2024-04-21T08:53:55.969 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-21T08:53:55.970 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Listen normally on 2 lo 127.0.0.1:123 2024-04-21T08:53:55.970 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Listen normally on 3 ens1f0 172.21.15.26:123 2024-04-21T08:53:55.970 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Listen normally on 4 lo [::1]:123 2024-04-21T08:53:55.970 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:cac0%4]:123 2024-04-21T08:53:55.970 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:53:55 ntpd[17108]: Listening on routing socket on fd #22 for interface updates 2024-04-21T08:53:55.988 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Command line: ntpd -gq 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: ---------------------------------------------------- 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: ntp-4 is maintained by Network Time Foundation, 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: corporation. Support and training for ntp-4 are 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: available at https://www.nwtime.org/support 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: ---------------------------------------------------- 2024-04-21T08:53:55.989 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: proto: precision = 0.047 usec (-24) 2024-04-21T08:53:55.990 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: basedate set to 2022-02-04 2024-04-21T08:53:55.990 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: gps base set to 2022-02-06 (week 2196) 2024-04-21T08:53:55.990 INFO:teuthology.orchestra.run.smithi169.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T08:53:55.990 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-21T08:53:55.991 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: restrict ::: KOD does nothing without LIMITED. 2024-04-21T08:53:55.991 INFO:teuthology.orchestra.run.smithi169.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-21T08:53:55.992 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Listen and drop on 0 v6wildcard [::]:123 2024-04-21T08:53:55.992 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-21T08:53:55.992 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Listen normally on 2 lo 127.0.0.1:123 2024-04-21T08:53:55.992 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Listen normally on 3 enp3s0f1 172.21.15.169:123 2024-04-21T08:53:55.992 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Listen normally on 4 lo [::1]:123 2024-04-21T08:53:55.992 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f4d%5]:123 2024-04-21T08:53:55.992 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:53:55 ntpd[17198]: Listening on routing socket on fd #22 for interface updates 2024-04-21T08:53:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:56 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:56 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:56 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:56 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:56 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:56.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:56 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:56.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:56.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:56.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:56 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:57.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:57 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:57.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:57 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:57.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:57 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:57.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:57 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:57.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:57 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:57.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:57 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:57.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:57 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:57.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:57 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:57.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:57 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:57.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:57 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:57.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:57 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:57.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:57 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:58 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:58 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:58 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:58 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:58.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:58 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:58.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:58 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:58.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:58.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:58.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:58.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:58.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:58 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:59 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:59 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:59 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:59 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:59 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:59.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:53:59 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:53:59.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:59 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:59.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:59 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:59.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:59 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:53:59.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:59 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:53:59.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:59 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:53:59.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:53:59 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:00.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:00.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:00.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:00 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:00.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:00.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:00 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:01.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:01 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:01.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:01 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:01.967 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:01 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:01.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:01 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:01.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:01 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:01.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:01 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:01.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:01 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:01.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:01 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:01.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:01 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:01.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:01 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:01.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:01 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:01.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:01 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:02.968 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stdout:21 Apr 08:54:02 ntpd[17108]: ntpd: time slew +0.000230 s 2024-04-21T08:54:02.969 INFO:teuthology.orchestra.run.smithi026.stdout:ntpd: time slew +0.000230s 2024-04-21T08:54:02.970 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-21T08:54:02.970 INFO:teuthology.orchestra.run.smithi026.stderr:21 Apr 08:54:02 ntpd[17108]: can't open /var/log/ntpstats/loopstats.20240421: Permission denied 2024-04-21T08:54:02.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:02.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:02.989 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:02.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:02.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-21T08:54:02.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: can't open /var/log/ntpstats/rawstats.20240421: Permission denied 2024-04-21T08:54:02.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-21T08:54:02.990 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: can't open /var/log/ntpstats/peerstats.20240421: Permission denied 2024-04-21T08:54:02.990 INFO:teuthology.orchestra.run.smithi169.stdout:21 Apr 08:54:02 ntpd[17198]: ntpd: time slew -0.000832 s 2024-04-21T08:54:02.990 INFO:teuthology.orchestra.run.smithi169.stdout:ntpd: time slew -0.000832s 2024-04-21T08:54:02.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-21T08:54:02.991 INFO:teuthology.orchestra.run.smithi169.stderr:21 Apr 08:54:02 ntpd[17198]: can't open /var/log/ntpstats/loopstats.20240421: Permission denied 2024-04-21T08:54:03.024 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2024-04-21T08:54:03.024 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2024-04-21T08:54:03.024 INFO:teuthology.orchestra.run.smithi026.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.025 INFO:teuthology.orchestra.run.smithi026.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.025 INFO:teuthology.orchestra.run.smithi026.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.025 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.041 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-04-21T08:54:03.041 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-04-21T08:54:03.041 INFO:teuthology.orchestra.run.smithi169.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.041 INFO:teuthology.orchestra.run.smithi169.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.041 INFO:teuthology.orchestra.run.smithi169.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.041 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-21T08:54:03.042 INFO:teuthology.run_tasks:Running task install... 2024-04-21T08:54:03.051 DEBUG:teuthology.task.install:project ceph 2024-04-21T08:54:03.051 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e'}} 2024-04-21T08:54:03.051 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e'} 2024-04-21T08:54:03.051 INFO:teuthology.task.install:Using flavor: default 2024-04-21T08:54:03.057 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-21T08:54:03.057 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-21T08:54:03.058 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-key list | grep Ceph 2024-04-21T08:54:03.058 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-key list | grep Ceph 2024-04-21T08:54:03.122 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-21T08:54:03.137 INFO:teuthology.orchestra.run.smithi169.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-21T08:54:03.150 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-21T08:54:03.150 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph.com (release key) 2024-04-21T08:54:03.150 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-21T08:54:03.151 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-21T08:54:03.151 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T08:54:03.163 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-21T08:54:03.163 INFO:teuthology.orchestra.run.smithi169.stdout:uid [ unknown] Ceph.com (release key) 2024-04-21T08:54:03.164 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-21T08:54:03.164 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-21T08:54:03.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T08:54:03.303 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default/ 2024-04-21T08:54:03.303 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-ga630765c-1jammy 2024-04-21T08:54:03.394 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default/ 2024-04-21T08:54:03.394 INFO:teuthology.task.install.deb:Package version is 19.0.0-3154-ga630765c-1jammy 2024-04-21T08:54:03.483 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:54:03.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-21T08:54:03.497 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2024-04-21T08:54:03.508 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:54:03.509 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-21T08:54:03.522 DEBUG:teuthology.orchestra.run.smithi169:> sudo apt-get update 2024-04-21T08:54:03.677 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T08:54:03.690 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T08:54:03.690 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-21T08:54:03.704 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-21T08:54:03.722 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy InRelease 2024-04-21T08:54:03.725 INFO:teuthology.orchestra.run.smithi169.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T08:54:03.743 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-21T08:54:03.765 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-21T08:54:03.786 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-04-21T08:54:03.792 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-21T08:54:03.800 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy InRelease 2024-04-21T08:54:03.814 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-21T08:54:03.839 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-21T08:54:03.873 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-21T08:54:03.875 INFO:teuthology.orchestra.run.smithi169.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-21T08:54:03.912 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-04-21T08:54:03.954 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,408 B] 2024-04-21T08:54:04.047 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 29.2 kB in 0s (82.9 kB/s) 2024-04-21T08:54:04.218 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-21T08:54:04.317 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [616 kB] 2024-04-21T08:54:04.625 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,597 kB] 2024-04-21T08:54:04.777 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-21T08:54:05.003 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-21T08:54:05.017 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-ga630765c-1jammy cephadm=19.0.0-3154-ga630765c-1jammy ceph-mds=19.0.0-3154-ga630765c-1jammy ceph-mgr=19.0.0-3154-ga630765c-1jammy ceph-common=19.0.0-3154-ga630765c-1jammy ceph-fuse=19.0.0-3154-ga630765c-1jammy ceph-test=19.0.0-3154-ga630765c-1jammy ceph-volume=19.0.0-3154-ga630765c-1jammy radosgw=19.0.0-3154-ga630765c-1jammy python3-rados=19.0.0-3154-ga630765c-1jammy python3-rgw=19.0.0-3154-ga630765c-1jammy python3-cephfs=19.0.0-3154-ga630765c-1jammy python3-rbd=19.0.0-3154-ga630765c-1jammy libcephfs2=19.0.0-3154-ga630765c-1jammy libcephfs-dev=19.0.0-3154-ga630765c-1jammy librados2=19.0.0-3154-ga630765c-1jammy librbd1=19.0.0-3154-ga630765c-1jammy rbd-fuse=19.0.0-3154-ga630765c-1jammy python3-cephfs=19.0.0-3154-ga630765c-1jammy cephfs-shell=19.0.0-3154-ga630765c-1jammy cephfs-top=19.0.0-3154-ga630765c-1jammy cephfs-mirror=19.0.0-3154-ga630765c-1jammy 2024-04-21T08:54:05.078 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-21T08:54:05.171 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 3,432 kB in 1s (2,340 kB/s) 2024-04-21T08:54:05.277 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-21T08:54:05.280 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-21T08:54:05.461 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:54:05.461 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:54:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:54:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:54:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T08:54:05.462 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T08:54:05.462 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:54:05.463 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-21T08:54:05.463 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-21T08:54:05.464 INFO:teuthology.orchestra.run.smithi169.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-21T08:54:05.465 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout:Recommended packages: 2024-04-21T08:54:05.466 INFO:teuthology.orchestra.run.smithi169.stdout: btrfs-tools 2024-04-21T08:54:05.569 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-21T08:54:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-21T08:54:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-21T08:54:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-21T08:54:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-21T08:54:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-21T08:54:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-21T08:54:05.570 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-21T08:54:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-21T08:54:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-21T08:54:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-21T08:54:05.571 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-21T08:54:05.572 INFO:teuthology.orchestra.run.smithi169.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-21T08:54:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-21T08:54:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-21T08:54:05.573 INFO:teuthology.orchestra.run.smithi169.stdout: socat unzip xmlstarlet zip 2024-04-21T08:54:05.715 INFO:teuthology.orchestra.run.smithi169.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-21T08:54:05.715 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 182 MB of archives. 2024-04-21T08:54:05.715 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-21T08:54:05.715 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-ga630765c-1jammy [3,555 kB] 2024-04-21T08:54:05.761 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-21T08:54:05.844 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-21T08:54:05.889 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-21T08:54:05.925 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-ga630765c-1jammy [3,224 kB] 2024-04-21T08:54:06.023 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-ga630765c-1jammy [712 kB] 2024-04-21T08:54:06.045 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-ga630765c-1jammy [356 kB] 2024-04-21T08:54:06.057 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-ga630765c-1jammy [32.8 kB] 2024-04-21T08:54:06.058 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-ga630765c-1jammy [180 kB] 2024-04-21T08:54:06.063 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-ga630765c-1jammy [66.9 kB] 2024-04-21T08:54:06.066 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-ga630765c-1jammy [330 kB] 2024-04-21T08:54:06.077 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-ga630765c-1jammy [6,894 kB] 2024-04-21T08:54:06.092 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-21T08:54:06.167 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-21T08:54:06.183 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3154-ga630765c-1jammy cephadm=19.0.0-3154-ga630765c-1jammy ceph-mds=19.0.0-3154-ga630765c-1jammy ceph-mgr=19.0.0-3154-ga630765c-1jammy ceph-common=19.0.0-3154-ga630765c-1jammy ceph-fuse=19.0.0-3154-ga630765c-1jammy ceph-test=19.0.0-3154-ga630765c-1jammy ceph-volume=19.0.0-3154-ga630765c-1jammy radosgw=19.0.0-3154-ga630765c-1jammy python3-rados=19.0.0-3154-ga630765c-1jammy python3-rgw=19.0.0-3154-ga630765c-1jammy python3-cephfs=19.0.0-3154-ga630765c-1jammy python3-rbd=19.0.0-3154-ga630765c-1jammy libcephfs2=19.0.0-3154-ga630765c-1jammy libcephfs-dev=19.0.0-3154-ga630765c-1jammy librados2=19.0.0-3154-ga630765c-1jammy librbd1=19.0.0-3154-ga630765c-1jammy rbd-fuse=19.0.0-3154-ga630765c-1jammy python3-cephfs=19.0.0-3154-ga630765c-1jammy cephfs-shell=19.0.0-3154-ga630765c-1jammy cephfs-top=19.0.0-3154-ga630765c-1jammy cephfs-mirror=19.0.0-3154-ga630765c-1jammy 2024-04-21T08:54:06.187 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-21T08:54:06.201 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-21T08:54:06.247 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-21T08:54:06.252 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-21T08:54:06.305 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-ga630765c-1jammy [112 kB] 2024-04-21T08:54:06.308 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-ga630765c-1jammy [466 kB] 2024-04-21T08:54:06.322 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-ga630765c-1jammy [25.8 MB] 2024-04-21T08:54:06.427 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-21T08:54:06.436 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-21T08:54:06.449 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-21T08:54:06.450 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-21T08:54:06.463 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-21T08:54:06.471 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-21T08:54:06.636 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-21T08:54:06.650 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:54:06.651 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:54:06.651 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:54:06.651 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:54:06.651 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T08:54:06.651 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T08:54:06.651 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:54:06.652 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2024-04-21T08:54:06.652 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-21T08:54:06.652 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-21T08:54:06.653 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-21T08:54:06.653 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-21T08:54:06.654 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-21T08:54:06.654 INFO:teuthology.orchestra.run.smithi026.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-21T08:54:06.655 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-21T08:54:06.656 INFO:teuthology.orchestra.run.smithi026.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-21T08:54:06.657 INFO:teuthology.orchestra.run.smithi026.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-21T08:54:06.657 INFO:teuthology.orchestra.run.smithi026.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-21T08:54:06.657 INFO:teuthology.orchestra.run.smithi026.stdout:Recommended packages: 2024-04-21T08:54:06.657 INFO:teuthology.orchestra.run.smithi026.stdout: btrfs-tools 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-21T08:54:06.767 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-21T08:54:06.768 INFO:teuthology.orchestra.run.smithi026.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-21T08:54:06.769 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-21T08:54:06.770 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-21T08:54:06.770 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-21T08:54:06.770 INFO:teuthology.orchestra.run.smithi026.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-21T08:54:06.770 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-21T08:54:06.770 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-21T08:54:06.770 INFO:teuthology.orchestra.run.smithi026.stdout: socat unzip xmlstarlet zip 2024-04-21T08:54:06.957 INFO:teuthology.orchestra.run.smithi026.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-21T08:54:06.957 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 182 MB of archives. 2024-04-21T08:54:06.957 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-21T08:54:06.957 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-21T08:54:07.040 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-21T08:54:07.085 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-21T08:54:07.203 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3154-ga630765c-1jammy [3,555 kB] 2024-04-21T08:54:07.208 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-21T08:54:07.229 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-21T08:54:07.288 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-21T08:54:07.294 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-21T08:54:07.347 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-21T08:54:07.347 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-ga630765c-1jammy [5,092 kB] 2024-04-21T08:54:07.347 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-21T08:54:07.352 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-21T08:54:07.356 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-21T08:54:07.360 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-21T08:54:07.361 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-21T08:54:07.361 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-21T08:54:07.383 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-21T08:54:07.397 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-21T08:54:07.426 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-ga630765c-1jammy [244 kB] 2024-04-21T08:54:07.429 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-ga630765c-1jammy [124 kB] 2024-04-21T08:54:07.430 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-ga630765c-1jammy [1,526 kB] 2024-04-21T08:54:07.448 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-21T08:54:07.459 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-ga630765c-1jammy [6,260 kB] 2024-04-21T08:54:07.527 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-21T08:54:07.610 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-21T08:54:07.616 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-21T08:54:07.622 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-21T08:54:07.632 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-21T08:54:07.659 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-21T08:54:07.667 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-ga630765c-1jammy [22.8 MB] 2024-04-21T08:54:07.668 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-21T08:54:07.691 INFO:teuthology.orchestra.run.smithi169.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-21T08:54:07.717 INFO:teuthology.orchestra.run.smithi169.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-21T08:54:07.734 INFO:teuthology.orchestra.run.smithi169.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-21T08:54:07.749 INFO:teuthology.orchestra.run.smithi169.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-21T08:54:07.832 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-21T08:54:07.938 INFO:teuthology.orchestra.run.smithi169.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-21T08:54:07.956 INFO:teuthology.orchestra.run.smithi169.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-21T08:54:07.962 INFO:teuthology.orchestra.run.smithi169.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-21T08:54:07.967 INFO:teuthology.orchestra.run.smithi169.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-21T08:54:08.151 INFO:teuthology.orchestra.run.smithi169.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-21T08:54:08.234 INFO:teuthology.orchestra.run.smithi169.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-21T08:54:08.248 INFO:teuthology.orchestra.run.smithi169.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-21T08:54:08.408 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-21T08:54:08.424 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-21T08:54:08.439 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-21T08:54:08.448 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-21T08:54:08.448 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-21T08:54:08.464 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-21T08:54:08.502 INFO:teuthology.orchestra.run.smithi169.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-21T08:54:08.502 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-21T08:54:08.503 INFO:teuthology.orchestra.run.smithi169.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-ga630765c-1jammy [14.0 kB] 2024-04-21T08:54:08.503 INFO:teuthology.orchestra.run.smithi169.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-21T08:54:08.504 INFO:teuthology.orchestra.run.smithi169.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-ga630765c-1jammy [870 kB] 2024-04-21T08:54:08.504 INFO:teuthology.orchestra.run.smithi169.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-21T08:54:08.515 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-21T08:54:08.518 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-21T08:54:08.519 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-21T08:54:08.521 INFO:teuthology.orchestra.run.smithi169.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-ga630765c-1jammy [2,436 kB] 2024-04-21T08:54:08.562 INFO:teuthology.orchestra.run.smithi169.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-ga630765c-1jammy [791 kB] 2024-04-21T08:54:08.571 INFO:teuthology.orchestra.run.smithi169.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-ga630765c-1jammy [148 kB] 2024-04-21T08:54:08.573 INFO:teuthology.orchestra.run.smithi169.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-ga630765c-1jammy [2,297 kB] 2024-04-21T08:54:08.642 INFO:teuthology.orchestra.run.smithi169.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-ga630765c-1jammy [8,625 kB] 2024-04-21T08:54:08.648 INFO:teuthology.orchestra.run.smithi169.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-21T08:54:08.650 INFO:teuthology.orchestra.run.smithi169.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-21T08:54:08.654 INFO:teuthology.orchestra.run.smithi169.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-21T08:54:08.659 INFO:teuthology.orchestra.run.smithi169.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-21T08:54:08.673 INFO:teuthology.orchestra.run.smithi169.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-21T08:54:08.693 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-21T08:54:08.776 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-21T08:54:08.797 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-21T08:54:08.858 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-21T08:54:08.858 INFO:teuthology.orchestra.run.smithi169.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-21T08:54:08.895 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-21T08:54:08.917 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-21T08:54:08.931 INFO:teuthology.orchestra.run.smithi169.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-ga630765c-1jammy [14.2 kB] 2024-04-21T08:54:08.931 INFO:teuthology.orchestra.run.smithi169.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-ga630765c-1jammy [51.6 MB] 2024-04-21T08:54:08.943 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-21T08:54:09.123 INFO:teuthology.orchestra.run.smithi169.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-21T08:54:09.128 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-21T08:54:09.144 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-21T08:54:09.151 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-21T08:54:09.156 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-21T08:54:09.240 INFO:teuthology.orchestra.run.smithi169.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-21T08:54:09.283 INFO:teuthology.orchestra.run.smithi169.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-21T08:54:09.340 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-21T08:54:09.366 INFO:teuthology.orchestra.run.smithi169.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-21T08:54:09.378 INFO:teuthology.orchestra.run.smithi169.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-21T08:54:09.391 INFO:teuthology.orchestra.run.smithi169.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-21T08:54:09.424 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-21T08:54:09.430 INFO:teuthology.orchestra.run.smithi169.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-21T08:54:09.439 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-21T08:54:09.625 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-21T08:54:09.676 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-21T08:54:09.689 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-21T08:54:09.695 INFO:teuthology.orchestra.run.smithi169.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-21T08:54:09.697 INFO:teuthology.orchestra.run.smithi169.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-21T08:54:09.700 INFO:teuthology.orchestra.run.smithi169.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-21T08:54:09.848 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-21T08:54:09.848 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-21T08:54:09.853 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-21T08:54:09.858 INFO:teuthology.orchestra.run.smithi026.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-21T08:54:09.864 INFO:teuthology.orchestra.run.smithi169.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-21T08:54:09.872 INFO:teuthology.orchestra.run.smithi026.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-21T08:54:10.060 INFO:teuthology.orchestra.run.smithi026.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-21T08:54:10.190 INFO:teuthology.orchestra.run.smithi169.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-21T08:54:10.324 INFO:teuthology.orchestra.run.smithi026.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-21T08:54:10.438 INFO:teuthology.orchestra.run.smithi026.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-21T08:54:10.483 INFO:teuthology.orchestra.run.smithi026.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-21T08:54:10.565 INFO:teuthology.orchestra.run.smithi026.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-21T08:54:10.578 INFO:teuthology.orchestra.run.smithi026.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-21T08:54:10.591 INFO:teuthology.orchestra.run.smithi026.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-21T08:54:10.599 INFO:teuthology.orchestra.run.smithi169.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-21T08:54:10.608 INFO:teuthology.orchestra.run.smithi169.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-21T08:54:10.610 INFO:teuthology.orchestra.run.smithi169.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-21T08:54:10.631 INFO:teuthology.orchestra.run.smithi026.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-21T08:54:10.736 INFO:teuthology.orchestra.run.smithi169.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-21T08:54:10.737 INFO:teuthology.orchestra.run.smithi169.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-21T08:54:10.770 INFO:teuthology.orchestra.run.smithi169.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-21T08:54:10.771 INFO:teuthology.orchestra.run.smithi169.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-21T08:54:10.786 INFO:teuthology.orchestra.run.smithi169.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-21T08:54:10.873 INFO:teuthology.orchestra.run.smithi169.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-ga630765c-1jammy [124 kB] 2024-04-21T08:54:10.875 INFO:teuthology.orchestra.run.smithi169.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-ga630765c-1jammy [232 kB] 2024-04-21T08:54:10.880 INFO:teuthology.orchestra.run.smithi169.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-ga630765c-1jammy [33.9 kB] 2024-04-21T08:54:10.893 INFO:teuthology.orchestra.run.smithi026.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-21T08:54:10.895 INFO:teuthology.orchestra.run.smithi026.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-21T08:54:10.898 INFO:teuthology.orchestra.run.smithi026.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-21T08:54:10.944 INFO:teuthology.orchestra.run.smithi169.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-ga630765c-1jammy [23.4 kB] 2024-04-21T08:54:10.945 INFO:teuthology.orchestra.run.smithi169.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-ga630765c-1jammy [38.9 kB] 2024-04-21T08:54:10.946 INFO:teuthology.orchestra.run.smithi169.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-ga630765c-1jammy [13.6 MB] 2024-04-21T08:54:10.952 INFO:teuthology.orchestra.run.smithi169.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-21T08:54:11.039 INFO:teuthology.orchestra.run.smithi169.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-21T08:54:11.063 INFO:teuthology.orchestra.run.smithi026.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-21T08:54:11.136 INFO:teuthology.orchestra.run.smithi169.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-21T08:54:11.288 INFO:teuthology.orchestra.run.smithi169.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-ga630765c-1jammy [91.2 kB] 2024-04-21T08:54:11.382 INFO:teuthology.orchestra.run.smithi169.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-21T08:54:11.400 INFO:teuthology.orchestra.run.smithi026.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-21T08:54:11.425 INFO:teuthology.orchestra.run.smithi169.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-21T08:54:11.449 INFO:teuthology.orchestra.run.smithi169.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-21T08:54:11.457 INFO:teuthology.orchestra.run.smithi169.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-21T08:54:11.502 INFO:teuthology.orchestra.run.smithi169.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-21T08:54:11.527 INFO:teuthology.orchestra.run.smithi169.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-21T08:54:11.529 INFO:teuthology.orchestra.run.smithi169.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-21T08:54:11.536 INFO:teuthology.orchestra.run.smithi169.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-21T08:54:11.558 INFO:teuthology.orchestra.run.smithi026.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3154-ga630765c-1jammy [3,224 kB] 2024-04-21T08:54:11.703 INFO:teuthology.orchestra.run.smithi169.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-21T08:54:11.796 INFO:teuthology.orchestra.run.smithi026.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-21T08:54:11.806 INFO:teuthology.orchestra.run.smithi026.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-21T08:54:11.807 INFO:teuthology.orchestra.run.smithi026.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-21T08:54:11.878 INFO:teuthology.orchestra.run.smithi026.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-21T08:54:11.878 INFO:teuthology.orchestra.run.smithi026.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-21T08:54:11.879 INFO:teuthology.orchestra.run.smithi026.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-21T08:54:11.881 INFO:teuthology.orchestra.run.smithi026.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-21T08:54:11.881 INFO:teuthology.orchestra.run.smithi026.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-21T08:54:12.048 INFO:teuthology.orchestra.run.smithi026.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-21T08:54:12.149 INFO:teuthology.orchestra.run.smithi026.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-21T08:54:12.240 INFO:teuthology.orchestra.run.smithi169.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-21T08:54:12.241 INFO:teuthology.orchestra.run.smithi026.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-21T08:54:12.246 INFO:teuthology.orchestra.run.smithi169.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-21T08:54:12.286 INFO:teuthology.orchestra.run.smithi169.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-21T08:54:12.286 INFO:teuthology.orchestra.run.smithi169.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-21T08:54:12.291 INFO:teuthology.orchestra.run.smithi169.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-21T08:54:12.294 INFO:teuthology.orchestra.run.smithi169.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-21T08:54:12.319 INFO:teuthology.orchestra.run.smithi026.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3154-ga630765c-1jammy [712 kB] 2024-04-21T08:54:12.335 INFO:teuthology.orchestra.run.smithi169.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-21T08:54:12.344 INFO:teuthology.orchestra.run.smithi169.stdout:Get:119 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-21T08:54:12.418 INFO:teuthology.orchestra.run.smithi169.stdout:Get:120 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-21T08:54:12.419 INFO:teuthology.orchestra.run.smithi169.stdout:Get:121 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-21T08:54:12.463 INFO:teuthology.orchestra.run.smithi026.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3154-ga630765c-1jammy [356 kB] 2024-04-21T08:54:12.482 INFO:teuthology.orchestra.run.smithi026.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-21T08:54:12.525 INFO:teuthology.orchestra.run.smithi026.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3154-ga630765c-1jammy [32.8 kB] 2024-04-21T08:54:12.526 INFO:teuthology.orchestra.run.smithi026.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-21T08:54:12.543 INFO:teuthology.orchestra.run.smithi026.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3154-ga630765c-1jammy [180 kB] 2024-04-21T08:54:12.550 INFO:teuthology.orchestra.run.smithi026.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-21T08:54:12.559 INFO:teuthology.orchestra.run.smithi026.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-21T08:54:12.566 INFO:teuthology.orchestra.run.smithi026.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3154-ga630765c-1jammy [66.9 kB] 2024-04-21T08:54:12.583 INFO:teuthology.orchestra.run.smithi169.stdout:Get:122 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-21T08:54:12.586 INFO:teuthology.orchestra.run.smithi026.stdout:Get:80 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3154-ga630765c-1jammy [330 kB] 2024-04-21T08:54:12.602 INFO:teuthology.orchestra.run.smithi026.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-21T08:54:12.629 INFO:teuthology.orchestra.run.smithi026.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-21T08:54:12.631 INFO:teuthology.orchestra.run.smithi026.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-21T08:54:12.637 INFO:teuthology.orchestra.run.smithi026.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-21T08:54:12.647 INFO:teuthology.orchestra.run.smithi026.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3154-ga630765c-1jammy [6,894 kB] 2024-04-21T08:54:12.805 INFO:teuthology.orchestra.run.smithi026.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-21T08:54:13.025 INFO:teuthology.orchestra.run.smithi169.stdout:Get:123 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-21T08:54:13.040 INFO:teuthology.orchestra.run.smithi169.stdout:Get:124 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-21T08:54:13.335 INFO:teuthology.orchestra.run.smithi026.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-21T08:54:13.340 INFO:teuthology.orchestra.run.smithi026.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-21T08:54:13.380 INFO:teuthology.orchestra.run.smithi026.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-21T08:54:13.381 INFO:teuthology.orchestra.run.smithi026.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-21T08:54:13.388 INFO:teuthology.orchestra.run.smithi026.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-21T08:54:13.390 INFO:teuthology.orchestra.run.smithi026.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-21T08:54:13.430 INFO:teuthology.orchestra.run.smithi026.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-21T08:54:13.439 INFO:teuthology.orchestra.run.smithi026.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-21T08:54:13.512 INFO:teuthology.orchestra.run.smithi026.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-21T08:54:13.513 INFO:teuthology.orchestra.run.smithi026.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-21T08:54:13.678 INFO:teuthology.orchestra.run.smithi026.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-21T08:54:13.735 INFO:teuthology.orchestra.run.smithi026.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3154-ga630765c-1jammy [112 kB] 2024-04-21T08:54:13.738 INFO:teuthology.orchestra.run.smithi026.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3154-ga630765c-1jammy [466 kB] 2024-04-21T08:54:13.800 INFO:teuthology.orchestra.run.smithi026.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3154-ga630765c-1jammy [25.8 MB] 2024-04-21T08:54:13.945 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 182 MB in 8s (23.4 MB/s) 2024-04-21T08:54:14.079 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-21T08:54:14.113 INFO:teuthology.orchestra.run.smithi026.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-21T08:54:14.128 INFO:teuthology.orchestra.run.smithi026.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-21T08:54:14.168 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-21T08:54:14.174 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-21T08:54:14.211 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-21T08:54:14.455 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-21T08:54:14.481 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-21T08:54:14.514 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T08:54:14.875 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cmd2. 2024-04-21T08:54:14.901 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-21T08:54:14.942 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-21T08:54:15.295 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-21T08:54:15.321 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-21T08:54:15.403 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T08:54:15.740 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-21T08:54:15.766 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-21T08:54:15.808 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T08:54:16.093 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-21T08:54:16.119 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-21T08:54:16.151 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T08:54:16.583 INFO:teuthology.orchestra.run.smithi026.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3154-ga630765c-1jammy [5,092 kB] 2024-04-21T08:54:16.588 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-21T08:54:16.614 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T08:54:16.663 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:54:16.958 INFO:teuthology.orchestra.run.smithi026.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3154-ga630765c-1jammy [244 kB] 2024-04-21T08:54:16.976 INFO:teuthology.orchestra.run.smithi026.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3154-ga630765c-1jammy [124 kB] 2024-04-21T08:54:16.994 INFO:teuthology.orchestra.run.smithi026.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3154-ga630765c-1jammy [1,526 kB] 2024-04-21T08:54:17.082 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-21T08:54:17.103 INFO:teuthology.orchestra.run.smithi026.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3154-ga630765c-1jammy [6,260 kB] 2024-04-21T08:54:17.109 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T08:54:17.149 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:54:17.444 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-21T08:54:17.470 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T08:54:17.502 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:54:17.577 INFO:teuthology.orchestra.run.smithi026.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3154-ga630765c-1jammy [22.8 MB] 2024-04-21T08:54:17.864 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-21T08:54:17.890 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-21T08:54:17.930 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T08:54:18.208 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librados2. 2024-04-21T08:54:18.234 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:18.266 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librados2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:18.736 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librbd1. 2024-04-21T08:54:18.762 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:18.802 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librbd1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3154-ga630765c-1jammy [14.0 kB] 2024-04-21T08:54:18.998 INFO:teuthology.orchestra.run.smithi026.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3154-ga630765c-1jammy [870 kB] 2024-04-21T08:54:19.016 INFO:teuthology.orchestra.run.smithi026.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3154-ga630765c-1jammy [2,436 kB] 2024-04-21T08:54:19.105 INFO:teuthology.orchestra.run.smithi026.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3154-ga630765c-1jammy [791 kB] 2024-04-21T08:54:19.143 INFO:teuthology.orchestra.run.smithi026.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3154-ga630765c-1jammy [148 kB] 2024-04-21T08:54:19.146 INFO:teuthology.orchestra.run.smithi026.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3154-ga630765c-1jammy [2,297 kB] 2024-04-21T08:54:19.247 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs2. 2024-04-21T08:54:19.248 INFO:teuthology.orchestra.run.smithi026.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3154-ga630765c-1jammy [8,625 kB] 2024-04-21T08:54:19.273 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:19.314 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:19.601 INFO:teuthology.orchestra.run.smithi026.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3154-ga630765c-1jammy [14.2 kB] 2024-04-21T08:54:19.601 INFO:teuthology.orchestra.run.smithi026.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3154-ga630765c-1jammy [51.6 MB] 2024-04-21T08:54:19.649 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rados. 2024-04-21T08:54:19.673 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:19.708 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rados (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:20.002 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-21T08:54:20.029 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:20.069 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:20.304 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cephfs. 2024-04-21T08:54:20.320 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:20.363 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cephfs (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:20.674 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-21T08:54:20.700 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:20.740 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:21.077 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-prettytable. 2024-04-21T08:54:21.103 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-21T08:54:21.144 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-21T08:54:21.371 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rbd. 2024-04-21T08:54:21.386 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:21.421 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rbd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:21.597 INFO:teuthology.orchestra.run.smithi026.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3154-ga630765c-1jammy [124 kB] 2024-04-21T08:54:21.599 INFO:teuthology.orchestra.run.smithi026.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3154-ga630765c-1jammy [232 kB] 2024-04-21T08:54:21.604 INFO:teuthology.orchestra.run.smithi026.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3154-ga630765c-1jammy [33.9 kB] 2024-04-21T08:54:21.605 INFO:teuthology.orchestra.run.smithi026.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3154-ga630765c-1jammy [23.4 kB] 2024-04-21T08:54:21.606 INFO:teuthology.orchestra.run.smithi026.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3154-ga630765c-1jammy [38.9 kB] 2024-04-21T08:54:21.607 INFO:teuthology.orchestra.run.smithi026.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3154-ga630765c-1jammy [13.6 MB] 2024-04-21T08:54:21.757 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-21T08:54:21.783 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-21T08:54:21.824 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T08:54:21.947 INFO:teuthology.orchestra.run.smithi026.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiescer/a630765c1f93c6e61d9b40c4b76437611d5ef29e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3154-ga630765c-1jammy [91.2 kB] 2024-04-21T08:54:22.101 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-21T08:54:22.117 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-21T08:54:22.159 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T08:54:22.496 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-21T08:54:22.512 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-21T08:54:22.546 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T08:54:22.651 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 182 MB in 15s (11.9 MB/s) 2024-04-21T08:54:22.789 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-21T08:54:22.832 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua5.1. 2024-04-21T08:54:22.848 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-21T08:54:22.882 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-21T08:54:22.890 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-21T08:54:22.895 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-21T08:54:22.937 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-21T08:54:23.202 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-any. 2024-04-21T08:54:23.206 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-21T08:54:23.218 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-21T08:54:23.233 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-21T08:54:23.261 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-21T08:54:23.298 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T08:54:23.513 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package zip. 2024-04-21T08:54:23.539 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-21T08:54:23.580 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking zip (3.0-12build2) ... 2024-04-21T08:54:23.593 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cmd2. 2024-04-21T08:54:23.619 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-21T08:54:23.659 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-21T08:54:23.891 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package unzip. 2024-04-21T08:54:23.917 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-21T08:54:23.958 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-21T08:54:23.970 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-21T08:54:23.997 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-21T08:54:24.229 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T08:54:24.337 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package luarocks. 2024-04-21T08:54:24.363 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-21T08:54:24.395 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-21T08:54:24.666 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-21T08:54:24.692 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-21T08:54:24.732 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T08:54:24.778 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package librgw2. 2024-04-21T08:54:24.804 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:24.844 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking librgw2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:25.069 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-21T08:54:25.095 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-21T08:54:25.135 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T08:54:25.372 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rgw. 2024-04-21T08:54:25.399 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:25.438 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:25.514 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-21T08:54:25.540 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T08:54:25.580 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:54:25.725 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-21T08:54:25.751 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-21T08:54:25.783 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T08:54:25.984 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-21T08:54:26.010 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T08:54:26.050 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:54:26.128 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libradosstriper1. 2024-04-21T08:54:26.324 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:26.324 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libradosstriper1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:26.389 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-21T08:54:26.413 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-21T08:54:26.453 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:54:26.623 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-common. 2024-04-21T08:54:26.649 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:26.689 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:26.790 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-21T08:54:26.816 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-21T08:54:26.881 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T08:54:27.201 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librados2. 2024-04-21T08:54:27.227 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../010-librados2_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:27.267 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librados2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:27.720 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librbd1. 2024-04-21T08:54:27.747 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../011-librbd1_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:27.786 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librbd1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:28.186 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-base. 2024-04-21T08:54:28.213 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:28.248 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs2. 2024-04-21T08:54:28.262 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-base (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:28.274 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:28.314 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:28.542 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rados. 2024-04-21T08:54:28.558 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:28.600 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rados (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:28.832 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-21T08:54:28.858 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-21T08:54:28.898 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-21T08:54:28.911 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-21T08:54:28.938 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:28.978 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-argparse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:29.201 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cheroot. 2024-04-21T08:54:29.228 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-21T08:54:29.268 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T08:54:29.372 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cephfs. 2024-04-21T08:54:29.388 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:29.430 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cephfs (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:29.629 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-21T08:54:29.656 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-21T08:54:29.704 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-21T08:54:29.750 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-21T08:54:29.776 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:29.808 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:30.086 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-prettytable. 2024-04-21T08:54:30.107 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-21T08:54:30.113 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-21T08:54:30.134 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-21T08:54:30.152 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-21T08:54:30.182 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-21T08:54:30.435 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rbd. 2024-04-21T08:54:30.462 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:30.493 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-21T08:54:30.505 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rbd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:30.520 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-21T08:54:30.560 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-21T08:54:30.858 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-21T08:54:30.885 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-21T08:54:30.888 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempora. 2024-04-21T08:54:30.914 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-21T08:54:30.924 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T08:54:30.963 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-21T08:54:31.160 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-21T08:54:31.177 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-21T08:54:31.210 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T08:54:31.317 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-portend. 2024-04-21T08:54:31.343 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-21T08:54:31.391 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-21T08:54:31.480 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-21T08:54:31.496 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-21T08:54:31.539 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T08:54:31.727 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-21T08:54:31.753 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-21T08:54:31.793 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-21T08:54:31.884 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua5.1. 2024-04-21T08:54:31.911 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-21T08:54:31.950 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-21T08:54:32.097 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-21T08:54:32.123 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-21T08:54:32.163 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-21T08:54:32.270 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-any. 2024-04-21T08:54:32.297 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-21T08:54:32.338 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-21T08:54:32.492 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-natsort. 2024-04-21T08:54:32.519 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-21T08:54:32.538 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package zip. 2024-04-21T08:54:32.550 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-21T08:54:32.555 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-21T08:54:32.588 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking zip (3.0-12build2) ... 2024-04-21T08:54:32.845 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-logutils. 2024-04-21T08:54:32.871 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-21T08:54:32.884 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package unzip. 2024-04-21T08:54:32.911 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-21T08:54:32.911 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-21T08:54:32.950 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-21T08:54:33.214 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-21T08:54:33.241 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-21T08:54:33.280 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-21T08:54:33.379 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package luarocks. 2024-04-21T08:54:33.406 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-21T08:54:33.445 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-21T08:54:33.584 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-mako. 2024-04-21T08:54:33.610 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-21T08:54:33.650 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T08:54:33.803 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librgw2. 2024-04-21T08:54:33.820 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../027-librgw2_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:33.861 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librgw2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:33.979 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-21T08:54:34.005 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-21T08:54:34.036 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-21T08:54:34.323 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-21T08:54:34.349 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-21T08:54:34.389 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-21T08:54:34.548 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rgw. 2024-04-21T08:54:34.575 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:34.614 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:34.926 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-21T08:54:34.952 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-21T08:54:34.976 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webob. 2024-04-21T08:54:34.984 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T08:54:35.002 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-21T08:54:35.059 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-21T08:54:35.286 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libradosstriper1. 2024-04-21T08:54:35.313 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:35.353 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libradosstriper1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:35.420 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-waitress. 2024-04-21T08:54:35.447 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-21T08:54:35.490 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T08:54:35.773 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-common. 2024-04-21T08:54:35.781 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-tempita. 2024-04-21T08:54:35.800 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:35.808 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-21T08:54:35.839 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:35.848 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T08:54:36.084 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-paste. 2024-04-21T08:54:36.111 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-21T08:54:36.150 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T08:54:36.479 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-21T08:54:36.494 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-21T08:54:36.529 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T08:54:36.765 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-21T08:54:36.792 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-21T08:54:36.831 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-21T08:54:37.135 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-webtest. 2024-04-21T08:54:37.161 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-21T08:54:37.201 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-21T08:54:37.286 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-base. 2024-04-21T08:54:37.313 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:37.354 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-base (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:37.513 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pecan. 2024-04-21T08:54:37.539 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-21T08:54:37.579 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T08:54:37.932 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-21T08:54:37.959 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-certifi. 2024-04-21T08:54:37.959 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-21T08:54:37.985 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-21T08:54:37.999 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-21T08:54:38.025 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-21T08:54:38.302 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cheroot. 2024-04-21T08:54:38.328 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-21T08:54:38.345 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-idna. 2024-04-21T08:54:38.368 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T08:54:38.371 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-21T08:54:38.403 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-21T08:54:38.655 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-21T08:54:38.670 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-21T08:54:38.689 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-urllib3. 2024-04-21T08:54:38.705 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-21T08:54:38.716 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-21T08:54:38.756 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T08:54:39.808 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-21T08:54:39.836 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-21T08:54:39.860 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests. 2024-04-21T08:54:39.875 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-21T08:54:39.886 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-21T08:54:39.926 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T08:54:40.161 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-21T08:54:40.188 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-21T08:54:40.227 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-21T08:54:40.246 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-21T08:54:40.273 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-21T08:54:40.312 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T08:54:40.505 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempora. 2024-04-21T08:54:40.521 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-21T08:54:40.555 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-21T08:54:40.607 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-21T08:54:40.634 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:40.674 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:40.833 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-portend. 2024-04-21T08:54:40.860 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-21T08:54:40.900 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-21T08:54:41.064 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-21T08:54:41.091 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:41.131 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:41.186 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-21T08:54:41.213 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-21T08:54:41.252 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-21T08:54:41.467 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-21T08:54:41.494 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-21T08:54:41.522 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-21T08:54:41.533 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-21T08:54:41.549 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-21T08:54:41.580 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-21T08:54:41.845 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-openssl. 2024-04-21T08:54:41.872 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-21T08:54:41.909 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-natsort. 2024-04-21T08:54:41.911 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-21T08:54:41.936 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-21T08:54:41.967 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-21T08:54:42.265 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr. 2024-04-21T08:54:42.270 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-logutils. 2024-04-21T08:54:42.291 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:42.298 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-21T08:54:42.331 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:42.337 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-21T08:54:42.640 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-21T08:54:42.667 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-21T08:54:42.706 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-21T08:54:42.726 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mon. 2024-04-21T08:54:42.752 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:42.792 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mon (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:42.992 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-mako. 2024-04-21T08:54:43.008 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-21T08:54:43.042 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T08:54:43.346 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-21T08:54:43.372 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-21T08:54:43.403 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-21T08:54:43.404 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-osd. 2024-04-21T08:54:43.431 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:43.471 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-osd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:43.690 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-21T08:54:43.717 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-21T08:54:43.765 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-21T08:54:44.068 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webob. 2024-04-21T08:54:44.095 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-21T08:54:44.134 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-21T08:54:44.487 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-waitress. 2024-04-21T08:54:44.514 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-21T08:54:44.532 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph. 2024-04-21T08:54:44.548 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:44.591 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:44.748 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T08:54:44.927 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-fuse. 2024-04-21T08:54:44.953 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:44.993 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:45.057 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempita. 2024-04-21T08:54:45.084 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-21T08:54:45.123 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T08:54:45.376 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-paste. 2024-04-21T08:54:45.403 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-21T08:54:45.405 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mds. 2024-04-21T08:54:45.431 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:45.443 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T08:54:45.471 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mds (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:45.746 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-21T08:54:45.762 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-21T08:54:45.804 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T08:54:45.833 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephadm. 2024-04-21T08:54:45.856 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:45.891 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:46.107 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-21T08:54:46.134 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-21T08:54:46.173 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-21T08:54:46.194 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-21T08:54:46.221 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-21T08:54:46.260 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-21T08:54:46.435 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webtest. 2024-04-21T08:54:46.462 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-21T08:54:46.493 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-21T08:54:46.554 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-21T08:54:46.570 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T08:54:46.604 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T08:54:46.788 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pecan. 2024-04-21T08:54:46.815 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-21T08:54:46.855 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T08:54:47.226 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-certifi. 2024-04-21T08:54:47.253 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-21T08:54:47.292 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-21T08:54:47.612 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-idna. 2024-04-21T08:54:47.639 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-21T08:54:47.668 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-babel. 2024-04-21T08:54:47.678 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-21T08:54:47.695 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T08:54:47.734 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T08:54:47.989 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-urllib3. 2024-04-21T08:54:48.017 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-21T08:54:48.056 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T08:54:48.062 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-jinja2. 2024-04-21T08:54:48.089 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-21T08:54:48.129 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T08:54:48.359 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests. 2024-04-21T08:54:48.386 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-21T08:54:48.426 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T08:54:48.474 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-21T08:54:48.500 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:48.540 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:48.729 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-21T08:54:48.745 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-21T08:54:48.778 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T08:54:48.894 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-21T08:54:48.921 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-21T08:54:48.960 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-21T08:54:49.082 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-21T08:54:49.109 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:49.148 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:49.288 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-routes. 2024-04-21T08:54:49.315 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-21T08:54:49.354 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T08:54:49.512 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-21T08:54:49.539 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:49.578 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:49.692 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-21T08:54:49.718 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:49.758 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:49.881 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-21T08:54:49.908 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-21T08:54:49.947 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-21T08:54:50.250 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-openssl. 2024-04-21T08:54:50.277 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-21T08:54:50.325 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-21T08:54:50.603 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr. 2024-04-21T08:54:50.630 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:50.661 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:51.030 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-21T08:54:51.045 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-21T08:54:51.048 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mon. 2024-04-21T08:54:51.075 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:51.088 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T08:54:51.114 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mon (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:51.592 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-joblib. 2024-04-21T08:54:51.618 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-21T08:54:51.658 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T08:54:51.718 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-osd. 2024-04-21T08:54:51.745 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:51.784 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-osd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:51.962 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-21T08:54:51.988 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-21T08:54:52.122 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-21T08:54:52.450 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-sklearn. 2024-04-21T08:54:52.477 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-21T08:54:52.517 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T08:54:52.829 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph. 2024-04-21T08:54:52.845 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../068-ceph_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:52.879 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:53.182 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-fuse. 2024-04-21T08:54:53.209 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:53.243 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-21T08:54:53.248 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:53.270 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:53.309 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:53.587 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mds. 2024-04-21T08:54:53.614 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:53.653 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mds (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:54.006 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephadm. 2024-04-21T08:54:54.033 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../071-cephadm_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:54.064 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:54.238 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-cachetools. 2024-04-21T08:54:54.265 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-21T08:54:54.304 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-21T08:54:54.375 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-21T08:54:54.402 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-21T08:54:54.442 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-21T08:54:54.591 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-21T08:54:54.618 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-21T08:54:54.649 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-21T08:54:54.711 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-21T08:54:54.727 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T08:54:54.903 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T08:54:54.936 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-21T08:54:54.963 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-21T08:54:55.002 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T08:54:55.289 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-rsa. 2024-04-21T08:54:55.305 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-21T08:54:55.346 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-21T08:54:55.667 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-google-auth. 2024-04-21T08:54:55.695 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-21T08:54:55.734 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-21T08:54:55.925 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-babel. 2024-04-21T08:54:55.952 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-21T08:54:55.991 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T08:54:56.054 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-21T08:54:56.082 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-21T08:54:56.120 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T08:54:56.327 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jinja2. 2024-04-21T08:54:56.354 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-21T08:54:56.390 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-websocket. 2024-04-21T08:54:56.394 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T08:54:56.406 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-21T08:54:56.440 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-21T08:54:56.722 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-21T08:54:56.735 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-21T08:54:56.749 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:56.763 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-21T08:54:56.788 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:56.827 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T08:54:57.125 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-21T08:54:57.152 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-21T08:54:57.191 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-21T08:54:57.494 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-routes. 2024-04-21T08:54:57.522 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-21T08:54:57.549 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-21T08:54:57.561 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T08:54:57.565 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:57.607 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:57.881 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-21T08:54:57.908 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:54:57.935 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-21T08:54:57.947 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:54:57.962 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-21T08:54:58.002 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T08:54:58.297 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-21T08:54:58.324 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T08:54:58.355 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T08:54:58.616 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package jq. 2024-04-21T08:54:58.643 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T08:54:58.682 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-21T08:54:58.935 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package socat. 2024-04-21T08:54:58.963 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-21T08:54:59.002 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-21T08:54:59.102 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-21T08:54:59.119 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-21T08:54:59.169 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T08:54:59.280 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package xmlstarlet. 2024-04-21T08:54:59.296 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-21T08:54:59.338 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-21T08:54:59.680 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-joblib. 2024-04-21T08:54:59.701 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-test. 2024-04-21T08:54:59.708 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-21T08:54:59.728 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:54:59.747 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T08:54:59.767 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-test (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:00.117 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-21T08:55:00.145 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-21T08:55:00.269 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-21T08:55:00.697 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn. 2024-04-21T08:55:00.725 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-21T08:55:00.763 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T08:55:01.473 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-21T08:55:01.501 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:01.531 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:02.426 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cachetools. 2024-04-21T08:55:02.453 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-21T08:55:02.480 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ceph-volume. 2024-04-21T08:55:02.492 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-21T08:55:02.507 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:02.555 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ceph-volume (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:02.795 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-21T08:55:02.823 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-21T08:55:02.861 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-21T08:55:03.001 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-21T08:55:03.028 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:03.076 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephfs-mirror (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:03.215 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-21T08:55:03.243 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-21T08:55:03.281 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T08:55:03.421 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-colorama. 2024-04-21T08:55:03.448 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-21T08:55:03.487 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-21T08:55:03.593 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rsa. 2024-04-21T08:55:03.620 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-21T08:55:03.659 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-21T08:55:03.740 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephfs-shell. 2024-04-21T08:55:03.756 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:03.798 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephfs-shell (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:03.938 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-google-auth. 2024-04-21T08:55:03.954 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-21T08:55:03.987 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-21T08:55:04.084 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package cephfs-top. 2024-04-21T08:55:04.112 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:04.159 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking cephfs-top (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:04.283 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-21T08:55:04.310 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-21T08:55:04.349 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T08:55:04.479 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-21T08:55:04.507 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:04.561 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libcephfs-dev (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:04.660 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-websocket. 2024-04-21T08:55:04.688 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-21T08:55:04.726 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-21T08:55:04.923 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-21T08:55:04.950 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-21T08:55:04.989 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T08:55:05.255 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-21T08:55:05.283 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-21T08:55:05.322 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T08:55:05.336 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-21T08:55:05.363 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-21T08:55:05.402 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-21T08:55:05.740 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package nvme-cli. 2024-04-21T08:55:05.768 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-21T08:55:05.798 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T08:55:06.011 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-21T08:55:06.039 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:06.077 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:06.145 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package pkg-config. 2024-04-21T08:55:06.172 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-21T08:55:06.203 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T08:55:06.347 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-21T08:55:06.375 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-21T08:55:06.405 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T08:55:06.456 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-21T08:55:06.472 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-21T08:55:06.539 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-21T08:55:06.733 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-21T08:55:06.761 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T08:55:06.816 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T08:55:07.010 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-21T08:55:07.037 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-21T08:55:07.076 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-21T08:55:07.077 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package jq. 2024-04-21T08:55:07.105 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-21T08:55:07.143 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-21T08:55:07.362 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pastescript. 2024-04-21T08:55:07.388 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package socat. 2024-04-21T08:55:07.389 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-21T08:55:07.404 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-21T08:55:07.428 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-21T08:55:07.438 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-21T08:55:07.740 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pluggy. 2024-04-21T08:55:07.749 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package xmlstarlet. 2024-04-21T08:55:07.766 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-21T08:55:07.768 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-21T08:55:07.798 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-21T08:55:07.799 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-21T08:55:08.068 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-psutil. 2024-04-21T08:55:08.096 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-21T08:55:08.134 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-21T08:55:08.154 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-test. 2024-04-21T08:55:08.182 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:08.220 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-test (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:08.529 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-py. 2024-04-21T08:55:08.557 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-21T08:55:08.596 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-21T08:55:08.933 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pygments. 2024-04-21T08:55:08.961 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-21T08:55:08.999 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T08:55:09.478 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-21T08:55:09.506 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-21T08:55:09.544 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-21T08:55:09.856 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-toml. 2024-04-21T08:55:09.883 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-21T08:55:09.922 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-21T08:55:10.192 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-pytest. 2024-04-21T08:55:10.220 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-21T08:55:10.258 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T08:55:10.482 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-volume. 2024-04-21T08:55:10.499 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:10.532 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-volume (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:10.612 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package python3-simplejson. 2024-04-21T08:55:10.640 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-21T08:55:10.678 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-21T08:55:10.911 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-21T08:55:10.939 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:10.948 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-21T08:55:10.976 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-21T08:55:10.986 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-mirror (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:11.015 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-21T08:55:11.297 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-colorama. 2024-04-21T08:55:11.325 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-21T08:55:11.364 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-21T08:55:11.633 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-shell. 2024-04-21T08:55:11.649 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:11.691 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-shell (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:11.794 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package radosgw. 2024-04-21T08:55:11.822 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:11.860 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking radosgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:11.952 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-top. 2024-04-21T08:55:11.968 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3154-ga630765c-1jammy_all.deb ... 2024-04-21T08:55:12.010 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-top (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:12.263 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-21T08:55:12.291 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:12.329 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs-dev (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:12.599 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-21T08:55:12.627 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-21T08:55:12.655 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package rbd-fuse. 2024-04-21T08:55:12.657 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T08:55:12.672 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:12.713 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking rbd-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:12.970 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-21T08:55:12.998 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-21T08:55:13.035 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-21T08:55:13.036 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-21T08:55:13.285 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T08:55:13.386 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T08:55:13.398 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package nvme-cli. 2024-04-21T08:55:13.426 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-21T08:55:13.465 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T08:55:13.645 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-21T08:55:13.895 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package pkg-config. 2024-04-21T08:55:13.923 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-21T08:55:13.967 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-21T08:55:13.995 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T08:55:14.231 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-21T08:55:14.248 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-21T08:55:14.281 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-21T08:55:14.414 INFO:teuthology.orchestra.run.smithi169.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-21T08:55:14.479 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:14.676 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-21T08:55:14.704 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-21T08:55:14.733 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-21T08:55:14.979 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user cephadm....done 2024-04-21T08:55:15.003 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastescript. 2024-04-21T08:55:15.032 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-21T08:55:15.078 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-21T08:55:15.127 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T08:55:15.395 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-21T08:55:15.398 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pluggy. 2024-04-21T08:55:15.427 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-21T08:55:15.464 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-21T08:55:15.647 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-21T08:55:15.790 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-21T08:55:15.901 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-psutil. 2024-04-21T08:55:15.917 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-21T08:55:15.950 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-21T08:55:16.041 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-21T08:55:16.287 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-py. 2024-04-21T08:55:16.300 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T08:55:16.315 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-21T08:55:16.353 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-21T08:55:16.418 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-21T08:55:16.631 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pygments. 2024-04-21T08:55:16.648 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-21T08:55:16.690 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T08:55:16.728 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T08:55:17.088 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-21T08:55:17.127 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-21T08:55:17.155 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-21T08:55:17.193 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-21T08:55:17.356 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-21T08:55:17.488 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-toml. 2024-04-21T08:55:17.516 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-21T08:55:17.571 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-21T08:55:17.616 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-21T08:55:17.874 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pytest. 2024-04-21T08:55:17.883 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-21T08:55:17.902 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-21T08:55:17.940 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T08:55:18.127 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-21T08:55:18.227 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplejson. 2024-04-21T08:55:18.243 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-21T08:55:18.285 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-21T08:55:18.361 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-21T08:55:18.555 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-21T08:55:18.583 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-21T08:55:18.620 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-21T08:55:18.621 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-21T08:55:18.930 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-argparse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:19.198 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T08:55:19.324 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T08:55:19.358 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package radosgw. 2024-04-21T08:55:19.387 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../122-radosgw_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:19.424 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking radosgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:19.450 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-21T08:55:19.685 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T08:55:19.794 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-21T08:55:20.054 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-21T08:55:20.294 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package rbd-fuse. 2024-04-21T08:55:20.311 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3154-ga630765c-1jammy_amd64.deb ... 2024-04-21T08:55:20.352 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking rbd-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:20.425 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-21T08:55:20.460 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-21T08:55:20.524 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T08:55:20.650 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-21T08:55:20.666 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-21T08:55:20.924 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-21T08:55:21.009 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T08:55:21.025 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-21T08:55:21.289 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-21T08:55:21.337 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-21T08:55:21.619 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-21T08:55:21.778 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T08:55:22.056 INFO:teuthology.orchestra.run.smithi026.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-21T08:55:22.071 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-21T08:55:22.126 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:22.389 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up zip (3.0-12build2) ... 2024-04-21T08:55:22.515 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T08:55:22.794 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user cephadm....done 2024-04-21T08:55:22.941 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-21T08:55:23.209 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T08:55:23.217 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-21T08:55:23.460 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T08:55:23.468 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-21T08:55:23.569 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-21T08:55:23.586 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-21T08:55:23.712 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T08:55:23.888 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-21T08:55:24.004 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-21T08:55:24.155 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-21T08:55:24.281 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-21T08:55:24.389 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-21T08:55:24.608 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-21T08:55:24.640 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T08:55:25.002 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-21T08:55:25.017 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T08:55:25.261 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-21T08:55:25.285 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-21T08:55:25.529 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-21T08:55:25.578 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T08:55:25.805 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-21T08:55:25.930 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-21T08:55:26.082 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-21T08:55:26.197 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-21T08:55:26.325 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:26.333 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-21T08:55:26.576 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-21T08:55:26.610 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-idna (3.3-1) ... 2024-04-21T08:55:26.835 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-argparse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:26.911 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T08:55:27.103 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-21T08:55:27.229 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-21T08:55:27.357 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-21T08:55:27.615 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-21T08:55:27.740 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-21T08:55:27.991 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-21T08:55:28.101 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T08:55:28.310 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:55:28.357 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-21T08:55:28.415 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-21T08:55:28.445 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-21T08:55:28.486 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-21T08:55:28.587 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-21T08:55:28.704 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T08:55:28.830 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-21T08:55:28.938 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-21T08:55:28.956 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T08:55:29.064 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-21T08:55:29.258 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-21T08:55:29.332 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-21T08:55:29.509 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-21T08:55:29.583 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-21T08:55:29.752 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:55:29.861 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-21T08:55:29.893 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up zip (3.0-12build2) ... 2024-04-21T08:55:30.019 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-21T08:55:30.187 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-21T08:55:30.438 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-21T08:55:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-21T08:55:30.746 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-21T08:55:30.973 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-21T08:55:31.205 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-21T08:55:31.233 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-21T08:55:31.331 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-21T08:55:31.457 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-21T08:55:31.476 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T08:55:31.577 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-21T08:55:31.758 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-21T08:55:31.845 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T08:55:31.971 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T08:55:32.184 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-21T08:55:32.272 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-21T08:55:32.452 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-21T08:55:32.573 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-21T08:55:32.832 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T08:55:32.837 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-21T08:55:32.958 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-21T08:55:33.078 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T08:55:33.130 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-21T08:55:33.149 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-21T08:55:33.378 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T08:55:33.440 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-21T08:55:33.504 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T08:55:33.774 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-21T08:55:33.905 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-21T08:55:34.025 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-21T08:55:34.151 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:34.164 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-21T08:55:34.291 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-21T08:55:34.452 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-idna (3.3-1) ... 2024-04-21T08:55:34.567 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:55:34.676 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T08:55:34.754 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-21T08:55:34.977 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T08:55:35.287 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T08:55:35.563 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-21T08:55:35.783 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-21T08:55:35.993 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-21T08:55:36.034 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-21T08:55:36.228 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:55:36.302 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T08:55:36.345 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-21T08:55:36.562 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-21T08:55:36.597 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-21T08:55:36.722 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-21T08:55:36.823 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-21T08:55:36.963 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-21T08:55:37.108 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-21T08:55:37.265 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T08:55:37.368 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-21T08:55:37.600 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T08:55:37.619 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:55:37.710 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librados2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:37.722 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-21T08:55:37.827 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:37.953 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-21T08:55:38.023 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-21T08:55:38.266 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-21T08:55:38.289 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:38.415 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libradosstriper1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:38.533 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-21T08:55:38.541 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-21T08:55:38.793 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-21T08:55:38.818 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librbd1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:38.927 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:39.077 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-21T08:55:39.078 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:39.293 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T08:55:39.294 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T08:55:39.353 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-21T08:55:39.479 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-21T08:55:39.772 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-21T08:55:39.796 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libcephfs-dev (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:39.907 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-21T08:55:39.922 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rados (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:40.048 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up librgw2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephfs-top (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:40.191 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-21T08:55:40.300 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T08:55:40.492 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-21T08:55:40.752 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-21T08:55:40.877 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-21T08:55:41.003 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-21T08:55:41.092 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-21T08:55:41.339 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-21T08:55:41.465 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-21T08:55:41.537 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rbd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:41.663 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up rbd-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:41.789 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-rgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:41.866 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-21T08:55:41.915 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up python3-cephfs (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:42.041 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephfs-shell (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:42.134 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-21T08:55:42.167 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:42.260 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-21T08:55:42.527 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-21T08:55:42.628 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-21T08:55:42.668 INFO:teuthology.orchestra.run.smithi169.stdout:Adding group ceph....done 2024-04-21T08:55:42.929 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-21T08:55:43.078 INFO:teuthology.orchestra.run.smithi169.stdout:Adding system user ceph....done 2024-04-21T08:55:43.220 INFO:teuthology.orchestra.run.smithi169.stdout:Setting system user ceph properties....done 2024-04-21T08:55:43.230 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-21T08:55:43.236 INFO:teuthology.orchestra.run.smithi169.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-21T08:55:43.370 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-21T08:55:43.507 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-21T08:55:43.685 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-21T08:55:43.718 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-21T08:55:43.953 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-21T08:55:44.193 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up cephfs-mirror (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:44.220 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-21T08:55:44.387 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T08:55:44.387 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T08:55:44.489 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-21T08:55:44.828 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-test (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:44.882 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-21T08:55:44.929 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up radosgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:45.167 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-21T08:55:45.391 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T08:55:45.391 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T08:55:45.511 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-21T08:55:45.612 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librados2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:45.730 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:45.839 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-base (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:45.856 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-21T08:55:46.192 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:46.219 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-21T08:55:46.318 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libradosstriper1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:46.428 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-21T08:55:46.737 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librbd1 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:46.767 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mds (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:46.855 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-modules-core (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:46.979 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T08:55:46.979 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T08:55:46.981 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:47.200 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T08:55:47.200 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-21T08:55:47.498 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:47.683 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs-dev (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:47.716 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T08:55:47.716 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T08:55:47.810 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rados (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:47.934 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librgw2 (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:48.060 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-top (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:48.161 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-21T08:55:48.199 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-osd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:48.484 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T08:55:48.484 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T08:55:48.951 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.060 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.211 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mon (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.422 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T08:55:49.422 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T08:55:49.432 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rbd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.541 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up rbd-fuse (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.667 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.793 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cephfs (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.913 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:49.919 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-shell (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:50.055 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:50.070 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-common (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:50.181 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:50.332 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ceph-volume (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:50.563 INFO:teuthology.orchestra.run.smithi026.stdout:Adding group ceph....done 2024-04-21T08:55:50.686 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T08:55:50.786 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T08:55:50.922 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user ceph....done 2024-04-21T08:55:50.938 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T08:55:51.091 INFO:teuthology.orchestra.run.smithi026.stdout:Setting system user ceph properties....done 2024-04-21T08:55:51.106 INFO:teuthology.orchestra.run.smithi026.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-21T08:55:51.251 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-21T08:55:51.593 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-21T08:55:52.063 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-mirror (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:52.206 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T08:55:52.284 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T08:55:52.285 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-21T08:55:52.756 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-test (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:52.836 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T08:55:52.839 DEBUG:teuthology.orchestra.run.smithi169:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-21T08:55:52.865 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up radosgw (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:52.893 INFO:teuthology.orchestra.run.smithi169.stdout:Reading package lists... 2024-04-21T08:55:53.093 INFO:teuthology.orchestra.run.smithi169.stdout:Building dependency tree... 2024-04-21T08:55:53.094 INFO:teuthology.orchestra.run.smithi169.stdout:Reading state information... 2024-04-21T08:55:53.271 INFO:teuthology.orchestra.run.smithi169.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-21T08:55:53.271 INFO:teuthology.orchestra.run.smithi169.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-21T08:55:53.271 INFO:teuthology.orchestra.run.smithi169.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-21T08:55:53.271 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:55:53.271 INFO:teuthology.orchestra.run.smithi169.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:55:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:55:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:55:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T08:55:53.272 INFO:teuthology.orchestra.run.smithi169.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T08:55:53.272 INFO:teuthology.orchestra.run.smithi169.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:55:53.273 INFO:teuthology.orchestra.run.smithi169.stdout:The following additional packages will be installed: 2024-04-21T08:55:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-21T08:55:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-21T08:55:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-21T08:55:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-21T08:55:53.273 INFO:teuthology.orchestra.run.smithi169.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T08:55:53.274 INFO:teuthology.orchestra.run.smithi169.stdout:Suggested packages: 2024-04-21T08:55:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-21T08:55:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-21T08:55:53.274 INFO:teuthology.orchestra.run.smithi169.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-21T08:55:53.315 INFO:teuthology.orchestra.run.smithi169.stdout:The following NEW packages will be installed: 2024-04-21T08:55:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-21T08:55:53.315 INFO:teuthology.orchestra.run.smithi169.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-21T08:55:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-21T08:55:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-21T08:55:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-21T08:55:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-21T08:55:53.316 INFO:teuthology.orchestra.run.smithi169.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T08:55:53.317 INFO:teuthology.orchestra.run.smithi169.stdout:The following packages will be upgraded: 2024-04-21T08:55:53.317 INFO:teuthology.orchestra.run.smithi169.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-21T08:55:53.331 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T08:55:53.331 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-21T08:55:53.375 INFO:teuthology.orchestra.run.smithi169.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-21T08:55:53.375 INFO:teuthology.orchestra.run.smithi169.stdout:Need to get 55.7 MB of archives. 2024-04-21T08:55:53.375 INFO:teuthology.orchestra.run.smithi169.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-21T08:55:53.376 INFO:teuthology.orchestra.run.smithi169.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-21T08:55:53.537 INFO:teuthology.orchestra.run.smithi169.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-21T08:55:53.546 INFO:teuthology.orchestra.run.smithi169.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-21T08:55:53.589 INFO:teuthology.orchestra.run.smithi169.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-21T08:55:53.590 INFO:teuthology.orchestra.run.smithi169.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-21T08:55:53.590 INFO:teuthology.orchestra.run.smithi169.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-21T08:55:53.601 INFO:teuthology.orchestra.run.smithi169.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-21T08:55:53.601 INFO:teuthology.orchestra.run.smithi169.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-21T08:55:53.604 INFO:teuthology.orchestra.run.smithi169.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-21T08:55:53.605 INFO:teuthology.orchestra.run.smithi169.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-21T08:55:53.605 INFO:teuthology.orchestra.run.smithi169.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-21T08:55:53.607 INFO:teuthology.orchestra.run.smithi169.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-21T08:55:53.612 INFO:teuthology.orchestra.run.smithi169.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-21T08:55:53.629 INFO:teuthology.orchestra.run.smithi169.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-21T08:55:53.630 INFO:teuthology.orchestra.run.smithi169.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-21T08:55:53.631 INFO:teuthology.orchestra.run.smithi169.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-21T08:55:53.809 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-base (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:53.995 INFO:teuthology.orchestra.run.smithi169.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-21T08:55:53.997 INFO:teuthology.orchestra.run.smithi169.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-21T08:55:53.997 INFO:teuthology.orchestra.run.smithi169.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-21T08:55:53.999 INFO:teuthology.orchestra.run.smithi169.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-21T08:55:53.999 INFO:teuthology.orchestra.run.smithi169.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-21T08:55:54.004 INFO:teuthology.orchestra.run.smithi169.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-21T08:55:54.005 INFO:teuthology.orchestra.run.smithi169.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-21T08:55:54.012 INFO:teuthology.orchestra.run.smithi169.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-21T08:55:54.012 INFO:teuthology.orchestra.run.smithi169.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-21T08:55:54.033 INFO:teuthology.orchestra.run.smithi169.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-21T08:55:54.035 INFO:teuthology.orchestra.run.smithi169.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-21T08:55:54.046 INFO:teuthology.orchestra.run.smithi169.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-21T08:55:54.070 INFO:teuthology.orchestra.run.smithi169.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-21T08:55:54.074 INFO:teuthology.orchestra.run.smithi169.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-21T08:55:54.074 INFO:teuthology.orchestra.run.smithi169.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-21T08:55:54.075 INFO:teuthology.orchestra.run.smithi169.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-21T08:55:54.075 INFO:teuthology.orchestra.run.smithi169.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-21T08:55:54.086 INFO:teuthology.orchestra.run.smithi169.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-21T08:55:54.088 INFO:teuthology.orchestra.run.smithi169.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-21T08:55:54.170 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-21T08:55:54.301 INFO:teuthology.orchestra.run.smithi169.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-21T08:55:54.302 INFO:teuthology.orchestra.run.smithi169.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-21T08:55:54.302 INFO:teuthology.orchestra.run.smithi169.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-21T08:55:54.302 INFO:teuthology.orchestra.run.smithi169.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-21T08:55:54.302 INFO:teuthology.orchestra.run.smithi169.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-21T08:55:54.302 INFO:teuthology.orchestra.run.smithi169.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-21T08:55:54.314 INFO:teuthology.orchestra.run.smithi169.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-21T08:55:54.314 INFO:teuthology.orchestra.run.smithi169.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-21T08:55:54.627 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mds (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:54.718 INFO:teuthology.orchestra.run.smithi169.stdout:Preconfiguring packages ... 2024-04-21T08:55:54.863 INFO:teuthology.orchestra.run.smithi169.stdout:Fetched 55.7 MB in 1s (56.3 MB/s) 2024-04-21T08:55:54.882 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T08:55:54.882 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-21T08:55:55.209 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-21T08:55:55.214 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T08:55:55.370 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:55.379 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T08:55:55.601 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T08:55:55.601 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-21T08:55:56.033 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-21T08:55:56.096 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-osd (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:56.373 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T08:55:56.373 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-21T08:55:56.874 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:56.992 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:56.992 INFO:teuthology.orchestra.run.smithi169.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-21T08:55:57.143 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mon (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:57.291 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package flex. 2024-04-21T08:55:57.394 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-21T08:55:57.394 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T08:55:57.394 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-21T08:55:57.399 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-21T08:55:57.440 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-21T08:55:57.885 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-cephadm (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:57.906 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T08:55:58.020 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:58.046 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-21T08:55:58.146 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-dashboard (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:58.297 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-volume (19.0.0-3154-ga630765c-1jammy) ... 2024-04-21T08:55:58.498 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T08:55:58.642 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T08:55:58.742 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T08:55:58.878 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T08:55:59.013 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-21T08:55:59.019 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T08:55:59.119 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T08:55:59.545 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T08:55:59.676 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T08:56:00.003 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T08:56:00.020 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T08:56:00.493 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package bison. 2024-04-21T08:56:00.598 INFO:teuthology.orchestra.run.smithi169.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-21T08:56:00.603 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-21T08:56:00.638 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T08:56:00.641 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-21T08:56:00.653 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T08:56:00.698 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-21T08:56:00.902 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-21T08:56:00.902 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-21T08:56:01.063 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-21T08:56:01.082 INFO:teuthology.orchestra.run.smithi026.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-21T08:56:01.082 INFO:teuthology.orchestra.run.smithi026.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-21T08:56:01.082 INFO:teuthology.orchestra.run.smithi026.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-21T08:56:01.082 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-21T08:56:01.082 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-21T08:56:01.082 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-21T08:56:01.082 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-21T08:56:01.083 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-21T08:56:01.083 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-21T08:56:01.083 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-21T08:56:01.084 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2024-04-21T08:56:01.084 INFO:teuthology.orchestra.run.smithi026.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-21T08:56:01.084 INFO:teuthology.orchestra.run.smithi026.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-21T08:56:01.084 INFO:teuthology.orchestra.run.smithi026.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-21T08:56:01.084 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-21T08:56:01.084 INFO:teuthology.orchestra.run.smithi026.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T08:56:01.086 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2024-04-21T08:56:01.086 INFO:teuthology.orchestra.run.smithi026.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-21T08:56:01.086 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-21T08:56:01.086 INFO:teuthology.orchestra.run.smithi026.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-21T08:56:01.090 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-21T08:56:01.127 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2024-04-21T08:56:01.127 INFO:teuthology.orchestra.run.smithi026.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-21T08:56:01.127 INFO:teuthology.orchestra.run.smithi026.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-21T08:56:01.128 INFO:teuthology.orchestra.run.smithi026.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-21T08:56:01.128 INFO:teuthology.orchestra.run.smithi026.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-21T08:56:01.128 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-21T08:56:01.128 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-21T08:56:01.128 INFO:teuthology.orchestra.run.smithi026.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-21T08:56:01.129 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages will be upgraded: 2024-04-21T08:56:01.129 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T08:56:01.130 INFO:teuthology.orchestra.run.smithi026.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-21T08:56:01.310 INFO:teuthology.orchestra.run.smithi026.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-21T08:56:01.310 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 55.7 MB of archives. 2024-04-21T08:56:01.310 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-21T08:56:01.310 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-21T08:56:01.466 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package dump. 2024-04-21T08:56:01.493 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-21T08:56:01.532 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking dump (0.4b47-3) ... 2024-04-21T08:56:01.803 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package indent. 2024-04-21T08:56:01.816 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:01.853 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T08:56:01.938 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-21T08:56:01.954 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-21T08:56:02.079 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-21T08:56:02.080 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-21T08:56:02.081 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-21T08:56:02.110 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-21T08:56:02.111 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-21T08:56:02.115 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-21T08:56:02.118 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-21T08:56:02.119 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-21T08:56:02.147 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-21T08:56:02.175 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-21T08:56:02.214 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T08:56:02.305 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-21T08:56:02.576 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-21T08:56:02.590 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-21T08:56:02.599 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-21T08:56:02.604 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-21T08:56:02.605 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-21T08:56:02.643 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T08:56:02.690 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-21T08:56:02.896 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-21T08:56:02.923 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-21T08:56:02.979 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T08:56:03.324 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-21T08:56:03.352 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-21T08:56:03.390 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:03.618 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-21T08:56:03.635 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-21T08:56:03.668 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:03.817 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-21T08:56:03.821 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-21T08:56:03.822 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-21T08:56:03.828 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-21T08:56:03.829 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-21T08:56:03.840 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-21T08:56:03.896 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libjson-perl. 2024-04-21T08:56:03.920 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-21T08:56:03.962 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-21T08:56:04.007 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-21T08:56:04.274 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-21T08:56:04.301 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-21T08:56:04.340 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T08:56:04.598 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-21T08:56:04.598 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-21T08:56:04.778 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-21T08:56:04.779 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-21T08:56:04.817 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-21T08:56:04.876 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-21T08:56:04.886 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-21T08:56:04.887 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-21T08:56:04.888 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-21T08:56:04.889 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-21T08:56:05.092 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-21T08:56:05.504 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-21T08:56:06.052 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-21T08:56:06.079 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T08:56:06.118 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:06.323 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-21T08:56:06.345 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-21T08:56:06.362 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-21T08:56:06.362 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-21T08:56:06.363 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-21T08:56:06.364 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-21T08:56:06.364 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-21T08:56:06.373 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T08:56:06.395 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-21T08:56:06.396 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-21T08:56:06.405 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:06.732 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-21T08:56:06.759 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T08:56:06.798 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:06.814 INFO:teuthology.orchestra.run.smithi026.stdout:Preconfiguring packages ... 2024-04-21T08:56:06.994 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 55.7 MB in 5s (10.6 MB/s) 2024-04-21T08:56:07.168 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-21T08:56:07.196 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-21T08:56:07.234 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T08:56:07.346 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-21T08:56:07.352 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T08:56:07.479 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T08:56:07.546 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-21T08:56:07.574 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T08:56:07.604 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T08:56:07.957 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-21T08:56:07.985 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:08.024 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:08.092 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-21T08:56:08.369 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-21T08:56:08.396 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:08.436 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:08.729 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-21T08:56:08.745 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:08.779 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:09.006 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-21T08:56:09.023 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T08:56:09.064 INFO:teuthology.orchestra.run.smithi026.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-21T08:56:09.065 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T08:56:09.350 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package flex. 2024-04-21T08:56:09.435 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-21T08:56:09.441 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-21T08:56:09.490 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-21T08:56:09.586 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-21T08:56:09.613 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-21T08:56:09.652 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T08:56:09.955 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package modemmanager. 2024-04-21T08:56:09.983 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T08:56:10.006 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T08:56:10.030 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:10.178 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-21T08:56:10.573 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T08:56:10.662 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package network-manager. 2024-04-21T08:56:10.690 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T08:56:10.746 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-21T08:56:11.076 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-21T08:56:11.081 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T08:56:11.194 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T08:56:11.386 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package ppp. 2024-04-21T08:56:11.414 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-21T08:56:11.579 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-21T08:56:11.682 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T08:56:11.709 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-21T08:56:11.991 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package pptp-linux. 2024-04-21T08:56:12.018 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-21T08:56:12.054 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T08:56:12.057 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-21T08:56:12.278 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-21T08:56:12.294 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-21T08:56:12.328 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-21T08:56:12.444 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package bison. 2024-04-21T08:56:12.551 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-21T08:56:12.557 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-21T08:56:12.604 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T08:56:12.665 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-21T08:56:12.693 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-21T08:56:12.731 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-client-common (238) ... 2024-04-21T08:56:13.013 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-21T08:56:13.041 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-21T08:56:13.080 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T08:56:13.169 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-21T08:56:13.197 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:13.235 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:13.391 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package dump. 2024-04-21T08:56:13.419 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-21T08:56:13.458 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking dump (0.4b47-3) ... 2024-04-21T08:56:13.695 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package indent. 2024-04-21T08:56:13.711 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:13.745 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T08:56:13.765 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-common. 2024-04-21T08:56:13.793 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-21T08:56:13.841 INFO:teuthology.orchestra.run.smithi169.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-21T08:56:13.871 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-common (238) ... 2024-04-21T08:56:13.998 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-21T08:56:14.026 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-21T08:56:14.064 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T08:56:14.330 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-14. 2024-04-21T08:56:14.359 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:14.393 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-21T08:56:14.400 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:14.421 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-21T08:56:14.460 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T08:56:14.688 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-21T08:56:14.716 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-21T08:56:14.745 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T08:56:15.058 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-21T08:56:15.086 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-21T08:56:15.124 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:15.396 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-21T08:56:15.424 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-21T08:56:15.468 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:15.675 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql. 2024-04-21T08:56:15.696 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjson-perl. 2024-04-21T08:56:15.704 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-21T08:56:15.712 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-21T08:56:15.746 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-21T08:56:15.749 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql (14+238) ... 2024-04-21T08:56:16.010 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-client. 2024-04-21T08:56:16.024 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-21T08:56:16.026 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-21T08:56:16.052 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-21T08:56:16.068 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-client (14+238) ... 2024-04-21T08:56:16.091 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T08:56:16.321 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-21T08:56:16.349 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-21T08:56:16.387 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-21T08:56:16.765 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package tcl8.6. 2024-04-21T08:56:16.793 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-21T08:56:16.840 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T08:56:17.184 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package tcl. 2024-04-21T08:56:17.212 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-21T08:56:17.264 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-21T08:56:17.637 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package wpasupplicant. 2024-04-21T08:56:17.665 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-21T08:56:17.721 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T08:56:17.828 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-21T08:56:17.856 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T08:56:17.895 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:18.092 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-21T08:56:18.108 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-21T08:56:18.150 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-21T08:56:18.381 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-21T08:56:18.409 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-21T08:56:18.448 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:18.461 INFO:teuthology.orchestra.run.smithi169.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-21T08:56:18.489 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-21T08:56:18.528 INFO:teuthology.orchestra.run.smithi169.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T08:56:18.816 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-client-common (238) ... 2024-04-21T08:56:18.867 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-21T08:56:18.896 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T08:56:18.934 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:19.025 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-21T08:56:19.151 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T08:56:19.277 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:19.295 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-21T08:56:19.323 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-21T08:56:19.362 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T08:56:19.412 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T08:56:19.521 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T08:56:19.623 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:19.673 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-21T08:56:19.701 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T08:56:19.739 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T08:56:20.100 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-21T08:56:20.109 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-21T08:56:20.137 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:20.176 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:20.194 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T08:56:20.479 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-21T08:56:20.507 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:20.545 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:20.656 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T08:56:20.656 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T08:56:20.848 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-21T08:56:20.876 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:20.915 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:21.148 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T08:56:21.159 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-21T08:56:21.175 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-21T08:56:21.217 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T08:56:21.256 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T08:56:21.408 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T08:56:21.534 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-21T08:56:21.660 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T08:56:21.721 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-21T08:56:21.749 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-21T08:56:21.785 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:21.787 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T08:56:21.937 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T08:56:22.079 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T08:56:22.157 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package modemmanager. 2024-04-21T08:56:22.185 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-21T08:56:22.224 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:22.768 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T08:56:23.091 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager. 2024-04-21T08:56:23.119 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-21T08:56:23.167 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-21T08:56:23.551 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up dump (0.4b47-3) ... 2024-04-21T08:56:23.732 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ppp. 2024-04-21T08:56:23.760 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-21T08:56:23.855 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-21T08:56:23.913 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:24.014 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T08:56:24.028 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T08:56:24.115 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-21T08:56:24.241 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-21T08:56:24.320 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package pptp-linux. 2024-04-21T08:56:24.337 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-21T08:56:24.367 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T08:56:24.378 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-21T08:56:24.457 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-21T08:56:24.526 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T08:56:24.648 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-21T08:56:24.652 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T08:56:24.665 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-21T08:56:24.706 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-21T08:56:24.812 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T08:56:24.913 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:25.009 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-21T08:56:25.022 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-21T08:56:25.037 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-21T08:56:25.075 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-common (238) ... 2024-04-21T08:56:25.215 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-client (14+238) ... 2024-04-21T08:56:25.341 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-21T08:56:25.371 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-21T08:56:25.399 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:25.429 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:25.896 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:25.896 INFO:teuthology.orchestra.run.smithi169.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-21T08:56:25.896 INFO:teuthology.orchestra.run.smithi169.stdout:which means they are currently configured by ifupdown: 2024-04-21T08:56:25.897 INFO:teuthology.orchestra.run.smithi169.stdout:- enp3s0f1 2024-04-21T08:56:25.897 INFO:teuthology.orchestra.run.smithi169.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-21T08:56:25.897 INFO:teuthology.orchestra.run.smithi169.stdout:remove their configuration from /etc/network/interfaces. 2024-04-21T08:56:25.897 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:26.009 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-common. 2024-04-21T08:56:26.024 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-21T08:56:26.037 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-21T08:56:26.095 INFO:teuthology.orchestra.run.smithi026.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-21T08:56:26.124 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-common (238) ... 2024-04-21T08:56:26.357 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-21T08:56:26.568 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-14. 2024-04-21T08:56:26.596 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-21T08:56:26.630 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:26.677 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-21T08:56:27.152 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:27.295 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:27.421 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-21T08:56:27.547 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-common (238) ... 2024-04-21T08:56:27.879 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql. 2024-04-21T08:56:27.897 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-21T08:56:27.946 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql (14+238) ... 2024-04-21T08:56:28.189 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client. 2024-04-21T08:56:28.207 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-21T08:56:28.248 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client (14+238) ... 2024-04-21T08:56:28.417 INFO:teuthology.orchestra.run.smithi169.stdout:Adding user postgres to group ssl-cert 2024-04-21T08:56:28.492 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-21T08:56:28.509 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-21T08:56:28.550 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-21T08:56:28.650 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:28.650 INFO:teuthology.orchestra.run.smithi169.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-21T08:56:28.811 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl8.6. 2024-04-21T08:56:28.840 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-21T08:56:28.847 INFO:teuthology.orchestra.run.smithi169.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-21T08:56:28.847 INFO:teuthology.orchestra.run.smithi169.stdout:Removing obsolete dictionary files: 2024-04-21T08:56:28.877 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T08:56:29.155 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl. 2024-04-21T08:56:29.183 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-21T08:56:29.227 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-21T08:56:29.390 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-21T08:56:29.574 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package wpasupplicant. 2024-04-21T08:56:29.603 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-21T08:56:29.641 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T08:56:29.807 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:30.012 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-21T08:56:30.041 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-21T08:56:30.070 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-21T08:56:30.100 INFO:teuthology.orchestra.run.smithi169.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-21T08:56:30.109 INFO:teuthology.orchestra.run.smithi169.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-21T08:56:30.224 INFO:teuthology.orchestra.run.smithi169.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:This user must also own the server process. 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:The database cluster will be initialized with locale "en_US". 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:The default text search configuration will be set to "english". 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:Data page checksums are disabled. 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:creating subdirectories ... ok 2024-04-21T08:56:30.225 INFO:teuthology.orchestra.run.smithi169.stdout:selecting dynamic shared memory implementation ... posix 2024-04-21T08:56:30.241 INFO:teuthology.orchestra.run.smithi169.stdout:selecting default max_connections ... 100 2024-04-21T08:56:30.262 INFO:teuthology.orchestra.run.smithi169.stdout:selecting default shared_buffers ... 128MB 2024-04-21T08:56:30.272 INFO:teuthology.orchestra.run.smithi169.stdout:selecting default time zone ... Etc/UTC 2024-04-21T08:56:30.273 INFO:teuthology.orchestra.run.smithi169.stdout:creating configuration files ... ok 2024-04-21T08:56:30.389 INFO:teuthology.orchestra.run.smithi169.stdout:running bootstrap script ... ok 2024-04-21T08:56:30.423 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-21T08:56:30.452 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-21T08:56:30.498 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T08:56:30.778 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-common (238) ... 2024-04-21T08:56:30.962 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-21T08:56:31.072 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-21T08:56:31.198 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:31.324 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-21T08:56:31.433 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-21T08:56:31.534 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:31.636 INFO:teuthology.orchestra.run.smithi169.stdout:performing post-bootstrap initialization ... ok 2024-04-21T08:56:32.079 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-21T08:56:32.165 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-21T08:56:32.484 INFO:teuthology.orchestra.run.smithi169.stdout:syncing data to disk ... ok 2024-04-21T08:56:32.533 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T08:56:32.533 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-21T08:56:32.872 INFO:teuthology.orchestra.run.smithi169.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-21T08:56:32.993 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-21T08:56:33.544 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-21T08:56:33.679 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-21T08:56:33.804 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-21T08:56:33.931 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-21T08:56:34.056 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:34.182 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-21T08:56:34.292 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-21T08:56:34.897 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-21T08:56:35.023 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up dump (0.4b47-3) ... 2024-04-21T08:56:35.117 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-21T08:56:35.175 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:35.276 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-21T08:56:35.377 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-21T08:56:35.486 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-21T08:56:35.612 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-21T08:56:35.652 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:35.685 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-21T08:56:35.755 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-21T08:56:35.786 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-21T08:56:35.881 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-21T08:56:35.912 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up postgresql (14+238) ... 2024-04-21T08:56:36.038 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:36.057 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-21T08:56:36.147 INFO:teuthology.orchestra.run.smithi169.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:36.192 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:36.318 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-21T08:56:36.376 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T08:56:36.376 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T08:56:36.478 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client (14+238) ... 2024-04-21T08:56:36.587 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-21T08:56:36.908 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T08:56:37.017 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-21T08:56:37.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:37.028 INFO:teuthology.orchestra.run.smithi026.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-21T08:56:37.028 INFO:teuthology.orchestra.run.smithi026.stdout:which means they are currently configured by ifupdown: 2024-04-21T08:56:37.028 INFO:teuthology.orchestra.run.smithi026.stdout:- ens1f0 2024-04-21T08:56:37.028 INFO:teuthology.orchestra.run.smithi026.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-21T08:56:37.028 INFO:teuthology.orchestra.run.smithi026.stdout:remove their configuration from /etc/network/interfaces. 2024-04-21T08:56:37.028 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:37.152 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-21T08:56:37.319 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T08:56:37.482 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-21T08:56:37.505 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T08:56:37.814 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-21T08:56:38.298 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-21T08:56:38.457 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-21T08:56:38.584 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-21T08:56:38.731 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-21T08:56:38.831 INFO:teuthology.orchestra.run.smithi169.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T08:56:38.876 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-common (238) ... 2024-04-21T08:56:39.300 INFO:teuthology.orchestra.run.smithi169.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T08:56:39.306 DEBUG:teuthology.parallel:result is None 2024-04-21T08:56:40.010 INFO:teuthology.orchestra.run.smithi026.stdout:Adding user postgres to group ssl-cert 2024-04-21T08:56:40.215 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:40.215 INFO:teuthology.orchestra.run.smithi026.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-21T08:56:40.399 INFO:teuthology.orchestra.run.smithi026.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-21T08:56:40.399 INFO:teuthology.orchestra.run.smithi026.stdout:Removing obsolete dictionary files: 2024-04-21T08:56:40.970 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-21T08:56:41.353 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-21T08:56:41.691 INFO:teuthology.orchestra.run.smithi026.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-21T08:56:41.703 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-21T08:56:41.743 INFO:teuthology.orchestra.run.smithi026.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:This user must also own the server process. 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:The database cluster will be initialized with locale "en_US". 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:The default text search configuration will be set to "english". 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:Data page checksums are disabled. 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:creating subdirectories ... ok 2024-04-21T08:56:41.744 INFO:teuthology.orchestra.run.smithi026.stdout:selecting dynamic shared memory implementation ... posix 2024-04-21T08:56:41.760 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default max_connections ... 100 2024-04-21T08:56:41.781 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default shared_buffers ... 128MB 2024-04-21T08:56:41.796 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default time zone ... Etc/UTC 2024-04-21T08:56:41.798 INFO:teuthology.orchestra.run.smithi026.stdout:creating configuration files ... ok 2024-04-21T08:56:41.917 INFO:teuthology.orchestra.run.smithi026.stdout:running bootstrap script ... ok 2024-04-21T08:56:42.514 INFO:teuthology.orchestra.run.smithi026.stdout:performing post-bootstrap initialization ... ok 2024-04-21T08:56:43.154 INFO:teuthology.orchestra.run.smithi026.stdout:syncing data to disk ... ok 2024-04-21T08:56:43.573 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-21T08:56:46.350 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:46.476 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-21T08:56:46.586 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql (14+238) ... 2024-04-21T08:56:46.686 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-21T08:56:46.804 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-21T08:56:47.065 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T08:56:47.065 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-21T08:56:47.557 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-21T08:56:47.649 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-21T08:56:47.977 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-21T08:56:48.120 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-21T08:56:49.682 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-21T08:56:49.781 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-21T08:56:50.274 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-21T08:56:50.279 DEBUG:teuthology.parallel:result is None 2024-04-21T08:56:50.280 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T08:56:50.494 DEBUG:teuthology.orchestra.run.smithi026:> dpkg-query -W -f '${Version}' ceph 2024-04-21T08:56:50.514 INFO:teuthology.orchestra.run.smithi026.stdout:19.0.0-3154-ga630765c-1jammy 2024-04-21T08:56:50.515 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-ga630765c-1jammy 2024-04-21T08:56:50.515 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-ga630765c-1jammy is installed. 2024-04-21T08:56:50.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a630765c1f93c6e61d9b40c4b76437611d5ef29e 2024-04-21T08:56:50.654 DEBUG:teuthology.orchestra.run.smithi169:> dpkg-query -W -f '${Version}' ceph 2024-04-21T08:56:50.674 INFO:teuthology.orchestra.run.smithi169.stdout:19.0.0-3154-ga630765c-1jammy 2024-04-21T08:56:50.674 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3154-ga630765c-1jammy 2024-04-21T08:56:50.674 INFO:teuthology.task.install:The correct ceph version 19.0.0-3154-ga630765c-1jammy is installed. 2024-04-21T08:56:50.675 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-21T08:56:50.676 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:50.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T08:56:50.690 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:50.690 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-21T08:56:50.731 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-21T08:56:50.731 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:50.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T08:56:50.746 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T08:56:50.801 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:50.801 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-04-21T08:56:50.814 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-21T08:56:50.870 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-21T08:56:50.871 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:50.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T08:56:50.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T08:56:50.938 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:50.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-21T08:56:50.951 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-21T08:56:51.006 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-21T08:56:51.006 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:51.006 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T08:56:51.022 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T08:56:51.078 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:51.078 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-04-21T08:56:51.091 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-21T08:56:51.145 INFO:teuthology.run_tasks:Running task ceph... 2024-04-21T08:56:51.227 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-21T08:56:51.227 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2024-04-21T08:56:51.230 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-04-21T08:56:51.242 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-21T08:56:51.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-21T08:56:51.283 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-21T08:56:51.297 INFO:tasks.ceph:Creating extra log directories... 2024-04-21T08:56:51.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-21T08:56:51.339 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-21T08:56:51.358 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-21T08:56:51.358 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-21T08:56:51.358 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-21T08:56:51.358 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:51.358 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-21T08:56:51.398 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-21T08:56:51.474 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:51.475 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-21T08:56:51.480 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-21T08:56:51.559 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-21T08:56:51.559 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-21T08:56:51.559 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}}', 'email': None, 'first_in_suite': False, 'job_id': '7666535', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '4f6bc5273643aaf5660909e85400647a8951c10b'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7599, 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e', 'sleep_before_teardown': 0, 'subset': '111/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/leonid-s-usov/ceph-ceph', 'suite_sha1': '4f6bc5273643aaf5660909e85400647a8951c10b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNM/4TvBgUnGLiSBW4AA32oHQQwI/zuXX2DrSrIHA5OjeWMGfseY/1ESxJ4QFMZ7LCRISZQe0wioqljW+q9Z/Q=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmmCnzLzJqcmy2jVfpo3zaQbZbOmN/O7S4RfzIgiu1Hh8VeBFhvrbdQbGdSQ9VgvNmU4snPn9+4G+SmQg1V7fQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'a630765c1f93c6e61d9b40c4b76437611d5ef29e', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-21_08:12:55', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-21T08:56:51.560 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-21T08:56:51.562 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-21T08:56:51.603 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2024-04-21T08:56:51.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-04-21T08:56:51.658 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:51.658 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T08:56:51.671 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T08:56:51.671 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-21 08:50:38.472459866 +0000 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-21 08:50:38.208462224 +0000 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-21 08:50:38.208462224 +0000 2024-04-21T08:56:51.719 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-21T08:56:51.720 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T08:56:51.773 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-21T08:56:51.773 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-21T08:56:51.773 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000196213 s, 2.6 MB/s 2024-04-21T08:56:51.774 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T08:56:51.824 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-04-21T08:56:51.871 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T08:56:51.871 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:51.871 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-04-21T08:56:51.871 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:51.871 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-21 08:50:38.952455578 +0000 2024-04-21T08:56:51.872 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-21 08:50:38.700457829 +0000 2024-04-21T08:56:51.872 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-21 08:50:38.700457829 +0000 2024-04-21T08:56:51.872 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-21T08:56:51.872 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T08:56:51.925 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-21T08:56:51.925 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-21T08:56:51.925 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000275739 s, 1.9 MB/s 2024-04-21T08:56:51.926 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T08:56:51.976 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-21 08:50:39.424451363 +0000 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-21 08:50:39.176453578 +0000 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-21 08:50:39.176453578 +0000 2024-04-21T08:56:52.023 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-21T08:56:52.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T08:56:52.077 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-21T08:56:52.077 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-21T08:56:52.077 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.00028572 s, 1.8 MB/s 2024-04-21T08:56:52.079 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T08:56:52.128 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-21 08:50:39.896447147 +0000 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-21 08:50:39.644449398 +0000 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-21 08:50:39.644449398 +0000 2024-04-21T08:56:52.179 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-21T08:56:52.179 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T08:56:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-21T08:56:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-21T08:56:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000250289 s, 2.0 MB/s 2024-04-21T08:56:52.234 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T08:56:52.288 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T08:56:52.288 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:52.288 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-04-21T08:56:52.294 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-21T08:56:52.294 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-04-21T08:56:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-21T08:56:52.343 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:52.343 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-04-21T08:56:52.343 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:52.344 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-21 08:50:30.214337508 +0000 2024-04-21T08:56:52.344 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-21 08:50:29.958401030 +0000 2024-04-21T08:56:52.344 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-21 08:50:29.958401030 +0000 2024-04-21T08:56:52.344 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-21T08:56:52.344 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-21T08:56:52.397 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-21T08:56:52.397 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-21T08:56:52.397 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000406214 s, 1.3 MB/s 2024-04-21T08:56:52.399 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-21T08:56:52.448 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-21 08:50:30.678222930 +0000 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-21 08:50:30.434283182 +0000 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-21 08:50:30.434283182 +0000 2024-04-21T08:56:52.495 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-21T08:56:52.495 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-21T08:56:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-21T08:56:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-21T08:56:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000332153 s, 1.5 MB/s 2024-04-21T08:56:52.549 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-21T08:56:52.596 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-21 08:50:30.906166630 +0000 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-21 08:50:30.902167618 +0000 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-21 08:50:30.902167618 +0000 2024-04-21T08:56:52.643 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-21T08:56:52.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-21T08:56:52.696 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-21T08:56:52.696 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-21T08:56:52.696 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000319107 s, 1.6 MB/s 2024-04-21T08:56:52.697 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-21T08:56:52.744 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 5h/5d Inode: 932 Links: 1 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-04-21 08:50:31.657986182 +0000 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-04-21 08:50:31.394049261 +0000 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-04-21 08:50:31.394049261 +0000 2024-04-21T08:56:52.791 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: - 2024-04-21T08:56:52.791 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-21T08:56:52.845 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-04-21T08:56:52.845 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-04-21T08:56:52.845 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000361448 s, 1.4 MB/s 2024-04-21T08:56:52.846 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-21T08:56:52.896 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T08:56:52.896 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-21T08:56:52.896 INFO:tasks.ceph:Generating config... 2024-04-21T08:56:52.897 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-21T08:56:52.897 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-21T08:56:52.897 INFO:tasks.ceph:[client] debug client = 20 2024-04-21T08:56:52.897 INFO:tasks.ceph:[client] debug ms = 1 2024-04-21T08:56:52.898 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-21T08:56:52.898 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-21T08:56:52.898 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-21T08:56:52.899 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-21T08:56:52.899 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-21T08:56:52.899 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-21T08:56:52.899 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-21T08:56:52.900 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-21T08:56:52.900 INFO:tasks.ceph:Setting up mon.a... 2024-04-21T08:56:52.901 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-21T08:56:52.935 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2024-04-21T08:56:52.962 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-21T08:56:53.043 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-21T08:56:53.097 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2024-04-21T08:56:53.098 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-21T08:56:53.099 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:53.099 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-21T08:56:53.146 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid c3cab1f1-d502-48e1-871b-caee77004426 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = quincy 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:fsid c3cab1f1-d502-48e1-871b-caee77004426 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2024-04-21T08:56:53.234890+0000 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-04-21T08:56:53.234890+0000 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 17 (quincy) 2024-04-21T08:56:53.232 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2024-04-21T08:56:53.233 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2024-04-21T08:56:53.233 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-04-21T08:56:53.233 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2024-04-21T08:56:53.233 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-21T08:56:53.234 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-21T08:56:53.283 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c3cab1f1-d502-48e1-871b-caee77004426... 2024-04-21T08:56:53.283 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-21T08:56:53.327 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2024-04-21T08:56:53.357 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-21T08:56:53.358 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2024-04-21T08:56:53.359 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-04-21T08:56:53.360 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = c3cab1f1-d502-48e1-871b-caee77004426 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2024-04-21T08:56:53.361 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug trim objects = true 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2024-04-21T08:56:53.362 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore compression mode = aggressive 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2024-04-21T08:56:53.363 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 20 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 20 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 10 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: osd blocked scrub grace period = 3600 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: osd max markdown count = 1000 2024-04-21T08:56:53.364 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-04-21T08:56:53.365 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-04-21T08:56:53.366 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-21T08:56:53.367 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: mon down mkfs grace = 300 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2024-04-21T08:56:53.368 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout: client_shutdown_timeout = 120 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-04-21T08:56:53.369 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal fragment size max = 10000 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal merge size = 5 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal split bits = 3 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal split size = 100 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2024-04-21T08:56:53.370 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: mds oft prefetch dirfrags = True 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: mds_dir_prefetch = True 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: mds_sleep_rank_change = 5000000.0 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-04-21T08:56:53.371 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-04-21T08:56:53.372 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-04-21T08:56:53.373 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.374 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.375 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.26,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = c3cab1f1-d502-48e1-871b-caee77004426 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-04-21T08:56:53.376 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug trim objects = true 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-04-21T08:56:53.377 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-04-21T08:56:53.378 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore compression mode = aggressive 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 20 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 20 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 10 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-04-21T08:56:53.379 INFO:teuthology.orchestra.run.smithi169.stdout: osd blocked scrub grace period = 3600 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: osd max markdown count = 1000 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-04-21T08:56:53.380 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-04-21T08:56:53.381 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-04-21T08:56:53.382 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: mon down mkfs grace = 300 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-21T08:56:53.383 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: client_shutdown_timeout = 120 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-04-21T08:56:53.384 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal fragment size max = 10000 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal merge size = 5 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split bits = 3 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds bal split size = 100 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds oft prefetch dirfrags = True 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-04-21T08:56:53.385 INFO:teuthology.orchestra.run.smithi169.stdout: mds_dir_prefetch = True 2024-04-21T08:56:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: mds_sleep_rank_change = 5000000.0 2024-04-21T08:56:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-04-21T08:56:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-04-21T08:56:53.386 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-04-21T08:56:53.386 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-21T08:56:53.386 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-21T08:56:53.467 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-21T08:56:53.467 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:53.468 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-21T08:56:53.473 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:53.473 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-21T08:56:53.519 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T08:56:53.519 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:53.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-21T08:56:53.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-21T08:56:53.583 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:56:53.583 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:56:53.631 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T08:56:53.631 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:53.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-21T08:56:53.631 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-21T08:56:53.654 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:56:53.654 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:56:53.703 INFO:tasks.ceph:Setting up mon nodes... 2024-04-21T08:56:53.704 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-21T08:56:53.704 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-21T08:56:53.749 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-21T08:56:53.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-21T08:56:53.797 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-21T08:56:53.809 INFO:tasks.ceph:Setting up mds nodes... 2024-04-21T08:56:53.809 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-21T08:56:53.854 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-21T08:56:53.858 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-21T08:56:53.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-21T08:56:53.953 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-21T08:56:53.956 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-21T08:56:54.011 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-21T08:56:54.096 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-21T08:56:54.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-21T08:56:54.155 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-21T08:56:54.200 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-21T08:56:54.203 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-21T08:56:54.259 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-21T08:56:54.343 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-21T08:56:54.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-21T08:56:54.402 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-21T08:56:54.486 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-21T08:56:54.489 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-21T08:56:54.542 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-21T08:56:54.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-21T08:56:54.581 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-21T08:56:54.592 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-21T08:56:54.592 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-21T08:56:54.592 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-21T08:56:54.645 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T08:56:54.645 INFO:tasks.ceph:role: osd.0 2024-04-21T08:56:54.645 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T08:56:54.645 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-21T08:56:54.698 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:56:54.699 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:56:54.722 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-21T08:56:54.724 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-21T08:56:54.724 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-21T08:56:54.787 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-21T08:56:54.841 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:56:54.841 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:56:54.841 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-21T08:56:54.894 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T08:56:54.894 INFO:tasks.ceph:role: osd.1 2024-04-21T08:56:54.894 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T08:56:54.895 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:56:54.951 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:56:54.975 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-21T08:56:54.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-21T08:56:54.976 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-21T08:56:55.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-21T08:56:55.087 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:56:55.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:56:55.089 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-21T08:56:55.142 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T08:56:55.142 INFO:tasks.ceph:role: osd.2 2024-04-21T08:56:55.142 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T08:56:55.143 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-21T08:56:55.198 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:56:55.198 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:56:55.198 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:56:55.198 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:56:55.199 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:56:55.199 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:56:55.199 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:56:55.199 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:56:55.199 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:56:55.199 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:56:55.222 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-21T08:56:55.224 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-21T08:56:55.224 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-21T08:56:55.282 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-21T08:56:55.336 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:56:55.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:56:55.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-21T08:56:55.394 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-21T08:56:55.394 INFO:tasks.ceph:role: osd.3 2024-04-21T08:56:55.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T08:56:55.394 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-21T08:56:55.450 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:56:55.450 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:56:55.450 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:56:55.450 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:56:55.450 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:56:55.450 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:56:55.450 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:56:55.451 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:56:55.451 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:56:55.451 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:56:55.474 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-21T08:56:55.475 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-21T08:56:55.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-21T08:56:55.534 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-21T08:56:55.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:56:55.588 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:56:55.589 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:56:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:55.707+0000 7f288c7407c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-21T08:56:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:55.707+0000 7f288c7407c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-21T08:56:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:55.707+0000 7f288c7407c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-21T08:56:55.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:55.707+0000 7f288c7407c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-21T08:56:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:55.707+0000 7f288c7407c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-21T08:56:55.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:55.711+0000 7f288c7407c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-21T08:56:58.683 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-21T08:56:58.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:56:58.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:58.779+0000 7f412f0ca7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-21T08:56:58.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:58.779+0000 7f412f0ca7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-21T08:56:58.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:58.779+0000 7f412f0ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-21T08:56:58.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:58.779+0000 7f412f0ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-21T08:56:58.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:58.779+0000 7f412f0ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-21T08:56:58.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:56:58.779+0000 7f412f0ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-21T08:57:01.765 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-21T08:57:01.819 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:01.903+0000 7f309d9f17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-21T08:57:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:01.903+0000 7f309d9f17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-21T08:57:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:01.903+0000 7f309d9f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-21T08:57:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:01.903+0000 7f309d9f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-21T08:57:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:01.903+0000 7f309d9f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-21T08:57:01.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:01.903+0000 7f309d9f17c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-21T08:57:04.857 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-21T08:57:04.911 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:04.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:04.995+0000 7f967309f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-21T08:57:04.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:04.995+0000 7f967309f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-21T08:57:04.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:04.995+0000 7f967309f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-21T08:57:04.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:04.995+0000 7f967309f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-21T08:57:04.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:04.995+0000 7f967309f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-21T08:57:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:04.995+0000 7f967309f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-21T08:57:07.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-21T08:57:08.031 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-21T08:57:08.046 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T08:57:08.046 INFO:tasks.ceph:role: osd.4 2024-04-21T08:57:08.046 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T08:57:08.046 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:57:08.110 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:57:08.111 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:57:08.111 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:57:08.597 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-21T08:57:08.598 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-21T08:57:08.599 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-21T08:57:08.755 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-21T08:57:08.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:57:08.767 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:57:08.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-21T08:57:08.822 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T08:57:08.822 INFO:tasks.ceph:role: osd.5 2024-04-21T08:57:08.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T08:57:08.822 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-21T08:57:08.886 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:57:08.886 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:57:08.886 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:57:08.887 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:57:08.887 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:57:08.887 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:57:08.887 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:57:08.887 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:57:08.887 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:57:08.887 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:57:09.336 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-21T08:57:09.338 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-21T08:57:09.338 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-21T08:57:09.433 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-21T08:57:09.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:57:09.445 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:57:09.445 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-21T08:57:09.499 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T08:57:09.499 INFO:tasks.ceph:role: osd.6 2024-04-21T08:57:09.499 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T08:57:09.499 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:57:09.564 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:57:09.565 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:57:10.024 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-21T08:57:10.026 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-21T08:57:10.026 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-21T08:57:10.130 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-21T08:57:10.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:57:10.140 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:57:10.140 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-21T08:57:10.192 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-21T08:57:10.192 INFO:tasks.ceph:role: osd.7 2024-04-21T08:57:10.192 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T08:57:10.192 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-21T08:57:10.254 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-21T08:57:10.763 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-04-21T08:57:10.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-04-21T08:57:10.767 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-21T08:57:10.918 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-21T08:57:10.930 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: /sbin/restorecon: command not found 2024-04-21T08:57:10.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:57:10.931 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:11.200 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:11.202+0000 7f567ccbe7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-21T08:57:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:11.202+0000 7f567ccbe7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-21T08:57:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:11.202+0000 7f567ccbe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-21T08:57:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:11.202+0000 7f567ccbe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-21T08:57:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:11.202+0000 7f567ccbe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-21T08:57:11.202 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:11.206+0000 7f567ccbe7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-21T08:57:14.176 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-21T08:57:14.191 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:14.276 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:14.278+0000 7f6d14bb77c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-21T08:57:14.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:14.278+0000 7f6d14bb77c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-21T08:57:14.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:14.278+0000 7f6d14bb77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-21T08:57:14.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:14.278+0000 7f6d14bb77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-21T08:57:14.277 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:14.278+0000 7f6d14bb77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-21T08:57:14.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:14.278+0000 7f6d14bb77c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-21T08:57:17.244 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-21T08:57:17.298 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:17.381 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:17.382+0000 7fc48f1137c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-21T08:57:17.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:17.382+0000 7fc48f1137c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-21T08:57:17.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:17.386+0000 7fc48f1137c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-21T08:57:17.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:17.386+0000 7fc48f1137c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-21T08:57:17.382 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:17.386+0000 7fc48f1137c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-21T08:57:17.383 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:17.386+0000 7fc48f1137c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-21T08:57:20.345 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-21T08:57:20.399 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:20.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:20.482+0000 7f7b57d977c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-21T08:57:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:20.486+0000 7f7b57d977c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-21T08:57:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:20.486+0000 7f7b57d977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-21T08:57:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:20.486+0000 7f7b57d977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-21T08:57:20.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:20.486+0000 7f7b57d977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-21T08:57:20.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:20.486+0000 7f7b57d977c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-21T08:57:21.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:21.564 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:23.460 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-21T08:57:23.473 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-21T08:57:23.473 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.474 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-21T08:57:23.488 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-21T08:57:23.543 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.543 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-21T08:57:23.598 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.599 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-21T08:57:23.654 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.654 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-21T08:57:23.711 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-21T08:57:23.766 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.766 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-21T08:57:23.822 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:23.822 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-21T08:57:23.879 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:23.879 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-21T08:57:23.892 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:23.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-21T08:57:23.946 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:23.946 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-21T08:57:24.002 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:24.002 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-21T08:57:24.058 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:24.058 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-21T08:57:24.114 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:24.114 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-21T08:57:24.170 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:24.170 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-21T08:57:24.226 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:24.226 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-21T08:57:24.281 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:24.281 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-21T08:57:24.287 INFO:tasks.ceph:Adding keys to all mons... 2024-04-21T08:57:24.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-21T08:57:24.332 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-21T08:57:24.341 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2024-04-21T08:57:24.341 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDV1CRmdvbULBAA2v53vd4LODHWhtUMLLyeJw== 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDV1CRmjXsgMxAAvc0e5vkSKMyOQG8crDRGQw== 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDV1CRmI4b8OBAAp8sSTWDt3kwt3Hhm7bDBPQ== 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDW1CRmB57qBRAAaGcsbd00fx+jdFrDXd0vww== 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDX1CRmWEJyKhAAoSfTaEY8xFA5RsfZdi2OmA== 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDa1CRm7tGMLhAATBcr7Ezimo0v2JxRSQpE+g== 2024-04-21T08:57:24.342 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDd1CRmp6H2NRAAWv+7sNtHwFTuXCCMLUvNFA== 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDg1CRmY6d7OxAAqJchKaRnZZ64IdYmamZY1A== 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDV1CRmEPnALxAAKQ9NrxLYV+Znpy2uWXrnmw== 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDW1CRm+34rDBAALNMCFb/7E4N+wjXs1ZgPZg== 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDW1CRmhNG3FBAAm4g8DC8GyGYeIC0fEK3Tog== 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDW1CRm9ss8HRAAzNmJ4VekB0IJoHl/Nxg7hg== 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2024-04-21T08:57:24.343 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDn1CRmzx8uDBAAWzM2JSyp1uRMPJt5xKl6uA== 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDq1CRmNq6+EBAAclLpwyjxr4Qv3rGuhyPAFw== 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDt1CRm4dX+FhAAl3UYa3GGZRVmxoES8YDWaQ== 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDw1CRmw1r1HBAAOCNHj64e9W3MJbiogh/TKg== 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2024-04-21T08:57:24.344 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQDW1CRm14bNIhAA06JweSvzRQuWK5uVhy/P2w== 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDV1CRmdvbULBAA2v53vd4LODHWhtUMLLyeJw== 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDV1CRmjXsgMxAAvc0e5vkSKMyOQG8crDRGQw== 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDV1CRmI4b8OBAAp8sSTWDt3kwt3Hhm7bDBPQ== 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.e] 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDW1CRmB57qBRAAaGcsbd00fx+jdFrDXd0vww== 2024-04-21T08:57:24.346 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDX1CRmWEJyKhAAoSfTaEY8xFA5RsfZdi2OmA== 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDa1CRm7tGMLhAATBcr7Ezimo0v2JxRSQpE+g== 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDd1CRmp6H2NRAAWv+7sNtHwFTuXCCMLUvNFA== 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDg1CRmY6d7OxAAqJchKaRnZZ64IdYmamZY1A== 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDV1CRmEPnALxAAKQ9NrxLYV+Znpy2uWXrnmw== 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDW1CRm+34rDBAALNMCFb/7E4N+wjXs1ZgPZg== 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-04-21T08:57:24.347 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDW1CRmhNG3FBAAm4g8DC8GyGYeIC0fEK3Tog== 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.f] 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDW1CRm9ss8HRAAzNmJ4VekB0IJoHl/Nxg7hg== 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDn1CRmzx8uDBAAWzM2JSyp1uRMPJt5xKl6uA== 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDq1CRmNq6+EBAAclLpwyjxr4Qv3rGuhyPAFw== 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDt1CRm4dX+FhAAl3UYa3GGZRVmxoES8YDWaQ== 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDw1CRmw1r1HBAAOCNHj64e9W3MJbiogh/TKg== 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2024-04-21T08:57:24.348 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDW1CRm14bNIhAA06JweSvzRQuWK5uVhy/P2w== 2024-04-21T08:57:24.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T08:57:24.392 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T08:57:24.436 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:24.438 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:24.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:24.524 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:24.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:24.615 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:24.698 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:24.700 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:24.781 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:24.783 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:24.863 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:24.865 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:24.949 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:24.952 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.029 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T08:57:25.036 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-21T08:57:25.111 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:25.119 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:25.200 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:25.202 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:25.287 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:25.289 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-21T08:57:25.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.468 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.551 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.640 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-21T08:57:25.682 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-21T08:57:25.685 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-21T08:57:25.772 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-21T08:57:25.773 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-21T08:57:25.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-21T08:57:25.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-21T08:57:25.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-21T08:57:25.898 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-21T08:57:25.993 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-21T08:57:26.003 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-21T08:57:26.060 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-21T08:57:26.151 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-21T08:57:26.161 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:26.163 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-21T08:57:26.206 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-21T08:57:26.206 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-21T08:57:26.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-21T08:57:26.211 INFO:tasks.ceph.mon.a:Started 2024-04-21T08:57:26.211 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-21T08:57:26.212 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-21T08:57:26.252 INFO:tasks.ceph.mon.b:Started 2024-04-21T08:57:26.252 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-21T08:57:26.252 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-21T08:57:26.254 INFO:tasks.ceph.mon.c:Started 2024-04-21T08:57:26.255 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-21T08:57:26.255 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-21T08:57:26.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-21T08:57:26.257 INFO:tasks.ceph.mgr.y:Started 2024-04-21T08:57:26.258 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-21T08:57:26.258 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-21T08:57:26.260 INFO:tasks.ceph.mgr.x:Started 2024-04-21T08:57:26.261 INFO:tasks.ceph:Setting crush tunables to default 2024-04-21T08:57:26.261 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2024-04-21T08:57:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10bab9640 1 Processor -- start 2024-04-21T08:57:26.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10bab9640 1 -- start start 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10bab9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd104152550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10bab9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 0x7fd104152a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10bab9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1040724b0 con 0x7fd1040739f0 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10bab9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd10406d3f0 con 0x7fd1040c6480 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10bab9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd104071ef0 con 0x7fd1040c60a0 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109054640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 0x7fd104152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10a056640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd1040739f0 0x7fd1040c8110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50856/0 (socket says 172.21.15.26:50856) 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd10a056640 1 -- 172.21.15.26:0/1902729941 learned_addr learned my addr 172.21.15.26:0/1902729941 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109054640 1 -- 172.21.15.26:0/1902729941 >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 msgr2=0x7fd104152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109054640 1 -- 172.21.15.26:0/1902729941 >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 msgr2=0x7fd104152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109054640 1 --2- 172.21.15.26:0/1902729941 >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 0x7fd104152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T08:57:26.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109054640 1 --2- 172.21.15.26:0/1902729941 >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 0x7fd104152a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T08:57:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109855640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd104152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109855640 1 -- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 msgr2=0x7fd104152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-21T08:57:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109855640 1 -- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 msgr2=0x7fd104152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-21T08:57:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109855640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd104152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-21T08:57:26.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.383+0000 7fd109855640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd104152550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T08:57:26.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310854824 0 0) 0x7fd1040724b0 con 0x7fd1040739f0 2024-04-21T08:57:26.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0ec003530 con 0x7fd1040739f0 2024-04-21T08:57:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3071099785 0 0) 0x7fd0ec003530 con 0x7fd1040739f0 2024-04-21T08:57:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 msgr2=0x7fd104152550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T08:57:26.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd104152550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 msgr2=0x7fd104152a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 --2- 172.21.15.26:0/1902729941 >> v2:172.21.15.26:3300/0 conn(0x7fd1040c6480 0x7fd104152a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1040721d0 con 0x7fd1040739f0 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fd0fc001680 con 0x7fd1040739f0 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 >> v1:172.21.15.26:6789/0 conn(0x7fd1040739f0 legacy=0x7fd1040c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0ec0039c0 0x7fd0ec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd0ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0ec004d50 0x7fd0ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd10406d3f0 con 0x7fd0ec004d50 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd104071ef0 con 0x7fd0ec0039c0 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ec00bb00 con 0x7fd1040c60a0 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd10a056640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0ec004d50 0x7fd0ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd109054640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd0ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd109855640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0ec0039c0 0x7fd0ec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd10a056640 1 -- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 msgr2=0x7fd0ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd10a056640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040c60a0 0x7fd0ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd10a056640 1 -- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0ec0039c0 msgr2=0x7fd0ec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd10a056640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0ec0039c0 0x7fd0ec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.571+0000 7fd10a056640 1 -- 172.21.15.26:0/1902729941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ec003530 con 0x7fd0ec004d50 2024-04-21T08:57:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10a056640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0ec004d50 0x7fd0ec0051d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c290 tx=0x7fd0fc01cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2547f4f0192446ea server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc007d60 con 0x7fd0ec004d50 2024-04-21T08:57:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0fc0a9020 con 0x7fd0ec004d50 2024-04-21T08:57:26.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd108853640 1 -- 172.21.15.26:0/1902729941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0a5b90 con 0x7fd0ec004d50 2024-04-21T08:57:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10bab9640 1 -- 172.21.15.26:0/1902729941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0ec004d50 msgr2=0x7fd0ec0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10bab9640 1 --2- 172.21.15.26:0/1902729941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0ec004d50 0x7fd0ec0051d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc00c290 tx=0x7fd0fc01cd20 comp rx=0 tx=0).stop 2024-04-21T08:57:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10a056640 1 -- 172.21.15.26:0/1902729941 reap_dead start 2024-04-21T08:57:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10bab9640 1 -- 172.21.15.26:0/1902729941 shutdown_connections 2024-04-21T08:57:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10bab9640 1 -- 172.21.15.26:0/1902729941 >> 172.21.15.26:0/1902729941 conn(0x7fd1040702c0 msgr2=0x7fd1040cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10bab9640 1 -- 172.21.15.26:0/1902729941 shutdown_connections 2024-04-21T08:57:26.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.579+0000 7fd10bab9640 1 -- 172.21.15.26:0/1902729941 wait complete. 2024-04-21T08:57:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 Processor -- start 2024-04-21T08:57:26.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 -- start start 2024-04-21T08:57:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040cba60 0x7fd10415add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd104153870 0x7fd104154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1040cbe40 0x7fd104154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040c89a0 con 0x7fd104153870 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040c8820 con 0x7fd1040cbe40 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10bab9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd1040c71b0 con 0x7fd1040cba60 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd104153870 0x7fd104154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd104153870 0x7fd104154970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55498/0 (socket says 172.21.15.26:55498) 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 -- 172.21.15.26:0/3309201552 learned_addr learned my addr 172.21.15.26:0/3309201552 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109855640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040cba60 0x7fd10415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd10a056640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1040cbe40 0x7fd104154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 -- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040cba60 msgr2=0x7fd10415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040cba60 0x7fd10415add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 -- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1040cbe40 msgr2=0x7fd104154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1040cbe40 0x7fd104154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 -- 172.21.15.26:0/3309201552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10415b460 con 0x7fd104153870 2024-04-21T08:57:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd109054640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd104153870 0x7fd104154970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400f180 tx=0x7fd0f400f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd1027fc640 1 -- 172.21.15.26:0/3309201552 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40147e0 con 0x7fd104153870 2024-04-21T08:57:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd1027fc640 1 -- 172.21.15.26:0/3309201552 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f401a070 con 0x7fd104153870 2024-04-21T08:57:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.583+0000 7fd1027fc640 1 -- 172.21.15.26:0/3309201552 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4014bc0 con 0x7fd104153870 2024-04-21T08:57:26.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.587+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd10415b740 con 0x7fd104153870 2024-04-21T08:57:26.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.587+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd10415bd00 con 0x7fd104153870 2024-04-21T08:57:26.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.587+0000 7fd1027fc640 1 -- 172.21.15.26:0/3309201552 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd0f4015800 con 0x7fd104153870 2024-04-21T08:57:26.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.587+0000 7fd1027fc640 1 -- 172.21.15.26:0/3309201552 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd0f401e8f0 con 0x7fd104153870 2024-04-21T08:57:26.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.587+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd104075410 con 0x7fd104153870 2024-04-21T08:57:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.611+0000 7fd1027fc640 1 -- 172.21.15.26:0/3309201552 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd0f401e410 con 0x7fd104153870 2024-04-21T08:57:26.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.675+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd10406c760 con 0x7fd104153870 2024-04-21T08:57:26.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd1027fc640 1 -- 172.21.15.26:0/3309201552 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd0f4014d60 con 0x7fd104153870 2024-04-21T08:57:26.679 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd104153870 msgr2=0x7fd104154970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd104153870 0x7fd104154970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd0f400f180 tx=0x7fd0f400f640 comp rx=0 tx=0).stop 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 shutdown_connections 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd1040cbe40 0x7fd104154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd104153870 0x7fd104154970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 --2- 172.21.15.26:0/3309201552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd1040cba60 0x7fd10415add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 >> 172.21.15.26:0/3309201552 conn(0x7fd1040702c0 msgr2=0x7fd10406b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 shutdown_connections 2024-04-21T08:57:26.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:26.679+0000 7fd10bab9640 1 -- 172.21.15.26:0/3309201552 wait complete. 2024-04-21T08:57:26.697 INFO:tasks.ceph:check_enable_crimson: False 2024-04-21T08:57:26.697 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-21T08:57:26.697 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:26.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-21T08:57:26.709 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:26.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-21T08:57:26.769 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:26.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-21T08:57:26.775 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:26.777+0000 7f1ceae7e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T08:57:26.781 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:26.779+0000 7f7bc79e0180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-21T08:57:26.793 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:57:26.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-21T08:57:26.850 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:26.850 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-21T08:57:26.863 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:26.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-21T08:57:26.917 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:26.917 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-21T08:57:26.970 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-04-21T08:57:26.970 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-21T08:57:27.025 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d 0 2024-04-21T08:57:27.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.185+0000 7fbd49902640 1 Processor -- start 2024-04-21T08:57:27.185 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.185+0000 7fbd49902640 1 -- start start 2024-04-21T08:57:27.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.185+0000 7fbd49902640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd4406cc50 0x7fbd4415b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.185+0000 7fbd49902640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbd4406fe90 0x7fbd44154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.185+0000 7fbd49902640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd44067df0 con 0x7fbd4406d030 2024-04-21T08:57:27.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.185+0000 7fbd49902640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbd4415bd80 con 0x7fbd4406cc50 2024-04-21T08:57:27.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.185+0000 7fbd49902640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbd440c8cc0 con 0x7fbd4406fe90 2024-04-21T08:57:27.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd427fc640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fbd4406d030 0x7fbd44071e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35290/0 (socket says 172.21.15.169:35290) 2024-04-21T08:57:27.187 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd427fc640 1 -- 172.21.15.169:0/3567754915 learned_addr learned my addr 172.21.15.169:0/3567754915 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd437fe640 1 --2- 172.21.15.169:0/3567754915 >> v2:172.21.15.169:3300/0 conn(0x7fbd4406fe90 0x7fbd44154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd42ffd640 1 --2- 172.21.15.169:0/3567754915 >> v2:172.21.15.26:3300/0 conn(0x7fbd4406cc50 0x7fbd4415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd41ffb640 1 -- 172.21.15.169:0/3567754915 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1541410082 0 0) 0x7fbd44067df0 con 0x7fbd4406d030 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd41ffb640 1 -- 172.21.15.169:0/3567754915 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd2c003530 con 0x7fbd4406d030 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd437fe640 1 -- 172.21.15.169:0/3567754915 >> v2:172.21.15.26:3300/0 conn(0x7fbd4406cc50 msgr2=0x7fbd4415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd437fe640 1 --2- 172.21.15.169:0/3567754915 >> v2:172.21.15.26:3300/0 conn(0x7fbd4406cc50 0x7fbd4415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd437fe640 1 -- 172.21.15.169:0/3567754915 >> v1:172.21.15.169:6789/0 conn(0x7fbd4406d030 legacy=0x7fbd44071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.188 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd437fe640 1 -- 172.21.15.169:0/3567754915 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd440c7390 con 0x7fbd4406fe90 2024-04-21T08:57:27.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd437fe640 1 --2- 172.21.15.169:0/3567754915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd44154c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbd44067b60 tx=0x7fbd3401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba6c7b64e683269c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.189 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd41ffb640 1 -- 172.21.15.169:0/3567754915 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd340b0070 con 0x7fbd4406fe90 2024-04-21T08:57:27.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd41ffb640 1 -- 172.21.15.169:0/3567754915 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd340ab600 con 0x7fbd4406fe90 2024-04-21T08:57:27.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd41ffb640 1 -- 172.21.15.169:0/3567754915 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd340ab9d0 con 0x7fbd4406fe90 2024-04-21T08:57:27.190 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 -- 172.21.15.169:0/3567754915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 msgr2=0x7fbd44154c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 --2- 172.21.15.169:0/3567754915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd44154c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbd44067b60 tx=0x7fbd3401c480 comp rx=0 tx=0).stop 2024-04-21T08:57:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 -- 172.21.15.169:0/3567754915 shutdown_connections 2024-04-21T08:57:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 --2- 172.21.15.169:0/3567754915 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd44154c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 --2- 172.21.15.169:0/3567754915 >> v2:172.21.15.26:3300/0 conn(0x7fbd4406cc50 0x7fbd4415b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 -- 172.21.15.169:0/3567754915 >> 172.21.15.169:0/3567754915 conn(0x7fbd4406f370 msgr2=0x7fbd4406f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 -- 172.21.15.169:0/3567754915 shutdown_connections 2024-04-21T08:57:27.191 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.189+0000 7fbd49902640 1 -- 172.21.15.169:0/3567754915 wait complete. 2024-04-21T08:57:27.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 Processor -- start 2024-04-21T08:57:27.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 -- start start 2024-04-21T08:57:27.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4406cc50 0x7fbd441f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.193 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd4406d030 0x7fbd44157170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd441576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440c8a00 con 0x7fbd4406cc50 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440c8880 con 0x7fbd4406fe90 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbd440c8150 con 0x7fbd4406d030 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd427fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd4406d030 0x7fbd44157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd437fe640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd441576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd427fc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd4406d030 0x7fbd44157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41690/0 (socket says 172.21.15.169:41690) 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd427fc640 1 -- 172.21.15.169:0/3184748046 learned_addr learned my addr 172.21.15.169:0/3184748046 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd42ffd640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4406cc50 0x7fbd441f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd437fe640 1 -- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd4406d030 msgr2=0x7fbd44157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd437fe640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd4406d030 0x7fbd44157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd437fe640 1 -- 172.21.15.169:0/3184748046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4406cc50 msgr2=0x7fbd441f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.194 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd437fe640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4406cc50 0x7fbd441f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd437fe640 1 -- 172.21.15.169:0/3184748046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd44156cc0 con 0x7fbd4406fe90 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd427fc640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd4406d030 0x7fbd44157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd437fe640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd441576b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd340ab000 tx=0x7fbd34019220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd2bfff640 1 -- 172.21.15.169:0/3184748046 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd340b0040 con 0x7fbd4406fe90 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd2bfff640 1 -- 172.21.15.169:0/3184748046 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd340b9070 con 0x7fbd4406fe90 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd441f7c50 con 0x7fbd4406fe90 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd2bfff640 1 -- 172.21.15.169:0/3184748046 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd340b4650 con 0x7fbd4406fe90 2024-04-21T08:57:27.195 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd440c4d40 con 0x7fbd4406fe90 2024-04-21T08:57:27.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd44075f60 con 0x7fbd4406fe90 2024-04-21T08:57:27.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd2bfff640 1 -- 172.21.15.169:0/3184748046 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbd340b47f0 con 0x7fbd4406fe90 2024-04-21T08:57:27.196 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.193+0000 7fbd2bfff640 1 -- 172.21.15.169:0/3184748046 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fbd340be900 con 0x7fbd4406fe90 2024-04-21T08:57:27.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.209+0000 7fbd2bfff640 1 -- 172.21.15.169:0/3184748046 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbd34016070 con 0x7fbd4406fe90 2024-04-21T08:57:27.245 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:27.245+0000 7f1ceae7e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T08:57:27.267 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:27.267+0000 7f7bc79e0180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-21T08:57:27.278 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.277+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d", "id": 0} v 0) -- 0x7fbd44165490 con 0x7fbd4406fe90 2024-04-21T08:57:27.285 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.285+0000 7fbd2bfff640 1 -- 172.21.15.169:0/3184748046 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fbd340be460 con 0x7fbd4406fe90 2024-04-21T08:57:27.285 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 msgr2=0x7fbd441576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd441576b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbd340ab000 tx=0x7fbd34019220 comp rx=0 tx=0).stop 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 shutdown_connections 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd4406fe90 0x7fbd441576b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd4406d030 0x7fbd44157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 --2- 172.21.15.169:0/3184748046 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd4406cc50 0x7fbd441f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 >> 172.21.15.169:0/3184748046 conn(0x7fbd4406f370 msgr2=0x7fbd44153920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 shutdown_connections 2024-04-21T08:57:27.287 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.289+0000 7fbd49902640 1 -- 172.21.15.169:0/3184748046 wait complete. 2024-04-21T08:57:27.301 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e 1 2024-04-21T08:57:27.414 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0f6c5d640 1 Processor -- start 2024-04-21T08:57:27.415 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0f6c5d640 1 -- start start 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0f6c5d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd0f00c8590 0x7fd0f00c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0f6c5d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0f00c94f0 con 0x7fd0f00c8040 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0f6c5d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0f00c9790 con 0x7fd0f0153010 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0f6c5d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd0f00740c0 con 0x7fd0f00c8590 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0effff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd0f00c8590 0x7fd0f00c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0effff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd0f00c8590 0x7fd0f00c6720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:60114/0 (socket says 172.21.15.169:60114) 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0effff640 1 -- 172.21.15.169:0/2971093020 learned_addr learned my addr 172.21.15.169:0/2971093020 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0effff640 1 -- 172.21.15.169:0/2971093020 >> v1:172.21.15.169:6789/0 conn(0x7fd0f0153010 legacy=0x7fd0f015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.416 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0effff640 1 -- 172.21.15.169:0/2971093020 >> v1:172.21.15.26:6789/0 conn(0x7fd0f00c8040 legacy=0x7fd0f01634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.417 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.417+0000 7fd0effff640 1 -- 172.21.15.169:0/2971093020 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f00c7930 con 0x7fd0f00c8590 2024-04-21T08:57:27.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0effff640 1 --2- 172.21.15.169:0/2971093020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c6720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009870 tx=0x7fd0e401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23141bfa6e21ab8b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0ef7fe640 1 -- 172.21.15.169:0/2971093020 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40b1070 con 0x7fd0f00c8590 2024-04-21T08:57:27.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0ef7fe640 1 -- 172.21.15.169:0/2971093020 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e40a8050 con 0x7fd0f00c8590 2024-04-21T08:57:27.419 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0ef7fe640 1 -- 172.21.15.169:0/2971093020 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40ac860 con 0x7fd0f00c8590 2024-04-21T08:57:27.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2971093020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 msgr2=0x7fd0f00c6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 --2- 172.21.15.169:0/2971093020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c6720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4009870 tx=0x7fd0e401c4d0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2971093020 shutdown_connections 2024-04-21T08:57:27.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 --2- 172.21.15.169:0/2971093020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c6720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2971093020 >> 172.21.15.169:0/2971093020 conn(0x7fd0f00c9b50 msgr2=0x7fd0f00c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2971093020 shutdown_connections 2024-04-21T08:57:27.420 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2971093020 wait complete. 2024-04-21T08:57:27.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 Processor -- start 2024-04-21T08:57:27.421 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.421+0000 7fd0f6c5d640 1 -- start start 2024-04-21T08:57:27.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0f00c8040 0x7fd0f01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0f0153010 0x7fd0f01f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f00c7bf0 con 0x7fd0f0153010 2024-04-21T08:57:27.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f01533f0 con 0x7fd0f00c8590 2024-04-21T08:57:27.424 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd0f015c8c0 con 0x7fd0f00c8040 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0effff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0f00c8040 0x7fd0f01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0f00c8040 0x7fd0f01548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41704/0 (socket says 172.21.15.169:41704) 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0effff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:60118/0 (socket says 172.21.15.169:60118) 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 -- 172.21.15.169:0/2919025233 learned_addr learned my addr 172.21.15.169:0/2919025233 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f51fa640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0f0153010 0x7fd0f01f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 -- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 msgr2=0x7fd0f00c2390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c2390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 -- 172.21.15.169:0/2919025233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0f0153010 msgr2=0x7fd0f01f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0f0153010 0x7fd0f01f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 -- 172.21.15.169:0/2919025233 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f00c39a0 con 0x7fd0f00c8040 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0effff640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f49f9640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0f00c8040 0x7fd0f01548c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800c3d0 tx=0x7fd0e800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.425 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0ed7fa640 1 -- 172.21.15.169:0/2919025233 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8017070 con 0x7fd0f00c8040 2024-04-21T08:57:27.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0ed7fa640 1 -- 172.21.15.169:0/2919025233 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0e80052f0 con 0x7fd0f00c8040 2024-04-21T08:57:27.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0ed7fa640 1 -- 172.21.15.169:0/2919025233 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e8003860 con 0x7fd0f00c8040 2024-04-21T08:57:27.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f0153710 con 0x7fd0f00c8040 2024-04-21T08:57:27.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f0153cd0 con 0x7fd0f00c8040 2024-04-21T08:57:27.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0ed7fa640 1 -- 172.21.15.169:0/2919025233 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd0e801a070 con 0x7fd0f00c8040 2024-04-21T08:57:27.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0ed7fa640 1 -- 172.21.15.169:0/2919025233 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fd0e8011c90 con 0x7fd0f00c8040 2024-04-21T08:57:27.426 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.425+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0f0074320 con 0x7fd0f00c8040 2024-04-21T08:57:27.427 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.429+0000 7fd0ed7fa640 1 -- 172.21.15.169:0/2919025233 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd0e8021070 con 0x7fd0f00c8040 2024-04-21T08:57:27.462 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:27.461+0000 7f1ceae7e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T08:57:27.464 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:27.463+0000 7f7bc79e0180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-21T08:57:27.513 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.513+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e", "id": 1} v 0) -- 0x7fd0f006f670 con 0x7fd0f00c8040 2024-04-21T08:57:27.519 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0ed7fa640 1 -- 172.21.15.169:0/2919025233 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fd0e8011590 con 0x7fd0f00c8040 2024-04-21T08:57:27.519 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-04-21T08:57:27.520 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0f00c8040 msgr2=0x7fd0f01548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0f00c8040 0x7fd0f01548c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd0e800c3d0 tx=0x7fd0e800c890 comp rx=0 tx=0).stop 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 shutdown_connections 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd0f0153010 0x7fd0f01f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0f00c8590 0x7fd0f00c2390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 --2- 172.21.15.169:0/2919025233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0f00c8040 0x7fd0f01548c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 >> 172.21.15.169:0/2919025233 conn(0x7fd0f00c9b50 msgr2=0x7fd0f00cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 shutdown_connections 2024-04-21T08:57:27.521 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.521+0000 7fd0f6c5d640 1 -- 172.21.15.169:0/2919025233 wait complete. 2024-04-21T08:57:27.536 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new ac81d636-91c1-413c-bff1-46cf85d1f481 2 2024-04-21T08:57:27.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14fca94640 1 Processor -- start 2024-04-21T08:57:27.649 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14fca94640 1 -- start start 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14fca94640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f80ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14fca94640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14f806d570 0x7f14f8151850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14fca94640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14f8158850 con 0x7f14f806d130 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14fca94640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f14f80c0d80 con 0x7f14f806d570 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14fca94640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f14f80c8540 con 0x7f14f806cd50 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f80ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f6d9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f14f806d570 0x7f14f8151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.650 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f80ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41716/0 (socket says 172.21.15.169:41716) 2024-04-21T08:57:27.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f659c640 1 -- 172.21.15.169:0/2762517842 learned_addr learned my addr 172.21.15.169:0/2762517842 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:27.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f6d9d640 1 -- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 msgr2=0x7f14f80ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:27.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f6d9d640 1 --2- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f80ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f6d9d640 1 -- 172.21.15.169:0/2762517842 >> v1:172.21.15.169:6789/0 conn(0x7f14f806d130 legacy=0x7f14f80c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f6d9d640 1 -- 172.21.15.169:0/2762517842 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f80c7930 con 0x7f14f806d570 2024-04-21T08:57:27.651 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.649+0000 7f14f659c640 1 --2- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f80ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T08:57:27.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14f6d9d640 1 --2- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8151850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009d90 tx=0x7f14f001f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c42ebb109f464dd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14f559a640 1 -- 172.21.15.169:0/2762517842 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f00b4070 con 0x7f14f806d570 2024-04-21T08:57:27.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14f559a640 1 -- 172.21.15.169:0/2762517842 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f00af600 con 0x7f14f806d570 2024-04-21T08:57:27.652 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14f559a640 1 -- 172.21.15.169:0/2762517842 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f00af9d0 con 0x7f14f806d570 2024-04-21T08:57:27.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 -- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 msgr2=0x7f14f8151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.653 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 --2- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8151850 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009d90 tx=0x7f14f001f150 comp rx=0 tx=0).stop 2024-04-21T08:57:27.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 -- 172.21.15.169:0/2762517842 shutdown_connections 2024-04-21T08:57:27.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 --2- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8151850 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 --2- 172.21.15.169:0/2762517842 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f80ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 -- 172.21.15.169:0/2762517842 >> 172.21.15.169:0/2762517842 conn(0x7f14f80c9b50 msgr2=0x7f14f80c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 -- 172.21.15.169:0/2762517842 shutdown_connections 2024-04-21T08:57:27.654 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 -- 172.21.15.169:0/2762517842 wait complete. 2024-04-21T08:57:27.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 Processor -- start 2024-04-21T08:57:27.656 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.653+0000 7f14fca94640 1 -- start start 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f8156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14f806d130 0x7f14f8152880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80c81d0 con 0x7f14f806d130 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14f80c7ef0 con 0x7f14f806d570 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f14f8158450 con 0x7f14f806cd50 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f8156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f6d9d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:60136/0 (socket says 172.21.15.169:60136) 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f8156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41730/0 (socket says 172.21.15.169:41730) 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f6d9d640 1 -- 172.21.15.169:0/3832615440 learned_addr learned my addr 172.21.15.169:0/3832615440 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:27.657 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 -- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 msgr2=0x7f14f8152dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f5d9b640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14f806d130 0x7f14f8152880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8152dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 -- 172.21.15.169:0/3832615440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14f806d130 msgr2=0x7f14f8152880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14f806d130 0x7f14f8152880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 -- 172.21.15.169:0/3832615440 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14f81543a0 con 0x7f14f806cd50 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f6d9d640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14f659c640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f8156ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14e800eb30 tx=0x7f14e800d350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14e6ffd640 1 -- 172.21.15.169:0/3832615440 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8004030 con 0x7f14f806cd50 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14e6ffd640 1 -- 172.21.15.169:0/3832615440 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e80041d0 con 0x7f14f806cd50 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14f8155380 con 0x7f14f806cd50 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14e6ffd640 1 -- 172.21.15.169:0/3832615440 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e8003620 con 0x7f14f806cd50 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f14f8154920 con 0x7f14f806cd50 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14e6ffd640 1 -- 172.21.15.169:0/3832615440 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f14e80037c0 con 0x7f14f806cd50 2024-04-21T08:57:27.658 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14e6ffd640 1 -- 172.21.15.169:0/3832615440 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f14e80183f0 con 0x7f14f806cd50 2024-04-21T08:57:27.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.657+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14f8074320 con 0x7f14f806cd50 2024-04-21T08:57:27.659 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.661+0000 7f14e6ffd640 1 -- 172.21.15.169:0/3832615440 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f14e8014070 con 0x7f14f806cd50 2024-04-21T08:57:27.726 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.729+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ac81d636-91c1-413c-bff1-46cf85d1f481", "id": 2} v 0) -- 0x7f14f80cba40 con 0x7f14f806cd50 2024-04-21T08:57:27.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14e6ffd640 1 -- 172.21.15.169:0/3832615440 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ac81d636-91c1-413c-bff1-46cf85d1f481", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f14e8003c40 con 0x7f14f806cd50 2024-04-21T08:57:27.732 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-04-21T08:57:27.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 msgr2=0x7f14f8156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f8156ab0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f14e800eb30 tx=0x7f14e800d350 comp rx=0 tx=0).stop 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 shutdown_connections 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14f806d570 0x7f14f8152dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14f806d130 0x7f14f8152880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 --2- 172.21.15.169:0/3832615440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14f806cd50 0x7f14f8156ab0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 >> 172.21.15.169:0/3832615440 conn(0x7f14f80c9b50 msgr2=0x7f14f80b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 shutdown_connections 2024-04-21T08:57:27.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.733+0000 7f14fca94640 1 -- 172.21.15.169:0/3832615440 wait complete. 2024-04-21T08:57:27.749 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 839fe36a-5e49-47c2-9361-6d331421254c 3 2024-04-21T08:57:27.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.857+0000 7fd7efaf1640 1 Processor -- start 2024-04-21T08:57:27.857 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.857+0000 7fd7efaf1640 1 -- start start 2024-04-21T08:57:27.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7efaf1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd7e81591f0 0x7fd7e80c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7efaf1640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e80c31e0 con 0x7fd7e8152b70 2024-04-21T08:57:27.860 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7efaf1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e80c34c0 con 0x7fd7e80c8b40 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7efaf1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e80c9ea0 con 0x7fd7e81591f0 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd7e80c8b40 0x7fd7e8158ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35322/0 (socket says 172.21.15.169:35322) 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 -- 172.21.15.169:0/870676666 learned_addr learned my addr 172.21.15.169:0/870676666 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ee08e640 1 --2- 172.21.15.169:0/870676666 >> v2:172.21.15.26:3300/0 conn(0x7fd7e81591f0 0x7fd7e80c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054727048 0 0) 0x7fd7e80c34c0 con 0x7fd7e80c8b40 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7d4003530 con 0x7fd7e80c8b40 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2392457240 0 0) 0x7fd7d4003530 con 0x7fd7e80c8b40 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 >> v2:172.21.15.26:3300/0 conn(0x7fd7e81591f0 msgr2=0x7fd7e80c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 --2- 172.21.15.169:0/870676666 >> v2:172.21.15.26:3300/0 conn(0x7fd7e81591f0 0x7fd7e80c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 >> v1:172.21.15.26:6789/0 conn(0x7fd7e8152b70 legacy=0x7fd7e806fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e80c37a0 con 0x7fd7e80c8b40 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fd7d8001680 con 0x7fd7e80c8b40 2024-04-21T08:57:27.861 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 >> v1:172.21.15.169:6789/0 conn(0x7fd7e80c8b40 legacy=0x7fd7e8158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7d40039c0 0x7fd7d4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7d40051d0 0x7fd7d400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e80c9ea0 con 0x7fd7d40051d0 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d400c080 con 0x7fd7d4004810 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d400c280 con 0x7fd7d40039c0 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed88d640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7d40039c0 0x7fd7d4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ee08e640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7d40051d0 0x7fd7d400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 -- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7d40039c0 msgr2=0x7fd7d4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7d40039c0 0x7fd7d4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.862 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 -- 172.21.15.169:0/870676666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7d40051d0 msgr2=0x7fd7d400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:27.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7d40051d0 0x7fd7d400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 -- 172.21.15.169:0/870676666 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d4003530 con 0x7fd7d4004810 2024-04-21T08:57:27.863 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ee08e640 1 -- 172.21.15.169:0/870676666 reap_dead start 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.861+0000 7fd7ed08c640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c1c0 tx=0x7fd7d801cc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a72950a0764f8bc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8007d00 con 0x7fd7d4004810 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d80a9020 con 0x7fd7d4004810 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ec88b640 1 -- 172.21.15.169:0/870676666 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80a5b40 con 0x7fd7d4004810 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 msgr2=0x7fd7d4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd7d800c1c0 tx=0x7fd7d801cc20 comp rx=0 tx=0).stop 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- 172.21.15.169:0/870676666 shutdown_connections 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 --2- 172.21.15.169:0/870676666 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7d4004c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- 172.21.15.169:0/870676666 >> 172.21.15.169:0/870676666 conn(0x7fd7e8067760 msgr2=0x7fd7e8067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- 172.21.15.169:0/870676666 shutdown_connections 2024-04-21T08:57:27.865 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- 172.21.15.169:0/870676666 wait complete. 2024-04-21T08:57:27.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 Processor -- start 2024-04-21T08:57:27.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- start start 2024-04-21T08:57:27.867 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7e81554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7e81ee9b0 0x7fd7e8155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e8156240 0x7fd7e80c5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e8152f50 con 0x7fd7e81ee9b0 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e80c9b30 con 0x7fd7d4004810 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7efaf1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e81530d0 con 0x7fd7e8156240 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e8156240 0x7fd7e80c5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ed88d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7e81554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ed88d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7e81554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:60152/0 (socket says 172.21.15.169:60152) 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e8156240 0x7fd7e80c5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:41752/0 (socket says 172.21.15.169:41752) 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ed88d640 1 -- 172.21.15.169:0/396369893 learned_addr learned my addr 172.21.15.169:0/396369893 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ed08c640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7e81ee9b0 0x7fd7e8155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 -- 172.21.15.169:0/396369893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 msgr2=0x7fd7e81554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7e81554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.868 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 -- 172.21.15.169:0/396369893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7e81ee9b0 msgr2=0x7fd7e8155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7e81ee9b0 0x7fd7e8155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 -- 172.21.15.169:0/396369893 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e8154460 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ed08c640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7e81ee9b0 0x7fd7e8155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7ee08e640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e8156240 0x7fd7e80c5060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c9200 tx=0x7fd7e00115a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7de7fc640 1 -- 172.21.15.169:0/396369893 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0011db0 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7de7fc640 1 -- 172.21.15.169:0/396369893 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7e001b070 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.865+0000 7fd7de7fc640 1 -- 172.21.15.169:0/396369893 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00039a0 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.869+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e8154700 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.869+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e8154cc0 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.869+0000 7fd7de7fc640 1 -- 172.21.15.169:0/396369893 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd7e0003b40 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.869+0000 7fd7de7fc640 1 -- 172.21.15.169:0/396369893 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fd7e0016a90 con 0x7fd7e8156240 2024-04-21T08:57:27.869 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.869+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e806f1c0 con 0x7fd7e8156240 2024-04-21T08:57:27.870 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.869+0000 7fd7de7fc640 1 -- 172.21.15.169:0/396369893 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd7e0016d30 con 0x7fd7e8156240 2024-04-21T08:57:27.933 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.933+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "839fe36a-5e49-47c2-9361-6d331421254c", "id": 3} v 0) -- 0x7fd7e8074320 con 0x7fd7e8156240 2024-04-21T08:57:27.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.937+0000 7fd7de7fc640 1 -- 172.21.15.169:0/396369893 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "839fe36a-5e49-47c2-9361-6d331421254c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fd7e0016600 con 0x7fd7e8156240 2024-04-21T08:57:27.938 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e8156240 msgr2=0x7fd7e80c5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e8156240 0x7fd7e80c5060 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80c9200 tx=0x7fd7e00115a0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 shutdown_connections 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd7e8156240 0x7fd7e80c5060 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd7e81ee9b0 0x7fd7e8155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 --2- 172.21.15.169:0/396369893 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd7d4004810 0x7fd7e81554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 >> 172.21.15.169:0/396369893 conn(0x7fd7e8067760 msgr2=0x7fd7e8157cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 shutdown_connections 2024-04-21T08:57:27.940 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:27.941+0000 7fd7efaf1640 1 -- 172.21.15.169:0/396369893 wait complete. 2024-04-21T08:57:27.954 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 9fec732b-95f2-40c0-a9b3-49911f569507 4 2024-04-21T08:57:28.040 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.041+0000 7f1ceae7e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T08:57:28.051 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.051+0000 7f7bc79e0180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-21T08:57:28.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385f2a2640 1 Processor -- start 2024-04-21T08:57:28.072 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385f2a2640 1 -- start start 2024-04-21T08:57:28.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385f2a2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3858152a90 0x7f38580c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385f2a2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3858073a80 0x7f38580c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385f2a2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38580c74f0 con 0x7f3858158ba0 2024-04-21T08:57:28.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385f2a2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3858071d50 con 0x7f3858152a90 2024-04-21T08:57:28.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385f2a2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f38580c8c30 con 0x7f3858073a80 2024-04-21T08:57:28.074 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385c83d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3858073a80 0x7f38580c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385c83d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3858073a80 0x7f38580c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39618/0 (socket says 172.21.15.169:39618) 2024-04-21T08:57:28.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385c83d640 1 -- 172.21.15.169:0/3267414599 learned_addr learned my addr 172.21.15.169:0/3267414599 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:28.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385d03e640 1 --2- 172.21.15.169:0/3267414599 >> v2:172.21.15.26:3300/0 conn(0x7f3858152a90 0x7f38580c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385c83d640 1 -- 172.21.15.169:0/3267414599 >> v2:172.21.15.26:3300/0 conn(0x7f3858152a90 msgr2=0x7f38580c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:28.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385c83d640 1 --2- 172.21.15.169:0/3267414599 >> v2:172.21.15.26:3300/0 conn(0x7f3858152a90 0x7f38580c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385c83d640 1 -- 172.21.15.169:0/3267414599 >> v1:172.21.15.26:6789/0 conn(0x7f3858158ba0 legacy=0x7f3858158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:28.075 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.073+0000 7f385c83d640 1 -- 172.21.15.169:0/3267414599 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38580c8f10 con 0x7f3858073a80 2024-04-21T08:57:28.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.077+0000 7f385c83d640 1 --2- 172.21.15.169:0/3267414599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858073a80 0x7f38580c6380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38580c6aa0 tx=0x7f384c01c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c129e925c86eebf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.077 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.077+0000 7f3857fff640 1 -- 172.21.15.169:0/3267414599 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c0ab620 con 0x7f3858073a80 2024-04-21T08:57:28.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.077+0000 7f3857fff640 1 -- 172.21.15.169:0/3267414599 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c0b0070 con 0x7f3858073a80 2024-04-21T08:57:28.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.077+0000 7f3857fff640 1 -- 172.21.15.169:0/3267414599 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c0ab9e0 con 0x7f3858073a80 2024-04-21T08:57:28.078 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- 172.21.15.169:0/3267414599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858073a80 msgr2=0x7f38580c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 --2- 172.21.15.169:0/3267414599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858073a80 0x7f38580c6380 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f38580c6aa0 tx=0x7f384c01c420 comp rx=0 tx=0).stop 2024-04-21T08:57:28.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- 172.21.15.169:0/3267414599 shutdown_connections 2024-04-21T08:57:28.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 --2- 172.21.15.169:0/3267414599 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858073a80 0x7f38580c6380 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 --2- 172.21.15.169:0/3267414599 >> v2:172.21.15.26:3300/0 conn(0x7f3858152a90 0x7f38580c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- 172.21.15.169:0/3267414599 >> 172.21.15.169:0/3267414599 conn(0x7f38580702c0 msgr2=0x7f38580cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- 172.21.15.169:0/3267414599 shutdown_connections 2024-04-21T08:57:28.079 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- 172.21.15.169:0/3267414599 wait complete. 2024-04-21T08:57:28.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 Processor -- start 2024-04-21T08:57:28.080 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- start start 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3858073a80 0x7f38581f51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3858152a90 0x7f38580c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858158ba0 0x7f38581eafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f38580c71b0 con 0x7f3858152a90 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3858152e70 con 0x7f3858158ba0 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f385806cf70 con 0x7f3858073a80 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3858073a80 0x7f38581f51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3858073a80 0x7f38581f51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:49056/0 (socket says 172.21.15.169:49056) 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 -- 172.21.15.169:0/3291905686 learned_addr learned my addr 172.21.15.169:0/3291905686 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d83f640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858158ba0 0x7f38581eafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385c83d640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3858152a90 0x7f38580c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 -- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858158ba0 msgr2=0x7f38581eafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858158ba0 0x7f38581eafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.083 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 -- 172.21.15.169:0/3291905686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3858152a90 msgr2=0x7f38580c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3858152a90 0x7f38580c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 -- 172.21.15.169:0/3291905686 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3858151800 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385d03e640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3858073a80 0x7f38581f51a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f385000d5f0 tx=0x7f385000dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f3855ffb640 1 -- 172.21.15.169:0/3291905686 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38500125f0 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f3855ffb640 1 -- 172.21.15.169:0/3291905686 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3850019070 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3858151ae0 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f3855ffb640 1 -- 172.21.15.169:0/3291905686 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38500129b0 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f38581520a0 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f3855ffb640 1 -- 172.21.15.169:0/3291905686 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3850012b50 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.081+0000 7f3855ffb640 1 -- 172.21.15.169:0/3291905686 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3850014940 con 0x7f3858073a80 2024-04-21T08:57:28.084 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.085+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38581522e0 con 0x7f3858073a80 2024-04-21T08:57:28.085 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.085+0000 7f3855ffb640 1 -- 172.21.15.169:0/3291905686 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3850014b90 con 0x7f3858073a80 2024-04-21T08:57:28.101 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.101+0000 7f1ceae7e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T08:57:28.107 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.107+0000 7f7bc79e0180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-21T08:57:28.153 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.153+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9fec732b-95f2-40c0-a9b3-49911f569507", "id": 4} v 0) -- 0x7f3858074320 con 0x7f3858073a80 2024-04-21T08:57:28.154 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.153+0000 7f1ceae7e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T08:57:28.158 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f3855ffb640 1 -- 172.21.15.169:0/3291905686 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9fec732b-95f2-40c0-a9b3-49911f569507", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3850014430 con 0x7f3858073a80 2024-04-21T08:57:28.159 INFO:teuthology.orchestra.run.smithi169.stdout:4 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3858073a80 msgr2=0x7f38581f51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3858073a80 0x7f38581f51a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f385000d5f0 tx=0x7f385000dab0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 shutdown_connections 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3858158ba0 0x7f38581eafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3858152a90 0x7f38580c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 --2- 172.21.15.169:0/3291905686 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3858073a80 0x7f38581f51a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 >> 172.21.15.169:0/3291905686 conn(0x7f38580702c0 msgr2=0x7f38580c5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 shutdown_connections 2024-04-21T08:57:28.160 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.161+0000 7f385f2a2640 1 -- 172.21.15.169:0/3291905686 wait complete. 2024-04-21T08:57:28.163 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.163+0000 7f7bc79e0180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-21T08:57:28.175 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d 5 2024-04-21T08:57:28.234 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.237+0000 7f1ceae7e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T08:57:28.244 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.243+0000 7f7bc79e0180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-21T08:57:28.287 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.289+0000 7f1ceae7e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T08:57:28.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa1541eb640 1 Processor -- start 2024-04-21T08:57:28.288 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa1541eb640 1 -- start start 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa1541eb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa14c0c4fe0 0x7fa14c0c9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa1541eb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa14c0c9bb0 0x7fa14c0ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa1541eb640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa14c070d20 con 0x7fa14c152be0 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa1541eb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c0c3140 con 0x7fa14c0c9bb0 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa1541eb640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa14c152fc0 con 0x7fa14c0c4fe0 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa151786640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa14c0c4fe0 0x7fa14c0c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa151786640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa14c0c4fe0 0x7fa14c0c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39644/0 (socket says 172.21.15.169:39644) 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa151786640 1 -- 172.21.15.169:0/2993928429 learned_addr learned my addr 172.21.15.169:0/2993928429 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa152788640 1 --2- 172.21.15.169:0/2993928429 >> v2:172.21.15.26:3300/0 conn(0x7fa14c0c9bb0 0x7fa14c0ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa151786640 1 -- 172.21.15.169:0/2993928429 >> v2:172.21.15.26:3300/0 conn(0x7fa14c0c9bb0 msgr2=0x7fa14c0ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa151786640 1 --2- 172.21.15.169:0/2993928429 >> v2:172.21.15.26:3300/0 conn(0x7fa14c0c9bb0 0x7fa14c0ce0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa151786640 1 -- 172.21.15.169:0/2993928429 >> v1:172.21.15.169:6789/0 conn(0x7fa14c152be0 legacy=0x7fa14c0c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.290 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.289+0000 7fa151786640 1 -- 172.21.15.169:0/2993928429 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c0c3410 con 0x7fa14c0c4fe0 2024-04-21T08:57:28.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa151786640 1 --2- 172.21.15.169:0/2993928429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c4fe0 0x7fa14c0c9670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0ced30 tx=0x7fa13c01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2717686b47339b53 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa150f85640 1 -- 172.21.15.169:0/2993928429 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0b5070 con 0x7fa14c0c4fe0 2024-04-21T08:57:28.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa150f85640 1 -- 172.21.15.169:0/2993928429 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa13c0a8a10 con 0x7fa14c0c4fe0 2024-04-21T08:57:28.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa150f85640 1 -- 172.21.15.169:0/2993928429 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa13c0a8de0 con 0x7fa14c0c4fe0 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 -- 172.21.15.169:0/2993928429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c4fe0 msgr2=0x7fa14c0c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 --2- 172.21.15.169:0/2993928429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c4fe0 0x7fa14c0c9670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa14c0ced30 tx=0x7fa13c01ed10 comp rx=0 tx=0).stop 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 -- 172.21.15.169:0/2993928429 shutdown_connections 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 --2- 172.21.15.169:0/2993928429 >> v2:172.21.15.26:3300/0 conn(0x7fa14c0c9bb0 0x7fa14c0ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 --2- 172.21.15.169:0/2993928429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c4fe0 0x7fa14c0c9670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 -- 172.21.15.169:0/2993928429 >> 172.21.15.169:0/2993928429 conn(0x7fa14c067760 msgr2=0x7fa14c067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 -- 172.21.15.169:0/2993928429 shutdown_connections 2024-04-21T08:57:28.293 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 -- 172.21.15.169:0/2993928429 wait complete. 2024-04-21T08:57:28.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 Processor -- start 2024-04-21T08:57:28.294 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.293+0000 7fa1541eb640 1 -- start start 2024-04-21T08:57:28.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa14c0c4fe0 0x7fa14c0cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c9bb0 0x7fa14c0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa14c152be0 0x7fa14c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c0ca4b0 con 0x7fa14c0c4fe0 2024-04-21T08:57:28.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa14c0ca1d0 con 0x7fa14c0c9bb0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa14c0ca790 con 0x7fa14c152be0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa151786640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c9bb0 0x7fa14c0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa151786640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c9bb0 0x7fa14c0ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39656/0 (socket says 172.21.15.169:39656) 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa152788640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa14c152be0 0x7fa14c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa151786640 1 -- 172.21.15.169:0/4105465011 learned_addr learned my addr 172.21.15.169:0/4105465011 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa151f87640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa14c0c4fe0 0x7fa14c0cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa152788640 1 -- 172.21.15.169:0/4105465011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c9bb0 msgr2=0x7fa14c0ae870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa152788640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c9bb0 0x7fa14c0ae870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa152788640 1 -- 172.21.15.169:0/4105465011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa14c0c4fe0 msgr2=0x7fa14c0cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa152788640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa14c0c4fe0 0x7fa14c0cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa152788640 1 -- 172.21.15.169:0/4105465011 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14c06db30 con 0x7fa14c152be0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa152788640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa14c152be0 0x7fa14c1559f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa144007d90 tx=0x7fa14400e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1427fc640 1 -- 172.21.15.169:0/4105465011 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa144014420 con 0x7fa14c152be0 2024-04-21T08:57:28.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1427fc640 1 -- 172.21.15.169:0/4105465011 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa144019070 con 0x7fa14c152be0 2024-04-21T08:57:28.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1427fc640 1 -- 172.21.15.169:0/4105465011 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1440147e0 con 0x7fa14c152be0 2024-04-21T08:57:28.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14c153d90 con 0x7fa14c152be0 2024-04-21T08:57:28.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14c06ddf0 con 0x7fa14c152be0 2024-04-21T08:57:28.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1427fc640 1 -- 172.21.15.169:0/4105465011 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa144014980 con 0x7fa14c152be0 2024-04-21T08:57:28.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1427fc640 1 -- 172.21.15.169:0/4105465011 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa14401d940 con 0x7fa14c152be0 2024-04-21T08:57:28.298 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.299+0000 7f7bc79e0180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-21T08:57:28.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.297+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14c074320 con 0x7fa14c152be0 2024-04-21T08:57:28.299 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.301+0000 7fa1427fc640 1 -- 172.21.15.169:0/4105465011 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa144014e00 con 0x7fa14c152be0 2024-04-21T08:57:28.366 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.365+0000 7f1ceae7e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T08:57:28.367 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.369+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d", "id": 5} v 0) -- 0x7fa14c0707e0 con 0x7fa14c152be0 2024-04-21T08:57:28.372 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1427fc640 1 -- 172.21.15.169:0/4105465011 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa14401dbe0 con 0x7fa14c152be0 2024-04-21T08:57:28.372 INFO:teuthology.orchestra.run.smithi169.stdout:5 2024-04-21T08:57:28.373 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa14c152be0 msgr2=0x7fa14c1559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa14c152be0 0x7fa14c1559f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa144007d90 tx=0x7fa14400e4b0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 shutdown_connections 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa14c152be0 0x7fa14c1559f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa14c0c9bb0 0x7fa14c0ae870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 --2- 172.21.15.169:0/4105465011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa14c0c4fe0 0x7fa14c0cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 >> 172.21.15.169:0/4105465011 conn(0x7fa14c067760 msgr2=0x7fa14c14d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 shutdown_connections 2024-04-21T08:57:28.374 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.373+0000 7fa1541eb640 1 -- 172.21.15.169:0/4105465011 wait complete. 2024-04-21T08:57:28.379 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.379+0000 7f7bc79e0180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-21T08:57:28.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54 6 2024-04-21T08:57:28.428 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.429+0000 7f1ceae7e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T08:57:28.435 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.435+0000 7f7bc79e0180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-21T08:57:28.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f430b35a640 1 Processor -- start 2024-04-21T08:57:28.499 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f430b35a640 1 -- start start 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f430b35a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43040c8b40 0x7f430406e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f430b35a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430406d270 con 0x7f4304154f50 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f430b35a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f430415f160 con 0x7f430415b0d0 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f430b35a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f430415ee80 con 0x7f43040c8b40 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f43088f5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43040c8b40 0x7f430406e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f43088f5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43040c8b40 0x7f430406e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39662/0 (socket says 172.21.15.169:39662) 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f43088f5640 1 -- 172.21.15.169:0/1689870102 learned_addr learned my addr 172.21.15.169:0/1689870102 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f43088f5640 1 -- 172.21.15.169:0/1689870102 >> v1:172.21.15.169:6789/0 conn(0x7f430415b0d0 legacy=0x7f430415b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.501 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f43088f5640 1 -- 172.21.15.169:0/1689870102 >> v1:172.21.15.26:6789/0 conn(0x7f4304154f50 legacy=0x7f43040ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.502 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.501+0000 7f43088f5640 1 -- 172.21.15.169:0/1689870102 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430406cc20 con 0x7f43040c8b40 2024-04-21T08:57:28.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 --2- 172.21.15.169:0/1689870102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43040c8b40 0x7f430406e7b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4300009870 tx=0x7f430001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6e1b5361cfc7083 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f42f7fff640 1 -- 172.21.15.169:0/1689870102 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000a7070 con 0x7f43040c8b40 2024-04-21T08:57:28.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f42f7fff640 1 -- 172.21.15.169:0/1689870102 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43000b0070 con 0x7f43040c8b40 2024-04-21T08:57:28.503 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f42f7fff640 1 -- 172.21.15.169:0/1689870102 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000ab890 con 0x7f43040c8b40 2024-04-21T08:57:28.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- 172.21.15.169:0/1689870102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43040c8b40 msgr2=0x7f430406e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 --2- 172.21.15.169:0/1689870102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43040c8b40 0x7f430406e7b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4300009870 tx=0x7f430001c560 comp rx=0 tx=0).stop 2024-04-21T08:57:28.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- 172.21.15.169:0/1689870102 shutdown_connections 2024-04-21T08:57:28.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 --2- 172.21.15.169:0/1689870102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43040c8b40 0x7f430406e7b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- 172.21.15.169:0/1689870102 >> 172.21.15.169:0/1689870102 conn(0x7f4304067760 msgr2=0x7f4304067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.504 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- 172.21.15.169:0/1689870102 shutdown_connections 2024-04-21T08:57:28.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- 172.21.15.169:0/1689870102 wait complete. 2024-04-21T08:57:28.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 Processor -- start 2024-04-21T08:57:28.505 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- start start 2024-04-21T08:57:28.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43040c8b40 0x7f43041f7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4304154f50 0x7f4304156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.507 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430415b0d0 0x7f43040b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f43040ce960 con 0x7f43040c8b40 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f43040ce7e0 con 0x7f4304154f50 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f430b35a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f430406fc10 con 0x7f430415b0d0 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4304154f50 0x7f4304156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4304154f50 0x7f4304156b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39670/0 (socket says 172.21.15.169:39670) 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 -- 172.21.15.169:0/211720325 learned_addr learned my addr 172.21.15.169:0/211720325 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43098f7640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430415b0d0 0x7f43040b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43090f6640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43040c8b40 0x7f43041f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 -- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430415b0d0 msgr2=0x7f43040b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430415b0d0 0x7f43040b2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 -- 172.21.15.169:0/211720325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43040c8b40 msgr2=0x7f43041f7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43040c8b40 0x7f43041f7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.505+0000 7f43088f5640 1 -- 172.21.15.169:0/211720325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43041588e0 con 0x7f4304154f50 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f43088f5640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4304154f50 0x7f4304156b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43000ad040 tx=0x7f430001ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.508 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f42f5ffb640 1 -- 172.21.15.169:0/211720325 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000abe60 con 0x7f4304154f50 2024-04-21T08:57:28.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f42f5ffb640 1 -- 172.21.15.169:0/211720325 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43000b4820 con 0x7f4304154f50 2024-04-21T08:57:28.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4304158bc0 con 0x7f4304154f50 2024-04-21T08:57:28.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f42f5ffb640 1 -- 172.21.15.169:0/211720325 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43000b4c10 con 0x7f4304154f50 2024-04-21T08:57:28.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4304156310 con 0x7f4304154f50 2024-04-21T08:57:28.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f42f5ffb640 1 -- 172.21.15.169:0/211720325 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f43000be780 con 0x7f4304154f50 2024-04-21T08:57:28.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f42f5ffb640 1 -- 172.21.15.169:0/211720325 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f43000c7cf0 con 0x7f4304154f50 2024-04-21T08:57:28.509 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4304157050 con 0x7f4304154f50 2024-04-21T08:57:28.510 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.509+0000 7f42f5ffb640 1 -- 172.21.15.169:0/211720325 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4304157050 con 0x7f4304154f50 2024-04-21T08:57:28.576 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.577+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54", "id": 6} v 0) -- 0x7f4304074320 con 0x7f4304154f50 2024-04-21T08:57:28.584 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f42f5ffb640 1 -- 172.21.15.169:0/211720325 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f43000c4060 con 0x7f4304154f50 2024-04-21T08:57:28.584 INFO:teuthology.orchestra.run.smithi169.stdout:6 2024-04-21T08:57:28.585 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f1ceae7e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4304154f50 msgr2=0x7f4304156b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4304154f50 0x7f4304156b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f43000ad040 tx=0x7f430001ada0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 shutdown_connections 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430415b0d0 0x7f43040b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4304154f50 0x7f4304156b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 --2- 172.21.15.169:0/211720325 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43040c8b40 0x7f43041f7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 >> 172.21.15.169:0/211720325 conn(0x7f4304067760 msgr2=0x7f43040cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.586 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 shutdown_connections 2024-04-21T08:57:28.587 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.585+0000 7f430b35a640 1 -- 172.21.15.169:0/211720325 wait complete. 2024-04-21T08:57:28.594 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.595+0000 7f7bc79e0180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-21T08:57:28.601 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 7767a47f-5c61-4b8d-b1bd-a03805547ed5 7 2024-04-21T08:57:28.648 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:28.649+0000 7f1ceae7e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T08:57:28.659 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:28.659+0000 7f7bc79e0180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-21T08:57:28.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.757+0000 7f35fe712640 1 Processor -- start 2024-04-21T08:57:28.757 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.757+0000 7f35fe712640 1 -- start start 2024-04-21T08:57:28.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fe712640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f35f80ca670 0x7f35f80c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fe712640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f8158850 con 0x7f35f806cd50 2024-04-21T08:57:28.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fe712640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35f80c7930 con 0x7f35f80c8f10 2024-04-21T08:57:28.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fe712640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f35f80c0d80 con 0x7f35f80ca670 2024-04-21T08:57:28.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fccaf640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f35f80c8f10 0x7f35f8151850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:35018/0 (socket says 172.21.15.169:35018) 2024-04-21T08:57:28.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fccaf640 1 -- 172.21.15.169:0/629568822 learned_addr learned my addr 172.21.15.169:0/629568822 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-04-21T08:57:28.760 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 --2- 172.21.15.169:0/629568822 >> v2:172.21.15.26:3300/0 conn(0x7f35f80ca670 0x7f35f80c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095602603 0 0) 0x7f35f80c7930 con 0x7f35f80c8f10 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e0003530 con 0x7f35f80c8f10 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3613684371 0 0) 0x7f35e0003530 con 0x7f35f80c8f10 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 >> v2:172.21.15.26:3300/0 conn(0x7f35f80ca670 msgr2=0x7f35f80c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 --2- 172.21.15.169:0/629568822 >> v2:172.21.15.26:3300/0 conn(0x7f35f80ca670 0x7f35f80c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 >> v1:172.21.15.26:6789/0 conn(0x7f35f806cd50 legacy=0x7f35f806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f80c7c10 con 0x7f35f80c8f10 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f35e8001680 con 0x7f35f80c8f10 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 >> v1:172.21.15.169:6789/0 conn(0x7f35f80c8f10 legacy=0x7f35f8151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35e00039c0 0x7f35e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e0004810 0x7f35e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e00051d0 0x7f35e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f35e000c050 con 0x7f35e00039c0 2024-04-21T08:57:28.761 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35e000c200 con 0x7f35e00051d0 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f35e000c400 con 0x7f35e0004810 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e0004810 0x7f35e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fccaf640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e00051d0 0x7f35e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f7fff640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35e00039c0 0x7f35e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 -- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e00051d0 msgr2=0x7f35e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e00051d0 0x7f35e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 -- 172.21.15.169:0/629568822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35e00039c0 msgr2=0x7f35e0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35e00039c0 0x7f35e0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 -- 172.21.15.169:0/629568822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e0003530 con 0x7f35e0004810 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35fccaf640 1 -- 172.21.15.169:0/629568822 reap_dead start 2024-04-21T08:57:28.762 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f7fff640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35e00039c0 0x7f35e0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:28.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f77fe640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e0004810 0x7f35e0004c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009ae0 tx=0x7f35ec01ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5974ffeebacaaa72 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.763 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec0b2070 con 0x7f35e0004810 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35ec0a5570 con 0x7f35e0004810 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.761+0000 7f35f6ffd640 1 -- 172.21.15.169:0/629568822 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec0096b0 con 0x7f35e0004810 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e0004810 msgr2=0x7f35e0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e0004810 0x7f35e0004c90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f35ec009ae0 tx=0x7f35ec01ca90 comp rx=0 tx=0).stop 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- 172.21.15.169:0/629568822 shutdown_connections 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 --2- 172.21.15.169:0/629568822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35e0004810 0x7f35e0004c90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- 172.21.15.169:0/629568822 >> 172.21.15.169:0/629568822 conn(0x7f35f80c9b50 msgr2=0x7f35f80c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- 172.21.15.169:0/629568822 shutdown_connections 2024-04-21T08:57:28.764 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- 172.21.15.169:0/629568822 wait complete. 2024-04-21T08:57:28.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 Processor -- start 2024-04-21T08:57:28.765 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- start start 2024-04-21T08:57:28.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e0004810 0x7f35f8151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f815a620 0x7f35f81f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35f815ab70 0x7f35f815aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:28.767 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f35f80c81d0 con 0x7f35f815a620 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f35f80c8540 con 0x7f35e0004810 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fe712640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f35f8158450 con 0x7f35f815ab70 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e0004810 0x7f35f8151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fccaf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35f815ab70 0x7f35f815aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e0004810 0x7f35f8151880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:39700/0 (socket says 172.21.15.169:39700) 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 -- 172.21.15.169:0/3893883739 learned_addr learned my addr 172.21.15.169:0/3893883739 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f77fe640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f815a620 0x7f35f81f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 -- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35f815ab70 msgr2=0x7f35f815aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35f815ab70 0x7f35f815aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 -- 172.21.15.169:0/3893883739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f815a620 msgr2=0x7f35f81f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f815a620 0x7f35f81f3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f7fff640 1 -- 172.21.15.169:0/3893883739 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f8152400 con 0x7f35e0004810 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35fccaf640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35f815ab70 0x7f35f815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T08:57:28.768 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.765+0000 7f35f77fe640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f815a620 0x7f35f81f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35f7fff640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e0004810 0x7f35f8151880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f35f000e800 tx=0x7f35f000ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35f4ff9640 1 -- 172.21.15.169:0/3893883739 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f000ee50 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35f4ff9640 1 -- 172.21.15.169:0/3893883739 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f0018070 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35f81526e0 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35f4ff9640 1 -- 172.21.15.169:0/3893883739 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f0003db0 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35f8159370 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35f4ff9640 1 -- 172.21.15.169:0/3893883739 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f35f00050d0 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35f4ff9640 1 -- 172.21.15.169:0/3893883739 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f35f000ccb0 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35f8074320 con 0x7f35e0004810 2024-04-21T08:57:28.769 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.769+0000 7f35f4ff9640 1 -- 172.21.15.169:0/3893883739 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f35f000c6c0 con 0x7f35e0004810 2024-04-21T08:57:28.833 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.833+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7767a47f-5c61-4b8d-b1bd-a03805547ed5", "id": 7} v 0) -- 0x7f35f806dfe0 con 0x7f35e0004810 2024-04-21T08:57:28.845 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.845+0000 7f35f4ff9640 1 -- 172.21.15.169:0/3893883739 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7767a47f-5c61-4b8d-b1bd-a03805547ed5", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f35f00053c0 con 0x7f35e0004810 2024-04-21T08:57:28.845 INFO:teuthology.orchestra.run.smithi169.stdout:7 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.845+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e0004810 msgr2=0x7f35f8151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.845+0000 7f35fe712640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e0004810 0x7f35f8151880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f35f000e800 tx=0x7f35f000ec00 comp rx=0 tx=0).stop 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.849+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 shutdown_connections 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.849+0000 7f35fe712640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f35f815ab70 0x7f35f815aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.849+0000 7f35fe712640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f815a620 0x7f35f81f3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.849+0000 7f35fe712640 1 --2- 172.21.15.169:0/3893883739 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f35e0004810 0x7f35f8151880 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.849+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 >> 172.21.15.169:0/3893883739 conn(0x7f35f80c9b50 msgr2=0x7f35f80c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.849+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 shutdown_connections 2024-04-21T08:57:28.847 INFO:teuthology.orchestra.run.smithi169.stderr:2024-04-21T08:57:28.849+0000 7f35fe712640 1 -- 172.21.15.169:0/3893883739 wait complete. 2024-04-21T08:57:28.861 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-21T08:57:28.861 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-21T08:57:28.863 INFO:tasks.ceph.osd.0:Started 2024-04-21T08:57:28.864 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-21T08:57:28.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-21T08:57:28.868 INFO:tasks.ceph.osd.1:Started 2024-04-21T08:57:28.868 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-21T08:57:28.868 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-21T08:57:28.870 INFO:tasks.ceph.osd.2:Started 2024-04-21T08:57:28.871 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-21T08:57:28.871 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-21T08:57:28.873 INFO:tasks.ceph.osd.3:Started 2024-04-21T08:57:28.873 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-21T08:57:28.873 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-21T08:57:28.903 INFO:tasks.ceph.osd.4:Started 2024-04-21T08:57:28.903 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-21T08:57:28.904 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-21T08:57:28.905 INFO:tasks.ceph.osd.5:Started 2024-04-21T08:57:28.905 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-21T08:57:28.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-21T08:57:28.907 INFO:tasks.ceph.osd.6:Started 2024-04-21T08:57:28.907 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-21T08:57:28.907 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-21T08:57:28.909 INFO:tasks.ceph.osd.7:Started 2024-04-21T08:57:28.910 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:29.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd632756640 1 Processor -- start 2024-04-21T08:57:29.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd632756640 1 -- start start 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd632756640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd62c0c8b40 0x7fd62c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd632756640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd632756640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c1594b0 con 0x7fd62c152b70 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd632756640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd62c0c9ea0 con 0x7fd62c0c8b40 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd632756640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c0c31e0 con 0x7fd62c158ae0 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd62c0c8b40 0x7fd62c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd62c0c8b40 0x7fd62c0c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39292/0 (socket says 172.21.15.26:39292) 2024-04-21T08:57:29.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 -- 172.21.15.26:0/859020003 learned_addr learned my addr 172.21.15.26:0/859020003 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:29.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd630cf3640 1 --2- 172.21.15.26:0/859020003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:29.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 -- 172.21.15.26:0/859020003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 msgr2=0x7fd62c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:29.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 --2- 172.21.15.26:0/859020003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 -- 172.21.15.26:0/859020003 >> v1:172.21.15.169:6789/0 conn(0x7fd62c152b70 legacy=0x7fd62c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:29.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 -- 172.21.15.26:0/859020003 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c0c34c0 con 0x7fd62c0c8b40 2024-04-21T08:57:29.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.059+0000 7fd62b7fe640 1 --2- 172.21.15.26:0/859020003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c0c8b40 0x7fd62c0c4e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd620009870 tx=0x7fd62001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf2224d1b8e0ed2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:29.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62affd640 1 -- 172.21.15.26:0/859020003 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200b5070 con 0x7fd62c0c8b40 2024-04-21T08:57:29.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62affd640 1 -- 172.21.15.26:0/859020003 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6200a8a50 con 0x7fd62c0c8b40 2024-04-21T08:57:29.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62affd640 1 -- 172.21.15.26:0/859020003 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200a8e20 con 0x7fd62c0c8b40 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- 172.21.15.26:0/859020003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c0c8b40 msgr2=0x7fd62c0c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 --2- 172.21.15.26:0/859020003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c0c8b40 0x7fd62c0c4e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd620009870 tx=0x7fd62001ed50 comp rx=0 tx=0).stop 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- 172.21.15.26:0/859020003 shutdown_connections 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 --2- 172.21.15.26:0/859020003 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 --2- 172.21.15.26:0/859020003 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c0c8b40 0x7fd62c0c4e70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- 172.21.15.26:0/859020003 >> 172.21.15.26:0/859020003 conn(0x7fd62c067760 msgr2=0x7fd62c067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- 172.21.15.26:0/859020003 shutdown_connections 2024-04-21T08:57:29.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- 172.21.15.26:0/859020003 wait complete. 2024-04-21T08:57:29.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 Processor -- start 2024-04-21T08:57:29.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- start start 2024-04-21T08:57:29.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd62c0c8b40 0x7fd62c148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:29.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c152b70 0x7fd62c1e4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:29.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0c9b30 con 0x7fd62c152b70 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd62c0c9850 con 0x7fd62c0c8b40 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd62c152f50 con 0x7fd62c158ae0 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c152b70 0x7fd62c1e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c152b70 0x7fd62c1e4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39300/0 (socket says 172.21.15.26:39300) 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 -- 172.21.15.26:0/1251425024 learned_addr learned my addr 172.21.15.26:0/1251425024 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd630cf3640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62bfff640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd62c0c8b40 0x7fd62c148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 -- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 msgr2=0x7fd62c147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 -- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd62c0c8b40 msgr2=0x7fd62c148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd62c0c8b40 0x7fd62c148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 -- 172.21.15.26:0/1251425024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c1ee7c0 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd62b7fe640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c152b70 0x7fd62c1e4520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b3040 tx=0x7fd62001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd628ff9640 1 -- 172.21.15.26:0/1251425024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200b5070 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd628ff9640 1 -- 172.21.15.26:0/1251425024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6200b0de0 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c1eeaa0 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd628ff9640 1 -- 172.21.15.26:0/1251425024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6200bb670 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd62c1ef060 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd628ff9640 1 -- 172.21.15.26:0/1251425024 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd6200c2060 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.063+0000 7fd628ff9640 1 -- 172.21.15.26:0/1251425024 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fd6200baa90 con 0x7fd62c152b70 2024-04-21T08:57:29.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.067+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62c075ef0 con 0x7fd62c152b70 2024-04-21T08:57:29.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.067+0000 7fd628ff9640 1 -- 172.21.15.26:0/1251425024 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd6200188b0 con 0x7fd62c152b70 2024-04-21T08:57:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd62c0cb070 con 0x7fd62c152b70 2024-04-21T08:57:29.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd628ff9640 1 -- 172.21.15.26:0/1251425024 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fd6200c4400 con 0x7fd62c152b70 2024-04-21T08:57:29.125 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:29.125 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:28.837455+0000","last_up_change":"0.000000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c152b70 msgr2=0x7fd62c1e4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c152b70 0x7fd62c1e4520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b3040 tx=0x7fd62001baf0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 shutdown_connections 2024-04-21T08:57:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd62c158ae0 0x7fd62c147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd62c152b70 0x7fd62c1e4520 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 --2- 172.21.15.26:0/1251425024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd62c0c8b40 0x7fd62c148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 >> 172.21.15.26:0/1251425024 conn(0x7fd62c067760 msgr2=0x7fd62c0cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 shutdown_connections 2024-04-21T08:57:29.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:29.123+0000 7fd632756640 1 -- 172.21.15.26:0/1251425024 wait complete. 2024-04-21T08:57:29.141 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-21T08:57:29.141 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-21T08:57:29.263 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-21T08:57:29.265+0000 7fb153cc87c0 -1 Falling back to public interface 2024-04-21T08:57:29.268 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-21T08:57:29.269+0000 7f32afa377c0 -1 Falling back to public interface 2024-04-21T08:57:29.268 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-21T08:57:29.269+0000 7f6c9a4737c0 -1 Falling back to public interface 2024-04-21T08:57:29.272 INFO:tasks.ceph.mgr.x.smithi169.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-21T08:57:29.272 INFO:tasks.ceph.mgr.x.smithi169.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-21T08:57:29.273 INFO:tasks.ceph.mgr.x.smithi169.stderr: from numpy import show_config as show_numpy_config 2024-04-21T08:57:29.282 INFO:tasks.ceph.mgr.y.smithi026.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-21T08:57:29.282 INFO:tasks.ceph.mgr.y.smithi026.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-21T08:57:29.282 INFO:tasks.ceph.mgr.y.smithi026.stderr: from numpy import show_config as show_numpy_config 2024-04-21T08:57:29.283 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-21T08:57:29.285+0000 7f9e1cc587c0 -1 Falling back to public interface 2024-04-21T08:57:29.309 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:29.309+0000 7f1ceae7e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T08:57:29.329 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:29.327+0000 7f7bc79e0180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-21T08:57:29.445 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:29.445+0000 7f1ceae7e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T08:57:29.495 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-21T08:57:29.495+0000 7f5466b957c0 -1 Falling back to public interface 2024-04-21T08:57:29.496 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-21T08:57:29.495+0000 7f81b7ae37c0 -1 Falling back to public interface 2024-04-21T08:57:29.496 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-21T08:57:29.495+0000 7ff9e321a7c0 -1 Falling back to public interface 2024-04-21T08:57:29.499 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:29.499+0000 7f7bc79e0180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-21T08:57:29.519 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-21T08:57:29.519+0000 7f2cf05007c0 -1 Falling back to public interface 2024-04-21T08:57:29.605 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:29.605+0000 7f1ceae7e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T08:57:29.668 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:29.669+0000 7f1ceae7e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T08:57:29.672 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:29.671+0000 7f7bc79e0180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-21T08:57:29.744 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:29.743+0000 7f7bc79e0180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-21T08:57:29.799 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:29.801+0000 7f1ceae7e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T08:57:29.896 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:29.895+0000 7f7bc79e0180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-21T08:57:29.947 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:30.067 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbb0c15640 1 Processor -- start 2024-04-21T08:57:30.067 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbb0c15640 1 -- start start 2024-04-21T08:57:30.068 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbb0c15640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac0c8dc0 0x7fbbac0c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:30.068 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbb0c15640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbbac0ce330 0x7fbbac0ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:30.068 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbb0c15640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbac070420 con 0x7fbbac152a50 2024-04-21T08:57:30.068 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbb0c15640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbbac0c55c0 con 0x7fbbac0ce330 2024-04-21T08:57:30.068 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbb0c15640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac152e30 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.069 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbba9d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac0c8dc0 0x7fbbac0c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:30.069 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbba9d9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac0c8dc0 0x7fbbac0c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:47240/0 (socket says 172.21.15.26:47240) 2024-04-21T08:57:30.069 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbba9d9b640 1 -- 172.21.15.26:0/4131448742 learned_addr learned my addr 172.21.15.26:0/4131448742 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:30.069 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbaad9d640 1 --2- 172.21.15.26:0/4131448742 >> v2:172.21.15.169:3300/0 conn(0x7fbbac0ce330 0x7fbbac0ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:30.069 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbaad9d640 1 -- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac0c8dc0 msgr2=0x7fbbac0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:30.069 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbaad9d640 1 --2- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac0c8dc0 0x7fbbac0c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.069 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbaad9d640 1 -- 172.21.15.26:0/4131448742 >> v1:172.21.15.169:6789/0 conn(0x7fbbac152a50 legacy=0x7fbbac159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:30.070 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbbaad9d640 1 -- 172.21.15.26:0/4131448742 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac1592f0 con 0x7fbbac0ce330 2024-04-21T08:57:30.070 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.067+0000 7fbba9d9b640 1 --2- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac0c8dc0 0x7fbbac0c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T08:57:30.071 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbaad9d640 1 --2- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 0x7fbbac0ce7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009d90 tx=0x7fbba401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9792ad0bdef5d23 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:30.071 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbba959a640 1 -- 172.21.15.26:0/4131448742 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40b4070 con 0x7fbbac0ce330 2024-04-21T08:57:30.071 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbba959a640 1 -- 172.21.15.26:0/4131448742 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba40af600 con 0x7fbbac0ce330 2024-04-21T08:57:30.071 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbba959a640 1 -- 172.21.15.26:0/4131448742 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba40af9d0 con 0x7fbbac0ce330 2024-04-21T08:57:30.072 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 -- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 msgr2=0x7fbbac0ce7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:30.072 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 --2- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 0x7fbbac0ce7a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbba4009d90 tx=0x7fbba401f150 comp rx=0 tx=0).stop 2024-04-21T08:57:30.072 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 -- 172.21.15.26:0/4131448742 shutdown_connections 2024-04-21T08:57:30.072 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 --2- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 0x7fbbac0ce7a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.072 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 --2- 172.21.15.26:0/4131448742 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac0c8dc0 0x7fbbac0c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.072 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 -- 172.21.15.26:0/4131448742 >> 172.21.15.26:0/4131448742 conn(0x7fbbac074b00 msgr2=0x7fbbac074f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:30.072 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 -- 172.21.15.26:0/4131448742 shutdown_connections 2024-04-21T08:57:30.073 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 -- 172.21.15.26:0/4131448742 wait complete. 2024-04-21T08:57:30.073 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 Processor -- start 2024-04-21T08:57:30.073 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.071+0000 7fbbb0c15640 1 -- start start 2024-04-21T08:57:30.075 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbac0c8dc0 0x7fbbac156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 0x7fbbac15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac152a50 0x7fbbac15c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac070140 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac06fe60 con 0x7fbbac0ce330 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac0c34f0 con 0x7fbbac152a50 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbac0c8dc0 0x7fbbac156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbac0c8dc0 0x7fbbac156270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39306/0 (socket says 172.21.15.26:39306) 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 -- 172.21.15.26:0/3482374957 learned_addr learned my addr 172.21.15.26:0/3482374957 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaad9d640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac152a50 0x7fbbac15c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbba9d9b640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 0x7fbbac15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 -- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac152a50 msgr2=0x7fbbac15c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac152a50 0x7fbbac15c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.076 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 -- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 msgr2=0x7fbbac15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 0x7fbbac15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 -- 172.21.15.26:0/3482374957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac0cd070 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbaa59c640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbac0c8dc0 0x7fbbac156270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c370 tx=0x7fbba000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbb9affd640 1 -- 172.21.15.26:0/3482374957 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba00052d0 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbb9affd640 1 -- 172.21.15.26:0/3482374957 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba0005470 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbb9affd640 1 -- 172.21.15.26:0/3482374957 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba0007260 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac0cd350 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac15ac10 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbb9affd640 1 -- 172.21.15.26:0/3482374957 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbba0007400 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbb9affd640 1 -- 172.21.15.26:0/3482374957 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fbba0011c60 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.077 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.075+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac0694b0 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.078 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.079+0000 7fbb9affd640 1 -- 172.21.15.26:0/3482374957 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbba0003970 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.136 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbac0709f0 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.137 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbb9affd640 1 -- 172.21.15.26:0/3482374957 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fbba0003b50 con 0x7fbbac0c8dc0 2024-04-21T08:57:30.137 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-21T08:57:30.137 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:28.837455+0000","last_up_change":"0.000000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:30.138 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbac0c8dc0 msgr2=0x7fbbac156270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:30.138 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbac0c8dc0 0x7fbbac156270 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbba000c370 tx=0x7fbba000c830 comp rx=0 tx=0).stop 2024-04-21T08:57:30.138 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 shutdown_connections 2024-04-21T08:57:30.138 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbbac152a50 0x7fbbac15c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.138 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbbac0ce330 0x7fbbac15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.139 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 --2- 172.21.15.26:0/3482374957 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbbac0c8dc0 0x7fbbac156270 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:30.139 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 >> 172.21.15.26:0/3482374957 conn(0x7fbbac074b00 msgr2=0x7fbbac0cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:30.139 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.135+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 shutdown_connections 2024-04-21T08:57:30.139 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:30.139+0000 7fbbb0c15640 1 -- 172.21.15.26:0/3482374957 wait complete. 2024-04-21T08:57:30.152 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-21T08:57:30.411 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:30.413+0000 7f1ceae7e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T08:57:30.486 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:30.485+0000 7f1ceae7e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T08:57:30.569 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:30.567+0000 7f7bc79e0180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-21T08:57:30.649 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:30.647+0000 7f7bc79e0180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-21T08:57:30.668 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:30.669+0000 7f1ceae7e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T08:57:30.741 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:30.741+0000 7f1ceae7e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T08:57:30.839 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:30.839+0000 7f7bc79e0180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-21T08:57:30.917 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:30.915+0000 7f7bc79e0180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-21T08:57:31.028 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:31.029+0000 7f1ceae7e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T08:57:31.089 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:31.089+0000 7f1ceae7e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T08:57:31.227 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:31.227+0000 7f7bc79e0180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-21T08:57:31.292 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-21T08:57:31.291+0000 7f7bc79e0180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-21T08:57:32.134 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:32.133+0000 7f1c922c9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-21T08:57:32.135 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T08:57:32.137+0000 7f1c922c9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-21T08:57:33.068 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-21T08:57:33.069+0000 7f6c9a4737c0 -1 osd.6 0 log_to_monitors true 2024-04-21T08:57:33.082 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-21T08:57:33.085+0000 7fb153cc87c0 -1 osd.4 0 log_to_monitors true 2024-04-21T08:57:33.163 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-21T08:57:33.165+0000 7f32afa377c0 -1 osd.5 0 log_to_monitors true 2024-04-21T08:57:33.189 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-21T08:57:33.189+0000 7f9e1cc587c0 -1 osd.7 0 log_to_monitors true 2024-04-21T08:57:33.331 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-21T08:57:33.331+0000 7f81b7ae37c0 -1 osd.1 0 log_to_monitors true 2024-04-21T08:57:33.466 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-21T08:57:33.463+0000 7f5466b957c0 -1 osd.3 0 log_to_monitors true 2024-04-21T08:57:33.485 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-21T08:57:33.483+0000 7f2cf05007c0 -1 osd.2 0 log_to_monitors true 2024-04-21T08:57:33.497 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-21T08:57:33.495+0000 7ff9e321a7c0 -1 osd.0 0 log_to_monitors true 2024-04-21T08:57:34.942 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-21T08:57:34.941+0000 7fb14fc71640 -1 osd.4 0 waiting for initial osdmap 2024-04-21T08:57:34.959 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-21T08:57:34.961+0000 7fb147aa5640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:34.999 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-21T08:57:35.001+0000 7f6c9641c640 -1 osd.6 0 waiting for initial osdmap 2024-04-21T08:57:35.020 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-21T08:57:35.021+0000 7f6c8e250640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:35.936 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-21T08:57:35.936+0000 7f9e18c01640 -1 osd.7 0 waiting for initial osdmap 2024-04-21T08:57:35.960 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-21T08:57:35.960+0000 7f9e10a35640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:35.965 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-21T08:57:35.964+0000 7f32ab9e0640 -1 osd.5 0 waiting for initial osdmap 2024-04-21T08:57:36.004 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-21T08:57:36.004+0000 7f32a3814640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:36.317 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-21T08:57:36.314+0000 7ff9df1c3640 -1 osd.0 0 waiting for initial osdmap 2024-04-21T08:57:36.343 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-21T08:57:36.342+0000 7ff9d6ff7640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:36.355 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-21T08:57:36.354+0000 7f81b3a8c640 -1 osd.1 0 waiting for initial osdmap 2024-04-21T08:57:36.362 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-21T08:57:36.362+0000 7f2cec4a9640 -1 osd.2 0 waiting for initial osdmap 2024-04-21T08:57:36.379 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-21T08:57:36.378+0000 7f81ab8c0640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:36.385 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-21T08:57:36.382+0000 7f5462b3e640 -1 osd.3 0 waiting for initial osdmap 2024-04-21T08:57:36.391 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-21T08:57:36.390+0000 7f2ce42dd640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:36.427 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-21T08:57:36.426+0000 7f545a972640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-21T08:57:36.959 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:37.083 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 Processor -- start 2024-04-21T08:57:37.083 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 -- start start 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63a8151aa0 0x7f63a806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f63a80c1e20 0x7f63a815b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80c8250 0x7f63a8072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f63a806ebd0 con 0x7f63a8151aa0 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f63a8151e80 con 0x7f63a80c1e20 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63ae088640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f63a80c1410 con 0x7f63a80c8250 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63a8151aa0 0x7f63a806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f63a8151aa0 0x7f63a806e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39352/0 (socket says 172.21.15.26:39352) 2024-04-21T08:57:37.085 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 -- 172.21.15.26:0/3541007540 learned_addr learned my addr 172.21.15.26:0/3541007540 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a6ffd640 1 --2- 172.21.15.26:0/3541007540 >> v2:172.21.15.169:3300/0 conn(0x7f63a80c1e20 0x7f63a815b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a7fff640 1 --2- 172.21.15.26:0/3541007540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80c8250 0x7f63a8072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 -- 172.21.15.26:0/3541007540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80c8250 msgr2=0x7f63a8072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 --2- 172.21.15.26:0/3541007540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80c8250 0x7f63a8072bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 -- 172.21.15.26:0/3541007540 >> v2:172.21.15.169:3300/0 conn(0x7f63a80c1e20 msgr2=0x7f63a815b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 --2- 172.21.15.26:0/3541007540 >> v2:172.21.15.169:3300/0 conn(0x7f63a80c1e20 0x7f63a815b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a77fe640 1 -- 172.21.15.26:0/3541007540 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a80c16f0 con 0x7f63a8151aa0 2024-04-21T08:57:37.086 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.082+0000 7f63a6ffd640 1 --2- 172.21.15.26:0/3541007540 >> v2:172.21.15.169:3300/0 conn(0x7f63a80c1e20 0x7f63a815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:37.088 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63a77fe640 1 --2- 172.21.15.26:0/3541007540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8151aa0 0x7f63a806e690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63a8070210 tx=0x7f639801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345231eaaf4e67e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.089 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63a67fc640 1 -- 172.21.15.26:0/3541007540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63980b5070 con 0x7f63a8151aa0 2024-04-21T08:57:37.089 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63a67fc640 1 -- 172.21.15.26:0/3541007540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63980a89d0 con 0x7f63a8151aa0 2024-04-21T08:57:37.089 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63a67fc640 1 -- 172.21.15.26:0/3541007540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63980a8da0 con 0x7f63a8151aa0 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 -- 172.21.15.26:0/3541007540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8151aa0 msgr2=0x7f63a806e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 --2- 172.21.15.26:0/3541007540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8151aa0 0x7f63a806e690 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63a8070210 tx=0x7f639801ed10 comp rx=0 tx=0).stop 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 -- 172.21.15.26:0/3541007540 shutdown_connections 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 --2- 172.21.15.26:0/3541007540 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a80c8250 0x7f63a8072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 --2- 172.21.15.26:0/3541007540 >> v2:172.21.15.169:3300/0 conn(0x7f63a80c1e20 0x7f63a815b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 --2- 172.21.15.26:0/3541007540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a8151aa0 0x7f63a806e690 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 -- 172.21.15.26:0/3541007540 >> 172.21.15.26:0/3541007540 conn(0x7f63a806f8b0 msgr2=0x7f63a80cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 -- 172.21.15.26:0/3541007540 shutdown_connections 2024-04-21T08:57:37.090 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.086+0000 7f63ae088640 1 -- 172.21.15.26:0/3541007540 wait complete. 2024-04-21T08:57:37.091 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 Processor -- start 2024-04-21T08:57:37.091 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 -- start start 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80c1e20 0x7f63a81579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a80c8250 0x7f63a8154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a8151aa0 0x7f63a80c66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f63a815b180 con 0x7f63a80c8250 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f63a815aea0 con 0x7f63a80c1e20 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f63a815bbe0 con 0x7f63a8151aa0 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a80c8250 0x7f63a8154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a80c8250 0x7f63a8154550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39354/0 (socket says 172.21.15.26:39354) 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 -- 172.21.15.26:0/4010435933 learned_addr learned my addr 172.21.15.26:0/4010435933 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:37.093 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a77fe640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80c1e20 0x7f63a81579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a7fff640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a8151aa0 0x7f63a80c66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 -- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a8151aa0 msgr2=0x7f63a80c66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a8151aa0 0x7f63a80c66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 -- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80c1e20 msgr2=0x7f63a81579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80c1e20 0x7f63a81579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 -- 172.21.15.26:0/4010435933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a8154a90 con 0x7f63a80c8250 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a7fff640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a8151aa0 0x7f63a80c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63a6ffd640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a80c8250 0x7f63a8154550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f639c00e7e0 tx=0x7f639c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f638ffff640 1 -- 172.21.15.26:0/4010435933 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c017070 con 0x7f63a80c8250 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f638ffff640 1 -- 172.21.15.26:0/4010435933 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639c00c6d0 con 0x7f63a80c8250 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f638ffff640 1 -- 172.21.15.26:0/4010435933 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f639c00f040 con 0x7f63a80c8250 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63a81f0f50 con 0x7f63a80c8250 2024-04-21T08:57:37.094 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63a81f1510 con 0x7f63a80c8250 2024-04-21T08:57:37.095 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.090+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63a8069050 con 0x7f63a80c8250 2024-04-21T08:57:37.095 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.094+0000 7f638ffff640 1 -- 172.21.15.26:0/4010435933 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f639c01a070 con 0x7f63a80c8250 2024-04-21T08:57:37.095 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.094+0000 7f638ffff640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f63940682f0 0x7f639406a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.096 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.094+0000 7f638ffff640 1 -- 172.21.15.26:0/4010435933 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3726+0+0 (secure 0 0 0) 0x7f639c085c80 con 0x7f63a80c8250 2024-04-21T08:57:37.096 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.094+0000 7f63a77fe640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f63940682f0 0x7f639406a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.096 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.094+0000 7f63a77fe640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f63940682f0 0x7f639406a7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f63980b2000 tx=0x7f6398008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.100 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.098+0000 7f638ffff640 1 -- 172.21.15.26:0/4010435933 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f639c056ae0 con 0x7f63a80c8250 2024-04-21T08:57:37.277 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.274+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63a80694b0 con 0x7f63a80c8250 2024-04-21T08:57:37.279 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f638ffff640 1 -- 172.21.15.26:0/4010435933 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+12793 (secure 0 0 0) 0x7f639c0563e0 con 0x7f63a80c8250 2024-04-21T08:57:37.279 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-21T08:57:37.279 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":15,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:37.170941+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:37.281 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f63940682f0 msgr2=0x7f639406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.281 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f63940682f0 0x7f639406a7b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f63980b2000 tx=0x7f6398008040 comp rx=0 tx=0).stop 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a80c8250 msgr2=0x7f63a8154550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a80c8250 0x7f63a8154550 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f639c00e7e0 tx=0x7f639c00eca0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 shutdown_connections 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a8151aa0 0x7f63a80c66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f63940682f0 0x7f639406a7b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f63a80c8250 0x7f63a8154550 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 --2- 172.21.15.26:0/4010435933 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63a80c1e20 0x7f63a81579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 >> 172.21.15.26:0/4010435933 conn(0x7f63a806f8b0 msgr2=0x7f63a814f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 shutdown_connections 2024-04-21T08:57:37.282 INFO:teuthology.misc.health.smithi026.stderr:2024-04-21T08:57:37.278+0000 7f63ae088640 1 -- 172.21.15.26:0/4010435933 wait complete. 2024-04-21T08:57:37.295 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-21T08:57:37.295 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-21T08:57:37.296 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-21T08:57:37.296 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-21T08:57:37.298 INFO:tasks.ceph.mds.a:Started 2024-04-21T08:57:37.298 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-21T08:57:37.298 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-21T08:57:37.301 INFO:tasks.ceph.mds.c:Started 2024-04-21T08:57:37.301 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-21T08:57:37.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-21T08:57:37.303 INFO:tasks.ceph.mds.e:Started 2024-04-21T08:57:37.303 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-21T08:57:37.303 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-21T08:57:37.306 INFO:tasks.ceph.mds.b:Started 2024-04-21T08:57:37.306 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-21T08:57:37.307 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-21T08:57:37.309 INFO:tasks.ceph.mds.d:Started 2024-04-21T08:57:37.309 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-21T08:57:37.309 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-21T08:57:37.312 INFO:tasks.ceph.mds.f:Started 2024-04-21T08:57:37.312 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-21T08:57:37.312 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:37.376 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2024-04-21T08:57:37.377 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2024-04-21T08:57:37.378 INFO:tasks.ceph.mds.e.smithi026.stdout:starting mds.e at 2024-04-21T08:57:37.398 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-04-21T08:57:37.402 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-04-21T08:57:37.402 INFO:tasks.ceph.mds.f.smithi169.stdout:starting mds.f at 2024-04-21T08:57:37.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7dbcc5f640 1 Processor -- start 2024-04-21T08:57:37.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7dbcc5f640 1 -- start start 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7dbcc5f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 0x7f7db8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7dbcc5f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7db80ce790 0x7f7db81584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7dbcc5f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db80c9480 con 0x7f7db80ce3b0 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7dbcc5f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7db806cfc0 con 0x7f7db80ce790 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7dbcc5f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7db80c9720 con 0x7f7db806caf0 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7db80ce3b0 0x7f7db806fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39040/0 (socket says 172.21.15.26:39040) 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db659c640 1 -- 172.21.15.26:0/1188389243 learned_addr learned my addr 172.21.15.26:0/1188389243 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:37.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 0x7f7db8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932062539 0 0) 0x7f7db80c9480 con 0x7f7db80ce3b0 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db6d9d640 1 --2- 172.21.15.26:0/1188389243 >> v2:172.21.15.169:3300/0 conn(0x7f7db80ce790 0x7f7db81584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7da4003530 con 0x7f7db80ce3b0 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1429373940 0 0) 0x7f7da4003530 con 0x7f7db80ce3b0 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 msgr2=0x7f7db8157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 0x7f7db8157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 >> v2:172.21.15.169:3300/0 conn(0x7f7db80ce790 msgr2=0x7f7db81584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 --2- 172.21.15.26:0/1188389243 >> v2:172.21.15.169:3300/0 conn(0x7f7db80ce790 0x7f7db81584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.418+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db80c9a00 con 0x7f7db80ce3b0 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f7da80016a0 con 0x7f7db80ce3b0 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 >> v1:172.21.15.26:6789/0 conn(0x7f7db80ce3b0 legacy=0x7f7db806fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 0x7f7da40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7da4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da4004d50 0x7f7da40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7db806cfc0 con 0x7f7da4003f40 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7db80c9720 con 0x7f7da4004d50 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7da400b9d0 con 0x7f7db806caf0 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7da4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db659c640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 0x7f7da40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db6d9d640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da4004d50 0x7f7da40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db5d9b640 1 -- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 msgr2=0x7f7da40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db806caf0 0x7f7da40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db5d9b640 1 -- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da4004d50 msgr2=0x7f7da40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7da4004d50 0x7f7da40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db5d9b640 1 -- 172.21.15.26:0/1188389243 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da4003530 con 0x7f7da4003f40 2024-04-21T08:57:37.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7da4004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009ab0 tx=0x7f7da001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c72d9a53e94623d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00b1070 con 0x7f7da4003f40 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da00a4b00 con 0x7f7da4003f40 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db559a640 1 -- 172.21.15.26:0/1188389243 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da00096b0 con 0x7f7da4003f40 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1188389243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 msgr2=0x7f7da4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7dbcc5f640 1 --2- 172.21.15.26:0/1188389243 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7da4004810 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7da0009ab0 tx=0x7f7da001c6a0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7db6d9d640 1 -- 172.21.15.26:0/1188389243 reap_dead start 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1188389243 shutdown_connections 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1188389243 >> 172.21.15.26:0/1188389243 conn(0x7f7db8067760 msgr2=0x7f7db8067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1188389243 shutdown_connections 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.422+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1188389243 wait complete. 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 Processor -- start 2024-04-21T08:57:37.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 -- start start 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7db81f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7db80c44f0 0x7f7db81598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db815a5e0 0x7f7db8159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7db815b330 con 0x7f7da4003f40 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7db815b1b0 con 0x7f7db80c44f0 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7db815b4b0 con 0x7f7db815a5e0 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7db81f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7db81f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39402/0 (socket says 172.21.15.26:39402) 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 -- 172.21.15.26:0/1156351434 learned_addr learned my addr 172.21.15.26:0/1156351434 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7db80c44f0 0x7f7db81598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db6d9d640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db815a5e0 0x7f7db8159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 -- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db815a5e0 msgr2=0x7f7db8159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db815a5e0 0x7f7db8159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 -- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7db80c44f0 msgr2=0x7f7db81598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7db80c44f0 0x7f7db81598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 -- 172.21.15.26:0/1156351434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db80afc20 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db659c640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7db81f2020 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7da8012360 tx=0x7f7da8012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7daeffd640 1 -- 172.21.15.26:0/1156351434 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da801c070 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7daeffd640 1 -- 172.21.15.26:0/1156351434 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da8014750 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db80afea0 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7daeffd640 1 -- 172.21.15.26:0/1156351434 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da8014b40 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db80b0460 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db8075ef0 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7daeffd640 1 -- 172.21.15.26:0/1156351434 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f7da801f070 con 0x7f7da4003f40 2024-04-21T08:57:37.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7daeffd640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7d98068320 0x7f7d9806a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7daeffd640 1 -- 172.21.15.26:0/1156351434 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7f7da8088ed0 con 0x7f7da4003f40 2024-04-21T08:57:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.426+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7d98068320 0x7f7d9806a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.430+0000 7f7db5d9b640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7d98068320 0x7f7d9806a7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7da00ae000 tx=0x7f7da00046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.434+0000 7f7daeffd640 1 -- 172.21.15.26:0/1156351434 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7db80afc20 con 0x7f7da4003f40 2024-04-21T08:57:37.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.590+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7db8070080 con 0x7f7da4003f40 2024-04-21T08:57:37.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7daeffd640 1 -- 172.21.15.26:0/1156351434 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+12793 (secure 0 0 0) 0x7f7da80591e0 con 0x7f7da4003f40 2024-04-21T08:57:37.595 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:37.595 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":15,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:37.170941+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7d98068320 msgr2=0x7f7d9806a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7d98068320 0x7f7d9806a7e0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7da00ae000 tx=0x7f7da00046d0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 msgr2=0x7f7db81f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7db81f2020 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7da8012360 tx=0x7f7da8012820 comp rx=0 tx=0).stop 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 shutdown_connections 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7db815a5e0 0x7f7db8159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7db80c44f0 0x7f7db81598e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7d98068320 0x7f7d9806a7e0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 --2- 172.21.15.26:0/1156351434 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7da4003f40 0x7f7db81f2020 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 >> 172.21.15.26:0/1156351434 conn(0x7f7db8067760 msgr2=0x7f7db81567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:37.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 shutdown_connections 2024-04-21T08:57:37.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.594+0000 7f7dbcc5f640 1 -- 172.21.15.26:0/1156351434 wait complete. 2024-04-21T08:57:37.613 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T08:57:37.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T08:57:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6432a1c640 1 Processor -- start 2024-04-21T08:57:37.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6432a1c640 1 -- start start 2024-04-21T08:57:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6432a1c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c14df30 0x7f642c0c8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6432a1c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f642c0c71c0 0x7f642c15a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6432a1c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c14e310 con 0x7f642c06e5d0 2024-04-21T08:57:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6432a1c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f642c0c86b0 con 0x7f642c0c71c0 2024-04-21T08:57:37.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6432a1c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f642c06d530 con 0x7f642c14df30 2024-04-21T08:57:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f642bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c14df30 0x7f642c0c8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6430fb9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f642c0c71c0 0x7f642c15a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6430fb9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f642c0c71c0 0x7f642c15a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:55176/0 (socket says 172.21.15.26:55176) 2024-04-21T08:57:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f6430fb9640 1 -- 172.21.15.26:0/324623121 learned_addr learned my addr 172.21.15.26:0/324623121 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f642b7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f642c06e5d0 0x7f642c071490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:33966/0 (socket says 172.21.15.26:33966) 2024-04-21T08:57:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f642bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c14df30 0x7f642c0c8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:47404/0 (socket says 172.21.15.26:47404) 2024-04-21T08:57:37.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f642bfff640 1 -- 172.21.15.26:0/324623121 >> v2:172.21.15.169:3300/0 conn(0x7f642c0c71c0 msgr2=0x7f642c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f642bfff640 1 --2- 172.21.15.26:0/324623121 >> v2:172.21.15.169:3300/0 conn(0x7f642c0c71c0 0x7f642c15a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f642bfff640 1 -- 172.21.15.26:0/324623121 >> v1:172.21.15.169:6789/0 conn(0x7f642c06e5d0 legacy=0x7f642c071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.738+0000 7f642bfff640 1 -- 172.21.15.26:0/324623121 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c06d810 con 0x7f642c14df30 2024-04-21T08:57:37.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f642bfff640 1 --2- 172.21.15.26:0/324623121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c14df30 0x7f642c0c8060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f64140097c0 tx=0x7f641401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=767cce209d8ff8ad server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f642affd640 1 -- 172.21.15.26:0/324623121 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140a7070 con 0x7f642c14df30 2024-04-21T08:57:37.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f642affd640 1 -- 172.21.15.26:0/324623121 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64140b0070 con 0x7f642c14df30 2024-04-21T08:57:37.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f642affd640 1 -- 172.21.15.26:0/324623121 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64140ab890 con 0x7f642c14df30 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 -- 172.21.15.26:0/324623121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c14df30 msgr2=0x7f642c0c8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 --2- 172.21.15.26:0/324623121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c14df30 0x7f642c0c8060 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f64140097c0 tx=0x7f641401c470 comp rx=0 tx=0).stop 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 -- 172.21.15.26:0/324623121 shutdown_connections 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 --2- 172.21.15.26:0/324623121 >> v2:172.21.15.169:3300/0 conn(0x7f642c0c71c0 0x7f642c15a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 --2- 172.21.15.26:0/324623121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c14df30 0x7f642c0c8060 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 -- 172.21.15.26:0/324623121 >> 172.21.15.26:0/324623121 conn(0x7f642c0cbef0 msgr2=0x7f642c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 -- 172.21.15.26:0/324623121 shutdown_connections 2024-04-21T08:57:37.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.742+0000 7f6432a1c640 1 -- 172.21.15.26:0/324623121 wait complete. 2024-04-21T08:57:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 Processor -- start 2024-04-21T08:57:37.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 -- start start 2024-04-21T08:57:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c06e5d0 0x7f642c0bf560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c0c71c0 0x7f642c072790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f642c14df30 0x7f642c1f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f642c161a10 con 0x7f642c0c71c0 2024-04-21T08:57:37.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f642c15b3a0 con 0x7f642c14df30 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f642c161b90 con 0x7f642c06e5d0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c0c71c0 0x7f642c072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c0c71c0 0x7f642c072790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36368/0 (socket says 172.21.15.26:36368) 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 -- 172.21.15.26:0/1246359141 learned_addr learned my addr 172.21.15.26:0/1246359141 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6430fb9640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f642c14df30 0x7f642c1f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642bfff640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c06e5d0 0x7f642c0bf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 -- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c06e5d0 msgr2=0x7f642c0bf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c06e5d0 0x7f642c0bf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 -- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f642c14df30 msgr2=0x7f642c1f5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f642c14df30 0x7f642c1f5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 -- 172.21.15.26:0/1246359141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c147a90 con 0x7f642c0c71c0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f642b7fe640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c0c71c0 0x7f642c072790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f642400c7c0 tx=0x7f642400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6428ff9640 1 -- 172.21.15.26:0/1246359141 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424017070 con 0x7f642c0c71c0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6428ff9640 1 -- 172.21.15.26:0/1246359141 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f642400a640 con 0x7f642c0c71c0 2024-04-21T08:57:37.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c0bfee0 con 0x7f642c0c71c0 2024-04-21T08:57:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6428ff9640 1 -- 172.21.15.26:0/1246359141 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f642400a9f0 con 0x7f642c0c71c0 2024-04-21T08:57:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c0c04a0 con 0x7f642c0c71c0 2024-04-21T08:57:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642c074320 con 0x7f642c0c71c0 2024-04-21T08:57:37.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6428ff9640 1 -- 172.21.15.26:0/1246359141 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f642401a070 con 0x7f642c0c71c0 2024-04-21T08:57:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6428ff9640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6410068320 0x7f641006a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.746+0000 7f6428ff9640 1 -- 172.21.15.26:0/1246359141 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7f6424085af0 con 0x7f642c0c71c0 2024-04-21T08:57:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.750+0000 7f642bfff640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6410068320 0x7f641006a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:37.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.750+0000 7f642bfff640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6410068320 0x7f641006a7e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64140af000 tx=0x7f64140b6040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:37.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.754+0000 7f6428ff9640 1 -- 172.21.15.26:0/1246359141 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6424055ea0 con 0x7f642c0c71c0 2024-04-21T08:57:37.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f642c0cab60 con 0x7f642c0c71c0 2024-04-21T08:57:37.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6428ff9640 1 -- 172.21.15.26:0/1246359141 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) ==== 93+0+10 (secure 0 0 0) 0x7f642405a1a0 con 0x7f642c0c71c0 2024-04-21T08:57:37.912 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6410068320 msgr2=0x7f641006a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6410068320 0x7f641006a7e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f64140af000 tx=0x7f64140b6040 comp rx=0 tx=0).stop 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c0c71c0 msgr2=0x7f642c072790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c0c71c0 0x7f642c072790 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f642400c7c0 tx=0x7f642400cc80 comp rx=0 tx=0).stop 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 shutdown_connections 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f642c14df30 0x7f642c1f5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6410068320 0x7f641006a7e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f642c0c71c0 0x7f642c072790 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 --2- 172.21.15.26:0/1246359141 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f642c06e5d0 0x7f642c0bf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 >> 172.21.15.26:0/1246359141 conn(0x7f642c0cbef0 msgr2=0x7f642c0cb5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 shutdown_connections 2024-04-21T08:57:37.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:37.910+0000 7f6432a1c640 1 -- 172.21.15.26:0/1246359141 wait complete. 2024-04-21T08:57:37.929 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:57:38.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.038+0000 7f6a31c4b640 1 Processor -- start 2024-04-21T08:57:38.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.038+0000 7f6a31c4b640 1 -- start start 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a31c4b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a2c155100 0x7f6a2c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a31c4b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c15e410 0x7f6a2c15e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a31c4b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2c15eda0 con 0x7f6a2c071c30 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a31c4b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6a2c15f330 con 0x7f6a2c155100 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a31c4b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2c15f050 con 0x7f6a2c15e410 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a2c155100 0x7f6a2c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6a2c155100 0x7f6a2c06b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36380/0 (socket says 172.21.15.26:36380) 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 -- 172.21.15.26:0/184020644 learned_addr learned my addr 172.21.15.26:0/184020644 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2bfff640 1 --2- 172.21.15.26:0/184020644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c15e410 0x7f6a2c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 -- 172.21.15.26:0/184020644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c15e410 msgr2=0x7f6a2c15e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 --2- 172.21.15.26:0/184020644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c15e410 0x7f6a2c15e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 -- 172.21.15.26:0/184020644 >> v1:172.21.15.169:6789/0 conn(0x7f6a2c071c30 legacy=0x7f6a2c0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:38.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 -- 172.21.15.26:0/184020644 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c072650 con 0x7f6a2c155100 2024-04-21T08:57:38.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2b7fe640 1 --2- 172.21.15.26:0/184020644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c155100 0x7f6a2c06b9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a20006fd0 tx=0x7f6a2001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16dfc973a0c6af00 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:38.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2a7fc640 1 -- 172.21.15.26:0/184020644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a200b0070 con 0x7f6a2c155100 2024-04-21T08:57:38.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2a7fc640 1 -- 172.21.15.26:0/184020644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a200ab600 con 0x7f6a2c155100 2024-04-21T08:57:38.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.042+0000 7f6a2a7fc640 1 -- 172.21.15.26:0/184020644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a200ab9d0 con 0x7f6a2c155100 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- 172.21.15.26:0/184020644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c155100 msgr2=0x7f6a2c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/184020644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c155100 0x7f6a2c06b9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a20006fd0 tx=0x7f6a2001c470 comp rx=0 tx=0).stop 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- 172.21.15.26:0/184020644 shutdown_connections 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/184020644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c15e410 0x7f6a2c15e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/184020644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c155100 0x7f6a2c06b9e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- 172.21.15.26:0/184020644 >> 172.21.15.26:0/184020644 conn(0x7f6a2c0c92d0 msgr2=0x7f6a2c0c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- 172.21.15.26:0/184020644 shutdown_connections 2024-04-21T08:57:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- 172.21.15.26:0/184020644 wait complete. 2024-04-21T08:57:38.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 Processor -- start 2024-04-21T08:57:38.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- start start 2024-04-21T08:57:38.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c071c30 0x7f6a2c1596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2c155100 0x7f6a2c15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c15e410 0x7f6a2c1f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c073410 con 0x7f6a2c15e410 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6a2c06bf20 con 0x7f6a2c155100 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6a2c0c6260 con 0x7f6a2c071c30 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c15e410 0x7f6a2c1f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c15e410 0x7f6a2c1f53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36382/0 (socket says 172.21.15.26:36382) 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 -- 172.21.15.26:0/905557346 learned_addr learned my addr 172.21.15.26:0/905557346 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2b7fe640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c071c30 0x7f6a2c1596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2affd640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2c155100 0x7f6a2c15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 -- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c071c30 msgr2=0x7f6a2c1596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c071c30 0x7f6a2c1596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 -- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2c155100 msgr2=0x7f6a2c15b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:38.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2c155100 0x7f6a2c15b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 -- 172.21.15.26:0/905557346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2c0c56e0 con 0x7f6a2c15e410 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2b7fe640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c071c30 0x7f6a2c1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a2bfff640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c15e410 0x7f6a2c1f53e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a24007e40 tx=0x7f6a2400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a13fff640 1 -- 172.21.15.26:0/905557346 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24014620 con 0x7f6a2c15e410 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a13fff640 1 -- 172.21.15.26:0/905557346 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a24019070 con 0x7f6a2c15e410 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2c0c59c0 con 0x7f6a2c15e410 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a13fff640 1 -- 172.21.15.26:0/905557346 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a24014a20 con 0x7f6a2c15e410 2024-04-21T08:57:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.046+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a2c0c5f80 con 0x7f6a2c15e410 2024-04-21T08:57:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.050+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a2c075ef0 con 0x7f6a2c15e410 2024-04-21T08:57:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.050+0000 7f6a13fff640 1 -- 172.21.15.26:0/905557346 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7f6a24014bc0 con 0x7f6a2c15e410 2024-04-21T08:57:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.050+0000 7f6a13fff640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6a180682f0 0x7f6a1806a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.050+0000 7f6a13fff640 1 -- 172.21.15.26:0/905557346 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4857+0+0 (secure 0 0 0) 0x7f6a24086ec0 con 0x7f6a2c15e410 2024-04-21T08:57:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.050+0000 7f6a2b7fe640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6a180682f0 0x7f6a1806a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.050+0000 7f6a2b7fe640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6a180682f0 0x7f6a1806a7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6a200ad000 tx=0x7f6a200a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:38.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.054+0000 7f6a13fff640 1 -- 172.21.15.26:0/905557346 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6a24057820 con 0x7f6a2c15e410 2024-04-21T08:57:38.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.254+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a2c0c7de0 con 0x7f6a2c15e410 2024-04-21T08:57:38.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.254+0000 7f6a13fff640 1 -- 172.21.15.26:0/905557346 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1389 (secure 0 0 0) 0x7f6a24057120 con 0x7f6a2c15e410 2024-04-21T08:57:38.256 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:38.256 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-21T08:57:38.256 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.254+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6a180682f0 msgr2=0x7f6a1806a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.254+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6a180682f0 0x7f6a1806a7b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6a200ad000 tx=0x7f6a200a6000 comp rx=0 tx=0).stop 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.254+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c15e410 msgr2=0x7f6a2c1f53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.254+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c15e410 0x7f6a2c1f53e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a24007e40 tx=0x7f6a2400e4b0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 shutdown_connections 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6a180682f0 0x7f6a1806a7b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6a2c15e410 0x7f6a2c1f53e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a2c155100 0x7f6a2c15b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 --2- 172.21.15.26:0/905557346 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a2c071c30 0x7f6a2c1596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 >> 172.21.15.26:0/905557346 conn(0x7f6a2c0c92d0 msgr2=0x7f6a2c0cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:38.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 shutdown_connections 2024-04-21T08:57:38.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:38.258+0000 7f6a31c4b640 1 -- 172.21.15.26:0/905557346 wait complete. 2024-04-21T08:57:40.275 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:57:40.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.406+0000 7f7c17215640 1 Processor -- start 2024-04-21T08:57:40.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.406+0000 7f7c17215640 1 -- start start 2024-04-21T08:57:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c17215640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7c10073b50 0x7f7c100c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c17215640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c100c6050 con 0x7f7c100c52b0 2024-04-21T08:57:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c17215640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c100c3470 con 0x7f7c100c5690 2024-04-21T08:57:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c17215640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7c100c5e00 con 0x7f7c10073b50 2024-04-21T08:57:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c14fb1640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7c100c52b0 0x7f7c101529d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39676/0 (socket says 172.21.15.26:39676) 2024-04-21T08:57:40.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c14fb1640 1 -- 172.21.15.26:0/2408396305 learned_addr learned my addr 172.21.15.26:0/2408396305 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0ffff640 1 --2- 172.21.15.26:0/2408396305 >> v2:172.21.15.169:3300/0 conn(0x7f7c10073b50 0x7f7c100c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3256071964 0 0) 0x7f7c100c6050 con 0x7f7c100c52b0 2024-04-21T08:57:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bfc003530 con 0x7f7c100c52b0 2024-04-21T08:57:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1090371361 0 0) 0x7f7bfc003530 con 0x7f7c100c52b0 2024-04-21T08:57:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 >> v2:172.21.15.169:3300/0 conn(0x7f7c10073b50 msgr2=0x7f7c100c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 --2- 172.21.15.26:0/2408396305 >> v2:172.21.15.169:3300/0 conn(0x7f7c10073b50 0x7f7c100c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 >> v1:172.21.15.169:6789/0 conn(0x7f7c100c5690 legacy=0x7f7c1006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c100c3750 con 0x7f7c100c52b0 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f7c08001a00 con 0x7f7c100c52b0 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 >> v1:172.21.15.26:6789/0 conn(0x7f7c100c52b0 legacy=0x7f7c101529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0039c0 0x7f7bfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bfc004810 0x7f7bfc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bfc0053d0 0x7f7bfc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100c5e00 con 0x7f7bfc0053d0 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7bfc00c260 con 0x7f7bfc004810 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7bfc00c460 con 0x7f7bfc0039c0 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c157b2640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bfc0053d0 0x7f7bfc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c14fb1640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0039c0 0x7f7bfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c0ffff640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bfc004810 0x7f7bfc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c157b2640 1 -- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0039c0 msgr2=0x7f7bfc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:40.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c157b2640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0039c0 0x7f7bfc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c157b2640 1 -- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bfc004810 msgr2=0x7f7bfc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:40.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c157b2640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bfc004810 0x7f7bfc004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.410+0000 7f7c157b2640 1 -- 172.21.15.26:0/2408396305 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bfc003530 con 0x7f7bfc0053d0 2024-04-21T08:57:40.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 -- 172.21.15.26:0/2408396305 reap_dead start 2024-04-21T08:57:40.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bfc0053d0 0x7f7bfc00b9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c00001780 tx=0x7f7c0001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fd551665c6e161 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:40.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c000013a0 con 0x7f7bfc0053d0 2024-04-21T08:57:40.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c000052f0 con 0x7f7bfc0053d0 2024-04-21T08:57:40.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c0f7fe640 1 -- 172.21.15.26:0/2408396305 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00003840 con 0x7f7bfc0053d0 2024-04-21T08:57:40.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- 172.21.15.26:0/2408396305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bfc0053d0 msgr2=0x7f7bfc00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bfc0053d0 0x7f7bfc00b9d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c00001780 tx=0x7f7c0001c420 comp rx=0 tx=0).stop 2024-04-21T08:57:40.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- 172.21.15.26:0/2408396305 shutdown_connections 2024-04-21T08:57:40.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 --2- 172.21.15.26:0/2408396305 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bfc0053d0 0x7f7bfc00b9d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- 172.21.15.26:0/2408396305 >> 172.21.15.26:0/2408396305 conn(0x7f7c100c8960 msgr2=0x7f7c100c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:40.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- 172.21.15.26:0/2408396305 shutdown_connections 2024-04-21T08:57:40.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- 172.21.15.26:0/2408396305 wait complete. 2024-04-21T08:57:40.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 Processor -- start 2024-04-21T08:57:40.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- start start 2024-04-21T08:57:40.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0053d0 0x7f7c101f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c100aea90 0x7f7c100caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c101f5540 0x7f7c101f59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100c97e0 con 0x7f7c101f5540 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100c9660 con 0x7f7c100aea90 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c17215640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7c100c6330 con 0x7f7bfc0053d0 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c101f5540 0x7f7c101f59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c101f5540 0x7f7c101f59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36408/0 (socket says 172.21.15.26:36408) 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 -- 172.21.15.26:0/980969024 learned_addr learned my addr 172.21.15.26:0/980969024 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c14fb1640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0053d0 0x7f7c101f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c0ffff640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c100aea90 0x7f7c100caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 -- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0053d0 msgr2=0x7f7c101f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0053d0 0x7f7c101f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 -- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c100aea90 msgr2=0x7f7c100caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c100aea90 0x7f7c100caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 -- 172.21.15.26:0/980969024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c101f5f00 con 0x7f7c101f5540 2024-04-21T08:57:40.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c0ffff640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c100aea90 0x7f7c100caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.414+0000 7f7c157b2640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c101f5540 0x7f7c101f59c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c0001c250 tx=0x7f7bfc005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c0d7fa640 1 -- 172.21.15.26:0/980969024 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c000b9070 con 0x7f7c101f5540 2024-04-21T08:57:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c0d7fa640 1 -- 172.21.15.26:0/980969024 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c000054a0 con 0x7f7c101f5540 2024-04-21T08:57:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c10072b40 con 0x7f7c101f5540 2024-04-21T08:57:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c0d7fa640 1 -- 172.21.15.26:0/980969024 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c00007a40 con 0x7f7c101f5540 2024-04-21T08:57:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c101f4d40 con 0x7f7c101f5540 2024-04-21T08:57:40.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c100734e0 con 0x7f7c101f5540 2024-04-21T08:57:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c0d7fa640 1 -- 172.21.15.26:0/980969024 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c000bc070 con 0x7f7c101f5540 2024-04-21T08:57:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c0d7fa640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bf0068380 0x7f7bf006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c0d7fa640 1 -- 172.21.15.26:0/980969024 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7c0011f200 con 0x7f7c101f5540 2024-04-21T08:57:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c14fb1640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bf0068380 0x7f7bf006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.418+0000 7f7c14fb1640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bf0068380 0x7f7bf006a840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c08002240 tx=0x7f7c08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:40.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.422+0000 7f7c0d7fa640 1 -- 172.21.15.26:0/980969024 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c100734e0 con 0x7f7c101f5540 2024-04-21T08:57:40.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.622+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c10075ef0 con 0x7f7c101f5540 2024-04-21T08:57:40.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.622+0000 7f7c0d7fa640 1 -- 172.21.15.26:0/980969024 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5515 (secure 0 0 0) 0x7f7c101f5f00 con 0x7f7c101f5540 2024-04-21T08:57:40.625 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:40.625 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-21T08:57:40.625 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2024-04-21T08:57:40.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bf0068380 msgr2=0x7f7bf006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bf0068380 0x7f7bf006a840 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c08002240 tx=0x7f7c08009040 comp rx=0 tx=0).stop 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c101f5540 msgr2=0x7f7c101f59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c101f5540 0x7f7c101f59c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7c0001c250 tx=0x7f7bfc005840 comp rx=0 tx=0).stop 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 shutdown_connections 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bf0068380 0x7f7bf006a840 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c101f5540 0x7f7c101f59c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7c100aea90 0x7f7c100caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 --2- 172.21.15.26:0/980969024 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bfc0053d0 0x7f7c101f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 >> 172.21.15.26:0/980969024 conn(0x7f7c100c8960 msgr2=0x7f7c1014d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 shutdown_connections 2024-04-21T08:57:40.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.626+0000 7f7c17215640 1 -- 172.21.15.26:0/980969024 wait complete. 2024-04-21T08:57:40.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b52e55640 1 Processor -- start 2024-04-21T08:57:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b52e55640 1 -- start start 2024-04-21T08:57:40.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b52e55640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b52e55640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0b4c0c5690 0x7f0b4c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b52e55640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b4c0c6050 con 0x7f0b4c0c52b0 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b52e55640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0b4c0c5e00 con 0x7f0b4c0c5690 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b52e55640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c0c6330 con 0x7f0b4c073b50 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b50bf1640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0b4c0c52b0 0x7f0b4c1529d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39678/0 (socket says 172.21.15.26:39678) 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b50bf1640 1 -- 172.21.15.26:0/3627493860 learned_addr learned my addr 172.21.15.26:0/3627493860 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b4bfff640 1 --2- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b513f2640 1 --2- 172.21.15.26:0/3627493860 >> v2:172.21.15.169:3300/0 conn(0x7f0b4c0c5690 0x7f0b4c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b4b7fe640 1 -- 172.21.15.26:0/3627493860 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217074001 0 0) 0x7f0b4c0c6050 con 0x7f0b4c0c52b0 2024-04-21T08:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b4b7fe640 1 -- 172.21.15.26:0/3627493860 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b34003530 con 0x7f0b4c0c52b0 2024-04-21T08:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b513f2640 1 -- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 msgr2=0x7f0b4c0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b513f2640 1 --2- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c0c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b513f2640 1 -- 172.21.15.26:0/3627493860 >> v1:172.21.15.26:6789/0 conn(0x7f0b4c0c52b0 legacy=0x7f0b4c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b4b7fe640 1 -- 172.21.15.26:0/3627493860 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3109598003 0 0) 0x7f0b34003530 con 0x7f0b4c0c52b0 2024-04-21T08:57:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.770+0000 7f0b513f2640 1 -- 172.21.15.26:0/3627493860 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c0c3470 con 0x7f0b4c0c5690 2024-04-21T08:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b513f2640 1 --2- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1595d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009d90 tx=0x7f0b4401c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be62bfe590e5e86 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b4b7fe640 1 -- 172.21.15.26:0/3627493860 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440ac070 con 0x7f0b4c0c5690 2024-04-21T08:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b4b7fe640 1 -- 172.21.15.26:0/3627493860 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b440a6490 con 0x7f0b4c0c5690 2024-04-21T08:57:40.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b4b7fe640 1 -- 172.21.15.26:0/3627493860 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c001680 con 0x7f0b4c0c5690 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 -- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c5690 msgr2=0x7f0b4c1595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1595d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009d90 tx=0x7f0b4401c770 comp rx=0 tx=0).stop 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 -- 172.21.15.26:0/3627493860 shutdown_connections 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1595d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3627493860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 -- 172.21.15.26:0/3627493860 >> 172.21.15.26:0/3627493860 conn(0x7f0b4c0c8960 msgr2=0x7f0b4c0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 -- 172.21.15.26:0/3627493860 shutdown_connections 2024-04-21T08:57:40.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 -- 172.21.15.26:0/3627493860 wait complete. 2024-04-21T08:57:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 Processor -- start 2024-04-21T08:57:40.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.774+0000 7f0b52e55640 1 -- start start 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c14b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c52b0 0x7f0b4c14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c165870 con 0x7f0b4c0c5690 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0b4c1656f0 con 0x7f0b4c0c52b0 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0b4c1659f0 con 0x7f0b4c073b50 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36424/0 (socket says 172.21.15.26:36424) 2024-04-21T08:57:40.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 -- 172.21.15.26:0/3342703256 learned_addr learned my addr 172.21.15.26:0/3342703256 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b50bf1640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c14b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b4bfff640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c52b0 0x7f0b4c14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 -- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 msgr2=0x7f0b4c14b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c14b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 -- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c52b0 msgr2=0x7f0b4c14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c52b0 0x7f0b4c14b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 -- 172.21.15.26:0/3342703256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b4c1eb4e0 con 0x7f0b4c0c5690 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b513f2640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1556f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b4401ae20 tx=0x7f0b44019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b497fa640 1 -- 172.21.15.26:0/3342703256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440ac070 con 0x7f0b4c0c5690 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b497fa640 1 -- 172.21.15.26:0/3342703256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b440a6a50 con 0x7f0b4c0c5690 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b4c1eb7c0 con 0x7f0b4c0c5690 2024-04-21T08:57:40.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b497fa640 1 -- 172.21.15.26:0/3342703256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440a6e00 con 0x7f0b4c0c5690 2024-04-21T08:57:40.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b4c14adf0 con 0x7f0b4c0c5690 2024-04-21T08:57:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b4c14aff0 con 0x7f0b4c0c5690 2024-04-21T08:57:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b497fa640 1 -- 172.21.15.26:0/3342703256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b440af070 con 0x7f0b4c0c5690 2024-04-21T08:57:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b497fa640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0b380683b0 0x7f0b3806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b497fa640 1 -- 172.21.15.26:0/3342703256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0b44120690 con 0x7f0b4c0c5690 2024-04-21T08:57:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.778+0000 7f0b50bf1640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0b380683b0 0x7f0b3806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:40.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.782+0000 7f0b50bf1640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0b380683b0 0x7f0b3806a870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0011f0 tx=0x7f0b3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:40.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.786+0000 7f0b497fa640 1 -- 172.21.15.26:0/3342703256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b4c14aff0 con 0x7f0b4c0c5690 2024-04-21T08:57:40.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.950+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0b4c075ef0 con 0x7f0b4c0c5690 2024-04-21T08:57:40.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.950+0000 7f0b497fa640 1 -- 172.21.15.26:0/3342703256 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12873 (secure 0 0 0) 0x7f0b44016480 con 0x7f0b4c0c5690 2024-04-21T08:57:40.953 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:40.953 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":17,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:39.175572+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0b380683b0 msgr2=0x7f0b3806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0b380683b0 0x7f0b3806a870 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0011f0 tx=0x7f0b3c009040 comp rx=0 tx=0).stop 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b4c0c5690 msgr2=0x7f0b4c1556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1556f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0b4401ae20 tx=0x7f0b44019510 comp rx=0 tx=0).stop 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 shutdown_connections 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0b380683b0 0x7f0b3806a870 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b4c0c5690 0x7f0b4c1556f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b4c0c52b0 0x7f0b4c14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 --2- 172.21.15.26:0/3342703256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b4c073b50 0x7f0b4c14b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:40.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 >> 172.21.15.26:0/3342703256 conn(0x7f0b4c0c8960 msgr2=0x7f0b4c14e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 shutdown_connections 2024-04-21T08:57:40.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:40.954+0000 7f0b52e55640 1 -- 172.21.15.26:0/3342703256 wait complete. 2024-04-21T08:57:40.973 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T08:57:40.973 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T08:57:41.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f9978640 1 Processor -- start 2024-04-21T08:57:41.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f9978640 1 -- start start 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f9978640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2f4152e60 0x7fa2f40736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f9978640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2f40c5e90 0x7fa2f4073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f9978640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f4153240 con 0x7fa2f40ccba0 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f9978640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f4158d10 con 0x7fa2f40c5e90 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f9978640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f40c6b60 con 0x7fa2f4152e60 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2f40c5e90 0x7fa2f4073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2f40c5e90 0x7fa2f4073be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36430/0 (socket says 172.21.15.26:36430) 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f37fe640 1 -- 172.21.15.26:0/4208232900 learned_addr learned my addr 172.21.15.26:0/4208232900 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f2ffd640 1 --2- 172.21.15.26:0/4208232900 >> v2:172.21.15.169:3300/0 conn(0x7fa2f4152e60 0x7fa2f40736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f37fe640 1 -- 172.21.15.26:0/4208232900 >> v2:172.21.15.169:3300/0 conn(0x7fa2f4152e60 msgr2=0x7fa2f40736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:41.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f37fe640 1 --2- 172.21.15.26:0/4208232900 >> v2:172.21.15.169:3300/0 conn(0x7fa2f4152e60 0x7fa2f40736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f37fe640 1 -- 172.21.15.26:0/4208232900 >> v1:172.21.15.169:6789/0 conn(0x7fa2f40ccba0 legacy=0x7fa2f41591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.098+0000 7fa2f37fe640 1 -- 172.21.15.26:0/4208232900 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f40c3550 con 0x7fa2f40c5e90 2024-04-21T08:57:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f37fe640 1 --2- 172.21.15.26:0/4208232900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4073be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4070550 tx=0x7fa2ec01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeffe769096766a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f1ffb640 1 -- 172.21.15.26:0/4208232900 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0b4070 con 0x7fa2f40c5e90 2024-04-21T08:57:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f1ffb640 1 -- 172.21.15.26:0/4208232900 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec0af400 con 0x7fa2f40c5e90 2024-04-21T08:57:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f1ffb640 1 -- 172.21.15.26:0/4208232900 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0af7d0 con 0x7fa2f40c5e90 2024-04-21T08:57:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 -- 172.21.15.26:0/4208232900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 msgr2=0x7fa2f4073be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 --2- 172.21.15.26:0/4208232900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4073be0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4070550 tx=0x7fa2ec01f1e0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 -- 172.21.15.26:0/4208232900 shutdown_connections 2024-04-21T08:57:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 --2- 172.21.15.26:0/4208232900 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4073be0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 --2- 172.21.15.26:0/4208232900 >> v2:172.21.15.169:3300/0 conn(0x7fa2f4152e60 0x7fa2f40736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 -- 172.21.15.26:0/4208232900 >> 172.21.15.26:0/4208232900 conn(0x7fa2f40cbef0 msgr2=0x7fa2f40cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 -- 172.21.15.26:0/4208232900 shutdown_connections 2024-04-21T08:57:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 -- 172.21.15.26:0/4208232900 wait complete. 2024-04-21T08:57:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 Processor -- start 2024-04-21T08:57:41.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 -- start start 2024-04-21T08:57:41.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ccba0 0x7fa2f41f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.102+0000 7fa2f9978640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4152e60 0x7fa2f4072740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f9978640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f40c67b0 con 0x7fa2f40c5e90 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f9978640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f40c3b10 con 0x7fa2f40ccba0 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f9978640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f41f1720 con 0x7fa2f4152e60 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36432/0 (socket says 172.21.15.26:36432) 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 -- 172.21.15.26:0/2071420858 learned_addr learned my addr 172.21.15.26:0/2071420858 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f27fc640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ccba0 0x7fa2f41f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f37fe640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4152e60 0x7fa2f4072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 -- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4152e60 msgr2=0x7fa2f4072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4152e60 0x7fa2f4072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 -- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ccba0 msgr2=0x7fa2f41f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ccba0 0x7fa2f41f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 -- 172.21.15.26:0/2071420858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f4158280 con 0x7fa2f40c5e90 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f2ffd640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4153ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400d620 tx=0x7fa2e400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2dbfff640 1 -- 172.21.15.26:0/2071420858 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400b620 con 0x7fa2f40c5e90 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2dbfff640 1 -- 172.21.15.26:0/2071420858 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e4019070 con 0x7fa2f40c5e90 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f4158520 con 0x7fa2f40c5e90 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2dbfff640 1 -- 172.21.15.26:0/2071420858 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400b9e0 con 0x7fa2f40c5e90 2024-04-21T08:57:41.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f4156aa0 con 0x7fa2f40c5e90 2024-04-21T08:57:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f4074320 con 0x7fa2f40c5e90 2024-04-21T08:57:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2dbfff640 1 -- 172.21.15.26:0/2071420858 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2e400bb80 con 0x7fa2f40c5e90 2024-04-21T08:57:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2dbfff640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2e0068380 0x7fa2e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2dbfff640 1 -- 172.21.15.26:0/2071420858 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa2e4086a50 con 0x7fa2f40c5e90 2024-04-21T08:57:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.106+0000 7fa2f27fc640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2e0068380 0x7fa2e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.110+0000 7fa2f27fc640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2e0068380 0x7fa2e006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa2f41e4c90 tx=0x7fa2e8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.110+0000 7fa2dbfff640 1 -- 172.21.15.26:0/2071420858 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2e40573f0 con 0x7fa2f40c5e90 2024-04-21T08:57:41.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.274+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2f406e2f0 con 0x7fa2f40c5e90 2024-04-21T08:57:41.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.274+0000 7fa2dbfff640 1 -- 172.21.15.26:0/2071420858 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fa2e4056cf0 con 0x7fa2f40c5e90 2024-04-21T08:57:41.278 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T08:57:41.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2e0068380 msgr2=0x7fa2e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2e0068380 0x7fa2e006a840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa2f41e4c90 tx=0x7fa2e8009040 comp rx=0 tx=0).stop 2024-04-21T08:57:41.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 msgr2=0x7fa2f4153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4153ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400d620 tx=0x7fa2e400dae0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 shutdown_connections 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2f4152e60 0x7fa2f4072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2f40ccba0 0x7fa2f41f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2e0068380 0x7fa2e006a840 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 --2- 172.21.15.26:0/2071420858 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2f40c5e90 0x7fa2f4153ea0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 >> 172.21.15.26:0/2071420858 conn(0x7fa2f40cbef0 msgr2=0x7fa2f40c50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 shutdown_connections 2024-04-21T08:57:41.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.278+0000 7fa2f9978640 1 -- 172.21.15.26:0/2071420858 wait complete. 2024-04-21T08:57:41.297 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-21T08:57:41.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d40def640 1 Processor -- start 2024-04-21T08:57:41.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d40def640 1 -- start start 2024-04-21T08:57:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d40def640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0c52b0 0x7f5d3c0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d40def640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d3c0c5690 0x7f5d3c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d40def640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d3c0c6050 con 0x7f5d3c073b50 2024-04-21T08:57:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d40def640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5d3c0c5e00 con 0x7f5d3c0c5690 2024-04-21T08:57:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d40def640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c0c6330 con 0x7f5d3c0c52b0 2024-04-21T08:57:41.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d3c0c5690 0x7f5d3c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5d3c0c5690 0x7f5d3c1595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36434/0 (socket says 172.21.15.26:36434) 2024-04-21T08:57:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/2751627040 learned_addr learned my addr 172.21.15.26:0/2751627040 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3a59c640 1 --2- 172.21.15.26:0/2751627040 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0c52b0 0x7f5d3c0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/2751627040 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0c52b0 msgr2=0x7f5d3c0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3ad9d640 1 --2- 172.21.15.26:0/2751627040 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0c52b0 0x7f5d3c0c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/2751627040 >> v1:172.21.15.26:6789/0 conn(0x7f5d3c073b50 legacy=0x7f5d3c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.414+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/2751627040 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c0c3470 con 0x7f5d3c0c5690 2024-04-21T08:57:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 --2- 172.21.15.26:0/2751627040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c1595d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009e50 tx=0x7f5d3401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2069ad19f220ba6a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d39d9b640 1 -- 172.21.15.26:0/2751627040 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340a56e0 con 0x7f5d3c0c5690 2024-04-21T08:57:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d39d9b640 1 -- 172.21.15.26:0/2751627040 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d340a5880 con 0x7f5d3c0c5690 2024-04-21T08:57:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d39d9b640 1 -- 172.21.15.26:0/2751627040 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340a5c50 con 0x7f5d3c0c5690 2024-04-21T08:57:41.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- 172.21.15.26:0/2751627040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 msgr2=0x7f5d3c1595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 --2- 172.21.15.26:0/2751627040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c1595d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009e50 tx=0x7f5d3401c910 comp rx=0 tx=0).stop 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- 172.21.15.26:0/2751627040 shutdown_connections 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 --2- 172.21.15.26:0/2751627040 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c1595d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 --2- 172.21.15.26:0/2751627040 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c0c52b0 0x7f5d3c0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- 172.21.15.26:0/2751627040 >> 172.21.15.26:0/2751627040 conn(0x7f5d3c0c8960 msgr2=0x7f5d3c0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- 172.21.15.26:0/2751627040 shutdown_connections 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- 172.21.15.26:0/2751627040 wait complete. 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 Processor -- start 2024-04-21T08:57:41.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- start start 2024-04-21T08:57:41.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c073b50 0x7f5d3c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c0c52b0 0x7f5d3c157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c165870 con 0x7f5d3c0c5690 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3c1656f0 con 0x7f5d3c0c52b0 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d40def640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5d3c1659f0 con 0x7f5d3c073b50 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c158900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36450/0 (socket says 172.21.15.26:36450) 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/3882880306 learned_addr learned my addr 172.21.15.26:0/3882880306 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3a59c640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c073b50 0x7f5d3c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d31d9b640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c0c52b0 0x7f5d3c157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c073b50 msgr2=0x7f5d3c1569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c073b50 0x7f5d3c1569c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c0c52b0 msgr2=0x7f5d3c157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c0c52b0 0x7f5d3c157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 -- 172.21.15.26:0/3882880306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3c14bdc0 con 0x7f5d3c0c5690 2024-04-21T08:57:41.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.418+0000 7f5d3ad9d640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c158900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d3401a540 tx=0x7f5d340196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d337fe640 1 -- 172.21.15.26:0/3882880306 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340bc020 con 0x7f5d3c0c5690 2024-04-21T08:57:41.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d337fe640 1 -- 172.21.15.26:0/3882880306 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d340a5c50 con 0x7f5d3c0c5690 2024-04-21T08:57:41.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3c1f3910 con 0x7f5d3c0c5690 2024-04-21T08:57:41.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d337fe640 1 -- 172.21.15.26:0/3882880306 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d340b8470 con 0x7f5d3c0c5690 2024-04-21T08:57:41.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d3c14c340 con 0x7f5d3c0c5690 2024-04-21T08:57:41.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d3c1f3ae0 con 0x7f5d3c0c5690 2024-04-21T08:57:41.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d337fe640 1 -- 172.21.15.26:0/3882880306 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5d340bf020 con 0x7f5d3c0c5690 2024-04-21T08:57:41.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d337fe640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5d1c068380 0x7f5d1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d337fe640 1 -- 172.21.15.26:0/3882880306 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f5d34121440 con 0x7f5d3c0c5690 2024-04-21T08:57:41.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d3a59c640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5d1c068380 0x7f5d1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.422+0000 7f5d3a59c640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5d1c068380 0x7f5d1c06a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00b9d0 tx=0x7f5d2c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.426+0000 7f5d337fe640 1 -- 172.21.15.26:0/3882880306 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5d34016620 con 0x7f5d3c0c5690 2024-04-21T08:57:41.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.586+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5d3c06fc90 con 0x7f5d3c0c5690 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.586+0000 7f5d337fe640 1 -- 172.21.15.26:0/3882880306 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f5d340f1d60 con 0x7f5d3c0c5690 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stdout: { 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T08:57:41.589 INFO:teuthology.orchestra.run.smithi026.stdout:] 2024-04-21T08:57:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5d1c068380 msgr2=0x7f5d1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5d1c068380 0x7f5d1c06a840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00b9d0 tx=0x7f5d2c008040 comp rx=0 tx=0).stop 2024-04-21T08:57:41.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 msgr2=0x7f5d3c158900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c158900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d3401a540 tx=0x7f5d340196b0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 shutdown_connections 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5d1c068380 0x7f5d1c06a840 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5d3c0c5690 0x7f5d3c158900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5d3c0c52b0 0x7f5d3c157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 --2- 172.21.15.26:0/3882880306 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5d3c073b50 0x7f5d3c1569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 >> 172.21.15.26:0/3882880306 conn(0x7f5d3c0c8960 msgr2=0x7f5d3c14d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 shutdown_connections 2024-04-21T08:57:41.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.590+0000 7f5d40def640 1 -- 172.21.15.26:0/3882880306 wait complete. 2024-04-21T08:57:41.606 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-21T08:57:41.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-21T08:57:41.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8c66d640 1 Processor -- start 2024-04-21T08:57:41.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8c66d640 1 -- start start 2024-04-21T08:57:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8c66d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fae840cb590 0x7fae840b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8c66d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae84071220 con 0x7fae840cb970 2024-04-21T08:57:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8c66d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae8415f280 con 0x7fae84071c00 2024-04-21T08:57:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8c66d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fae840b0ff0 con 0x7fae840cb590 2024-04-21T08:57:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae840cb970 0x7fae840ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39686/0 (socket says 172.21.15.26:39686) 2024-04-21T08:57:41.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 -- 172.21.15.26:0/2416671167 learned_addr learned my addr 172.21.15.26:0/2416671167 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8a409640 1 --2- 172.21.15.26:0/2416671167 >> v2:172.21.15.169:3300/0 conn(0x7fae840cb590 0x7fae840b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409127575 0 0) 0x7fae84071220 con 0x7fae840cb970 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae70003530 con 0x7fae840cb970 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1805389451 0 0) 0x7fae70003530 con 0x7fae840cb970 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 >> v2:172.21.15.169:3300/0 conn(0x7fae840cb590 msgr2=0x7fae840b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 --2- 172.21.15.26:0/2416671167 >> v2:172.21.15.169:3300/0 conn(0x7fae840cb590 0x7fae840b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 >> v1:172.21.15.169:6789/0 conn(0x7fae84071c00 legacy=0x7fae8406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8415f560 con 0x7fae840cb970 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fae80001680 con 0x7fae840cb970 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 >> v1:172.21.15.26:6789/0 conn(0x7fae840cb970 legacy=0x7fae840ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae700039c0 0x7fae70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae70004810 0x7fae70004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae700051d0 0x7fae7000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fae840b0ff0 con 0x7fae70004810 2024-04-21T08:57:41.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae7000c080 con 0x7fae700051d0 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fae7000c280 con 0x7fae700039c0 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae70004810 0x7fae70004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8a409640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae700039c0 0x7fae70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 -- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae700039c0 msgr2=0x7fae70003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae700039c0 0x7fae70003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 -- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae700051d0 msgr2=0x7fae7000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8ac0a640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae700051d0 0x7fae7000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae700051d0 0x7fae7000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae89c08640 1 -- 172.21.15.26:0/2416671167 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae70003530 con 0x7fae70004810 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8ac0a640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae700051d0 0x7fae7000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:41.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.722+0000 7fae8ac0a640 1 -- 172.21.15.26:0/2416671167 reap_dead start 2024-04-21T08:57:41.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae89c08640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae70004810 0x7fae70004c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae8000c240 tx=0x7fae8001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24505ec19fee264 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae80007d20 con 0x7fae70004810 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae800a9070 con 0x7fae70004810 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae89407640 1 -- 172.21.15.26:0/2416671167 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae800a5e40 con 0x7fae70004810 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 -- 172.21.15.26:0/2416671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae70004810 msgr2=0x7fae70004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae70004810 0x7fae70004c90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fae8000c240 tx=0x7fae8001cc80 comp rx=0 tx=0).stop 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 -- 172.21.15.26:0/2416671167 shutdown_connections 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 --2- 172.21.15.26:0/2416671167 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae70004810 0x7fae70004c90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 -- 172.21.15.26:0/2416671167 >> 172.21.15.26:0/2416671167 conn(0x7fae8406b9e0 msgr2=0x7fae8406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 -- 172.21.15.26:0/2416671167 shutdown_connections 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 -- 172.21.15.26:0/2416671167 wait complete. 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 Processor -- start 2024-04-21T08:57:41.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.726+0000 7fae8c66d640 1 -- start start 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae70004810 0x7fae841f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae84160090 0x7fae840c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae840c78f0 0x7fae84154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fae8415fe00 con 0x7fae840c78f0 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae8415fb20 con 0x7fae84160090 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fae8415eed0 con 0x7fae70004810 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae840c78f0 0x7fae84154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae840c78f0 0x7fae84154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36470/0 (socket says 172.21.15.26:36470) 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 -- 172.21.15.26:0/3536610056 learned_addr learned my addr 172.21.15.26:0/3536610056 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8a409640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae70004810 0x7fae841f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae89c08640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae84160090 0x7fae840c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 -- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae70004810 msgr2=0x7fae841f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae70004810 0x7fae841f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 -- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae84160090 msgr2=0x7fae840c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae84160090 0x7fae840c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 -- 172.21.15.26:0/3536610056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840cae50 con 0x7fae840c78f0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8ac0a640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae840c78f0 0x7fae84154350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fae8415caa0 tx=0x7fae7c00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae76ffd640 1 -- 172.21.15.26:0/3536610056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c018070 con 0x7fae840c78f0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae76ffd640 1 -- 172.21.15.26:0/3536610056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c003db0 con 0x7fae840c78f0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae76ffd640 1 -- 172.21.15.26:0/3536610056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0052b0 con 0x7fae840c78f0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae841f8d60 con 0x7fae840c78f0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae840c8190 con 0x7fae840c78f0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae84075ef0 con 0x7fae840c78f0 2024-04-21T08:57:41.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae76ffd640 1 -- 172.21.15.26:0/3536610056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae7c01b070 con 0x7fae840c78f0 2024-04-21T08:57:41.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae76ffd640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae680683b0 0x7fae6806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:41.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae76ffd640 1 -- 172.21.15.26:0/3536610056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fae7c085e10 con 0x7fae840c78f0 2024-04-21T08:57:41.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.730+0000 7fae8a409640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae680683b0 0x7fae6806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:41.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.734+0000 7fae8a409640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae680683b0 0x7fae6806a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae78009ab0 tx=0x7fae78008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.734+0000 7fae76ffd640 1 -- 172.21.15.26:0/3536610056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae7c056690 con 0x7fae840c78f0 2024-04-21T08:57:41.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:41.898+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fae8406bed0 con 0x7fae840c78f0 2024-04-21T08:57:42.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.210+0000 7fae76ffd640 1 -- 172.21.15.26:0/3536610056 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7fae7c055f90 con 0x7fae840c78f0 2024-04-21T08:57:42.214 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2024-04-21T08:57:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae680683b0 msgr2=0x7fae6806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae680683b0 0x7fae6806a870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae78009ab0 tx=0x7fae78008040 comp rx=0 tx=0).stop 2024-04-21T08:57:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae840c78f0 msgr2=0x7fae84154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae840c78f0 0x7fae84154350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fae8415caa0 tx=0x7fae7c00d9d0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 shutdown_connections 2024-04-21T08:57:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae680683b0 0x7fae6806a870 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae840c78f0 0x7fae84154350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae84160090 0x7fae840c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 --2- 172.21.15.26:0/3536610056 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae70004810 0x7fae841f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.214+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 >> 172.21.15.26:0/3536610056 conn(0x7fae8406b9e0 msgr2=0x7fae8415dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.218+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 shutdown_connections 2024-04-21T08:57:42.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.218+0000 7fae8c66d640 1 -- 172.21.15.26:0/3536610056 wait complete. 2024-04-21T08:57:42.243 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-21T08:57:42.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7c3d6640 1 Processor -- start 2024-04-21T08:57:42.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7c3d6640 1 -- start start 2024-04-21T08:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7c3d6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcb74152990 0x7fcb74159270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7c3d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb740c7f00 0x7fcb7406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7c3d6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb740c6b80 con 0x7fcb740c8350 2024-04-21T08:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7c3d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcb740c6e60 con 0x7fcb740c7f00 2024-04-21T08:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7c3d6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcb740c7140 con 0x7fcb74152990 2024-04-21T08:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb79971640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb740c7f00 0x7fcb7406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:42.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb79971640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb740c7f00 0x7fcb7406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36482/0 (socket says 172.21.15.26:36482) 2024-04-21T08:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb79971640 1 -- 172.21.15.26:0/3377594597 learned_addr learned my addr 172.21.15.26:0/3377594597 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb7a172640 1 --2- 172.21.15.26:0/3377594597 >> v2:172.21.15.169:3300/0 conn(0x7fcb74152990 0x7fcb74159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb79971640 1 -- 172.21.15.26:0/3377594597 >> v2:172.21.15.169:3300/0 conn(0x7fcb74152990 msgr2=0x7fcb74159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb79971640 1 --2- 172.21.15.26:0/3377594597 >> v2:172.21.15.169:3300/0 conn(0x7fcb74152990 0x7fcb74159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb79971640 1 -- 172.21.15.26:0/3377594597 >> v1:172.21.15.169:6789/0 conn(0x7fcb740c8350 legacy=0x7fcb7406f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:42.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.374+0000 7fcb79971640 1 -- 172.21.15.26:0/3377594597 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb740c7420 con 0x7fcb740c7f00 2024-04-21T08:57:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb79971640 1 --2- 172.21.15.26:0/3377594597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c7f00 0x7fcb7406ec80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009870 tx=0x7fcb6401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a73bf072036cded server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb79170640 1 -- 172.21.15.26:0/3377594597 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640b5070 con 0x7fcb740c7f00 2024-04-21T08:57:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb79170640 1 -- 172.21.15.26:0/3377594597 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb640a89d0 con 0x7fcb740c7f00 2024-04-21T08:57:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb79170640 1 -- 172.21.15.26:0/3377594597 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640a8da0 con 0x7fcb740c7f00 2024-04-21T08:57:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/3377594597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c7f00 msgr2=0x7fcb7406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:42.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/3377594597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c7f00 0x7fcb7406ec80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009870 tx=0x7fcb6401ecd0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/3377594597 shutdown_connections 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/3377594597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c7f00 0x7fcb7406ec80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/3377594597 >> v2:172.21.15.169:3300/0 conn(0x7fcb74152990 0x7fcb74159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/3377594597 >> 172.21.15.26:0/3377594597 conn(0x7fcb740c8940 msgr2=0x7fcb740c8d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/3377594597 shutdown_connections 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/3377594597 wait complete. 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 Processor -- start 2024-04-21T08:57:42.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 -- start start 2024-04-21T08:57:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.378+0000 7fcb7c3d6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb740c7f00 0x7fcb74157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c8350 0x7fcb7414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:42.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb74152990 0x7fcb7414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7406e6f0 con 0x7fcb740c8350 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb740c79e0 con 0x7fcb740c7f00 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcb74159ce0 con 0x7fcb74152990 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c8350 0x7fcb7414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c8350 0x7fcb7414b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36488/0 (socket says 172.21.15.26:36488) 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 -- 172.21.15.26:0/2889129155 learned_addr learned my addr 172.21.15.26:0/2889129155 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7a172640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb740c7f00 0x7fcb74157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7a973640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb74152990 0x7fcb7414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 -- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb74152990 msgr2=0x7fcb7414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb74152990 0x7fcb7414bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 -- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb740c7f00 msgr2=0x7fcb74157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb740c7f00 0x7fcb74157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:42.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 -- 172.21.15.26:0/2889129155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb741f1e30 con 0x7fcb740c8350 2024-04-21T08:57:42.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb79971640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c8350 0x7fcb7414b850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb6401c900 tx=0x7fcb6401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:42.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb6affd640 1 -- 172.21.15.26:0/2889129155 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640b5070 con 0x7fcb740c8350 2024-04-21T08:57:42.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb6affd640 1 -- 172.21.15.26:0/2889129155 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb640b0b40 con 0x7fcb740c8350 2024-04-21T08:57:42.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7414e4e0 con 0x7fcb740c8350 2024-04-21T08:57:42.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb6affd640 1 -- 172.21.15.26:0/2889129155 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb640bb410 con 0x7fcb740c8350 2024-04-21T08:57:42.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb740ca020 con 0x7fcb740c8350 2024-04-21T08:57:42.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb741f2000 con 0x7fcb740c8350 2024-04-21T08:57:42.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb6affd640 1 -- 172.21.15.26:0/2889129155 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb640c2060 con 0x7fcb740c8350 2024-04-21T08:57:42.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb6affd640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb58068380 0x7fcb5806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:42.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.382+0000 7fcb6affd640 1 -- 172.21.15.26:0/2889129155 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fcb64123d90 con 0x7fcb740c8350 2024-04-21T08:57:42.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.386+0000 7fcb7a172640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb58068380 0x7fcb5806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:42.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.386+0000 7fcb7a172640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb58068380 0x7fcb5806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000a8d0 tx=0x7fcb70008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:42.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.386+0000 7fcb6affd640 1 -- 172.21.15.26:0/2889129155 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcb64018830 con 0x7fcb740c8350 2024-04-21T08:57:42.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:42.550+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fcb74074320 con 0x7fcb740c8350 2024-04-21T08:57:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb6affd640 1 -- 172.21.15.26:0/2889129155 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fcb640f46a0 con 0x7fcb740c8350 2024-04-21T08:57:43.219 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb58068380 msgr2=0x7fcb5806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb58068380 0x7fcb5806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000a8d0 tx=0x7fcb70008040 comp rx=0 tx=0).stop 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c8350 msgr2=0x7fcb7414b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c8350 0x7fcb7414b850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb6401c900 tx=0x7fcb6401ba70 comp rx=0 tx=0).stop 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 shutdown_connections 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb74152990 0x7fcb7414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb58068380 0x7fcb5806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb740c8350 0x7fcb7414b850 secure :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb6401c900 tx=0x7fcb6401ba70 comp rx=0 tx=0).stop 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 --2- 172.21.15.26:0/2889129155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb740c7f00 0x7fcb74157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.218+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 >> 172.21.15.26:0/2889129155 conn(0x7fcb740c8940 msgr2=0x7fcb7415c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:43.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.222+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 shutdown_connections 2024-04-21T08:57:43.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.222+0000 7fcb7c3d6640 1 -- 172.21.15.26:0/2889129155 wait complete. 2024-04-21T08:57:43.255 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-21T08:57:43.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c9806640 1 Processor -- start 2024-04-21T08:57:43.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c9806640 1 -- start start 2024-04-21T08:57:43.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c9806640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 0x7f91c40c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c9806640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f91c41592b0 0x7f91c40c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c9806640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c40c74f0 con 0x7f91c4073a80 2024-04-21T08:57:43.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c9806640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f91c4071d50 con 0x7f91c41592b0 2024-04-21T08:57:43.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c9806640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f91c40c8c30 con 0x7f91c4152a90 2024-04-21T08:57:43.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f91c4073a80 0x7f91c4158ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39700/0 (socket says 172.21.15.26:39700) 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 -- 172.21.15.26:0/1175354999 learned_addr learned my addr 172.21.15.26:0/1175354999 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c37fe640 1 --2- 172.21.15.26:0/1175354999 >> v2:172.21.15.169:3300/0 conn(0x7f91c41592b0 0x7f91c40c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c2ffd640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 0x7f91c40c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891149032 0 0) 0x7f91c40c74f0 con 0x7f91c4073a80 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91ac003530 con 0x7f91c4073a80 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3466276816 0 0) 0x7f91ac003530 con 0x7f91c4073a80 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 msgr2=0x7f91c40c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 0x7f91c40c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 >> v2:172.21.15.169:3300/0 conn(0x7f91c41592b0 msgr2=0x7f91c40c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 --2- 172.21.15.26:0/1175354999 >> v2:172.21.15.169:3300/0 conn(0x7f91c41592b0 0x7f91c40c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c40c8f10 con 0x7f91c4073a80 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f91b8001680 con 0x7f91c4073a80 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 >> v1:172.21.15.26:6789/0 conn(0x7f91c4073a80 legacy=0x7f91c4158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:43.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 0x7f91ac0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91ac004d50 0x7f91ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f91c4071d50 con 0x7f91ac003f40 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91c40c8c30 con 0x7f91ac004d50 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f91ac00ba20 con 0x7f91c4152a90 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c2ffd640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 0x7f91ac0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c37fe640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91ac004d50 0x7f91ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 -- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 msgr2=0x7f91ac0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c4152a90 0x7f91ac0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 -- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91ac004d50 msgr2=0x7f91ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91ac004d50 0x7f91ac0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.374+0000 7f91c27fc640 1 -- 172.21.15.26:0/1175354999 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91ac003530 con 0x7f91ac003f40 2024-04-21T08:57:43.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c27fc640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91ac004810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c240 tx=0x7f91b801cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ba473a284c9e2b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:43.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8007d60 con 0x7f91ac003f40 2024-04-21T08:57:43.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b80a9020 con 0x7f91ac003f40 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c1ffb640 1 -- 172.21.15.26:0/1175354999 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b8005b20 con 0x7f91ac003f40 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 -- 172.21.15.26:0/1175354999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 msgr2=0x7f91ac004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 --2- 172.21.15.26:0/1175354999 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91ac004810 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91b800c240 tx=0x7f91b801cc50 comp rx=0 tx=0).stop 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c37fe640 1 -- 172.21.15.26:0/1175354999 reap_dead start 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 -- 172.21.15.26:0/1175354999 shutdown_connections 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 -- 172.21.15.26:0/1175354999 >> 172.21.15.26:0/1175354999 conn(0x7f91c40702c0 msgr2=0x7f91c40cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 -- 172.21.15.26:0/1175354999 shutdown_connections 2024-04-21T08:57:43.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 -- 172.21.15.26:0/1175354999 wait complete. 2024-04-21T08:57:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 Processor -- start 2024-04-21T08:57:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.378+0000 7f91c9806640 1 -- start start 2024-04-21T08:57:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91c4153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c415c410 0x7f91c4150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c415a250 0x7f91c415a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f91c40c71b0 con 0x7f91ac003f40 2024-04-21T08:57:43.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f91c4152e70 con 0x7f91c415c410 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f91c406cf70 con 0x7f91c415a250 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91c4153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91c4153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36508/0 (socket says 172.21.15.26:36508) 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 -- 172.21.15.26:0/4107041137 learned_addr learned my addr 172.21.15.26:0/4107041137 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c37fe640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c415a250 0x7f91c415a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c27fc640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c415c410 0x7f91c4150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 -- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c415a250 msgr2=0x7f91c415a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c415a250 0x7f91c415a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 -- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c415c410 msgr2=0x7f91c4150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c415c410 0x7f91c4150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 -- 172.21.15.26:0/4107041137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c415c970 con 0x7f91ac003f40 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c2ffd640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91c4153340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f91b4011590 tx=0x7f91b4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91abfff640 1 -- 172.21.15.26:0/4107041137 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b4015930 con 0x7f91ac003f40 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91abfff640 1 -- 172.21.15.26:0/4107041137 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b4015ad0 con 0x7f91ac003f40 2024-04-21T08:57:43.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91abfff640 1 -- 172.21.15.26:0/4107041137 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b401d400 con 0x7f91ac003f40 2024-04-21T08:57:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91c415cc50 con 0x7f91ac003f40 2024-04-21T08:57:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c41552b0 con 0x7f91ac003f40 2024-04-21T08:57:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c4074320 con 0x7f91ac003f40 2024-04-21T08:57:43.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91abfff640 1 -- 172.21.15.26:0/4107041137 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f91b401d5a0 con 0x7f91ac003f40 2024-04-21T08:57:43.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91abfff640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f91b00683b0 0x7f91b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:43.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91abfff640 1 -- 172.21.15.26:0/4107041137 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f91b4087040 con 0x7f91ac003f40 2024-04-21T08:57:43.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.382+0000 7f91c27fc640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f91b00683b0 0x7f91b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:43.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.386+0000 7f91c27fc640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f91b00683b0 0x7f91b006a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91b80aa000 tx=0x7f91b8000ff0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.390+0000 7f91abfff640 1 -- 172.21.15.26:0/4107041137 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f91b4019030 con 0x7f91ac003f40 2024-04-21T08:57:43.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:43.590+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f91c406d280 con 0x7f91ac003f40 2024-04-21T08:57:44.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.282+0000 7f91abfff640 1 -- 172.21.15.26:0/4107041137 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f91b40576f0 con 0x7f91ac003f40 2024-04-21T08:57:44.291 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 2 and data pool 3 2024-04-21T08:57:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f91b00683b0 msgr2=0x7f91b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f91b00683b0 0x7f91b006a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f91b80aa000 tx=0x7f91b8000ff0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 msgr2=0x7f91c4153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91c4153340 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f91b4011590 tx=0x7f91b4011a50 comp rx=0 tx=0).stop 2024-04-21T08:57:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 shutdown_connections 2024-04-21T08:57:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91c415a250 0x7f91c415a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91c415c410 0x7f91c4150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f91b00683b0 0x7f91b006a870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 --2- 172.21.15.26:0/4107041137 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f91ac003f40 0x7f91c4153340 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.298+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 >> 172.21.15.26:0/4107041137 conn(0x7f91c40702c0 msgr2=0x7f91c40cc6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.302+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 shutdown_connections 2024-04-21T08:57:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.302+0000 7f91c9806640 1 -- 172.21.15.26:0/4107041137 wait complete. 2024-04-21T08:57:44.331 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302c71d640 1 Processor -- start 2024-04-21T08:57:44.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302c71d640 1 -- start start 2024-04-21T08:57:44.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302c71d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3024152b70 0x7f30240c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302c71d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024158ae0 0x7f3024158f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302c71d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30241594b0 con 0x7f30240c4e70 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302c71d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f30240c9ea0 con 0x7f3024152b70 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302c71d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f30240c52e0 con 0x7f3024158ae0 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302a4b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3024152b70 0x7f30240c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302a4b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3024152b70 0x7f30240c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36520/0 (socket says 172.21.15.26:36520) 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302a4b9640 1 -- 172.21.15.26:0/3021426411 learned_addr learned my addr 172.21.15.26:0/3021426411 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302a4b9640 1 -- 172.21.15.26:0/3021426411 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024158ae0 msgr2=0x7f3024158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302a4b9640 1 --2- 172.21.15.26:0/3021426411 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024158ae0 0x7f3024158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302a4b9640 1 -- 172.21.15.26:0/3021426411 >> v1:172.21.15.169:6789/0 conn(0x7f30240c4e70 legacy=0x7f302406fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:44.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.450+0000 7f302a4b9640 1 -- 172.21.15.26:0/3021426411 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30240c31e0 con 0x7f3024152b70 2024-04-21T08:57:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302a4b9640 1 --2- 172.21.15.26:0/3021426411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024152b70 0x7f30240c8b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e50 tx=0x7f301401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d96288f8429da0a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f30294b7640 1 -- 172.21.15.26:0/3021426411 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140b4070 con 0x7f3024152b70 2024-04-21T08:57:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f30294b7640 1 -- 172.21.15.26:0/3021426411 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30140af400 con 0x7f3024152b70 2024-04-21T08:57:44.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f30294b7640 1 -- 172.21.15.26:0/3021426411 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30140af7d0 con 0x7f3024152b70 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- 172.21.15.26:0/3021426411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024152b70 msgr2=0x7f30240c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 --2- 172.21.15.26:0/3021426411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024152b70 0x7f30240c8b40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3014009e50 tx=0x7f301401f1e0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- 172.21.15.26:0/3021426411 shutdown_connections 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 --2- 172.21.15.26:0/3021426411 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024158ae0 0x7f3024158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 --2- 172.21.15.26:0/3021426411 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024152b70 0x7f30240c8b40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- 172.21.15.26:0/3021426411 >> 172.21.15.26:0/3021426411 conn(0x7f3024067760 msgr2=0x7f3024067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- 172.21.15.26:0/3021426411 shutdown_connections 2024-04-21T08:57:44.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- 172.21.15.26:0/3021426411 wait complete. 2024-04-21T08:57:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 Processor -- start 2024-04-21T08:57:44.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- start start 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30240c4e70 0x7f302406cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024152b70 0x7f30240c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024158ae0 0x7f302414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f30240c9850 con 0x7f3024158ae0 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30240c37a0 con 0x7f30240c4e70 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302c71d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f30240c9b30 con 0x7f3024152b70 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024158ae0 0x7f302414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024158ae0 0x7f302414d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36522/0 (socket says 172.21.15.26:36522) 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 -- 172.21.15.26:0/989086614 learned_addr learned my addr 172.21.15.26:0/989086614 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:44.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302a4b9640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30240c4e70 0x7f302406cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f3029cb8640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024152b70 0x7f30240c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 -- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024152b70 msgr2=0x7f30240c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024152b70 0x7f30240c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 -- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30240c4e70 msgr2=0x7f302406cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30240c4e70 0x7f302406cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302acba640 1 -- 172.21.15.26:0/989086614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f302406d340 con 0x7f3024158ae0 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f302a4b9640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30240c4e70 0x7f302406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.454+0000 7f3029cb8640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024152b70 0x7f30240c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f302acba640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024158ae0 0x7f302414d3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f301c00b390 tx=0x7f301c00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f3022ffd640 1 -- 172.21.15.26:0/989086614 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c015020 con 0x7f3024158ae0 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f3022ffd640 1 -- 172.21.15.26:0/989086614 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f301c011830 con 0x7f3024158ae0 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f302415bd40 con 0x7f3024158ae0 2024-04-21T08:57:44.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f3022ffd640 1 -- 172.21.15.26:0/989086614 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f301c011c20 con 0x7f3024158ae0 2024-04-21T08:57:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f302415c300 con 0x7f3024158ae0 2024-04-21T08:57:44.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3024075ef0 con 0x7f3024158ae0 2024-04-21T08:57:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f3022ffd640 1 -- 172.21.15.26:0/989086614 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f301c018020 con 0x7f3024158ae0 2024-04-21T08:57:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f3022ffd640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3010068380 0x7f301006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f3022ffd640 1 -- 172.21.15.26:0/989086614 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f301c0868a0 con 0x7f3024158ae0 2024-04-21T08:57:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f302a4b9640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3010068380 0x7f301006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.458+0000 7f302a4b9640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3010068380 0x7f301006a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f30140b1000 tx=0x7f30140aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:44.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.462+0000 7f3022ffd640 1 -- 172.21.15.26:0/989086614 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f301c01f020 con 0x7f3024158ae0 2024-04-21T08:57:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.630+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f302415ce00 con 0x7f3024158ae0 2024-04-21T08:57:44.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.630+0000 7f3022ffd640 1 -- 172.21.15.26:0/989086614 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16610 (secure 0 0 0) 0x7f301c0172c0 con 0x7f3024158ae0 2024-04-21T08:57:44.633 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:44.633 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:43.594642+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.630+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3010068380 msgr2=0x7f301006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.630+0000 7f302c71d640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3010068380 0x7f301006a840 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f30140b1000 tx=0x7f30140aa000 comp rx=0 tx=0).stop 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.630+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024158ae0 msgr2=0x7f302414d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.630+0000 7f302c71d640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024158ae0 0x7f302414d3d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f301c00b390 tx=0x7f301c00b850 comp rx=0 tx=0).stop 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 shutdown_connections 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3010068380 0x7f301006a840 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3024158ae0 0x7f302414d3d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3024152b70 0x7f30240c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 --2- 172.21.15.26:0/989086614 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30240c4e70 0x7f302406cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 >> 172.21.15.26:0/989086614 conn(0x7f3024067760 msgr2=0x7f30240cc7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 shutdown_connections 2024-04-21T08:57:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.634+0000 7f302c71d640 1 -- 172.21.15.26:0/989086614 wait complete. 2024-04-21T08:57:44.652 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:44.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb414f35640 1 Processor -- start 2024-04-21T08:57:44.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb414f35640 1 -- start start 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb414f35640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 0x7fb41015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb414f35640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb4100cb120 0x7fb4100d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb414f35640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41015b3a0 con 0x7fb4100c7680 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb414f35640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb41015e130 con 0x7fb4100cb120 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb414f35640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb41015f0c0 con 0x7fb410154eb0 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb4100c7680 0x7fb41015ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39702/0 (socket says 172.21.15.26:39702) 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 -- 172.21.15.26:0/153043444 learned_addr learned my addr 172.21.15.26:0/153043444 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:44.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40e59c640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 0x7fb41015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40ed9d640 1 --2- 172.21.15.26:0/153043444 >> v2:172.21.15.169:3300/0 conn(0x7fb4100cb120 0x7fb4100d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2227787202 0 0) 0x7fb41015b3a0 con 0x7fb4100c7680 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3f8003530 con 0x7fb4100c7680 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1328775978 0 0) 0x7fb3f8003530 con 0x7fb4100c7680 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 msgr2=0x7fb41015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 0x7fb41015eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 >> v2:172.21.15.169:3300/0 conn(0x7fb4100cb120 msgr2=0x7fb4100d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 --2- 172.21.15.26:0/153043444 >> v2:172.21.15.169:3300/0 conn(0x7fb4100cb120 0x7fb4100d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41015b680 con 0x7fb4100c7680 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fb404001680 con 0x7fb4100c7680 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 >> v1:172.21.15.26:6789/0 conn(0x7fb4100c7680 legacy=0x7fb41015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 0x7fb3f80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb3f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3f8004d50 0x7fb3f80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb41015e130 con 0x7fb3f8003f40 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb41015f0c0 con 0x7fb3f8004d50 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb3f800b9d0 con 0x7fb410154eb0 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb3f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40e59c640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 0x7fb3f80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40ed9d640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3f8004d50 0x7fb3f80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 -- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 msgr2=0x7fb3f80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 0x7fb3f80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 -- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3f8004d50 msgr2=0x7fb3f80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3f8004d50 0x7fb3f80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40dd9b640 1 -- 172.21.15.26:0/153043444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3f8003530 con 0x7fb3f8003f40 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40ed9d640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb3f8004d50 0x7fb3f80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:44.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.770+0000 7fb40e59c640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb410154eb0 0x7fb3f80039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:44.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb3f8004810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb404001060 tx=0x7fb40401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eac052a645fa57e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:44.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404007d80 con 0x7fb3f8003f40 2024-04-21T08:57:44.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb404005b00 con 0x7fb3f8003f40 2024-04-21T08:57:44.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb40d59a640 1 -- 172.21.15.26:0/153043444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb404007070 con 0x7fb3f8003f40 2024-04-21T08:57:44.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 -- 172.21.15.26:0/153043444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 msgr2=0x7fb3f8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 --2- 172.21.15.26:0/153043444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb3f8004810 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb404001060 tx=0x7fb40401f3b0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb40ed9d640 1 -- 172.21.15.26:0/153043444 reap_dead start 2024-04-21T08:57:44.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 -- 172.21.15.26:0/153043444 shutdown_connections 2024-04-21T08:57:44.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 -- 172.21.15.26:0/153043444 >> 172.21.15.26:0/153043444 conn(0x7fb41006dea0 msgr2=0x7fb41006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:44.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 -- 172.21.15.26:0/153043444 shutdown_connections 2024-04-21T08:57:44.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 -- 172.21.15.26:0/153043444 wait complete. 2024-04-21T08:57:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 Processor -- start 2024-04-21T08:57:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.774+0000 7fb414f35640 1 -- start start 2024-04-21T08:57:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb41015a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb41015ab90 0x7fb4101e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4101579b0 0x7fb4101e44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb41015e660 con 0x7fb3f8003f40 2024-04-21T08:57:44.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb41015e380 con 0x7fb41015ab90 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb410155290 con 0x7fb4101579b0 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb41015a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb41015a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36550/0 (socket says 172.21.15.26:36550) 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 -- 172.21.15.26:0/2127272256 learned_addr learned my addr 172.21.15.26:0/2127272256 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40ed9d640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4101579b0 0x7fb4101e44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb41015ab90 0x7fb4101e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 -- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4101579b0 msgr2=0x7fb4101e44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4101579b0 0x7fb4101e44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 -- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb41015ab90 msgr2=0x7fb4101e3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb41015ab90 0x7fb4101e3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 -- 172.21.15.26:0/2127272256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb410151960 con 0x7fb3f8003f40 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb41015ab90 0x7fb4101e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40e59c640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb41015a240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb40000f350 tx=0x7fb40000f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb3feffd640 1 -- 172.21.15.26:0/2127272256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000039a0 con 0x7fb3f8003f40 2024-04-21T08:57:44.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb3feffd640 1 -- 172.21.15.26:0/2127272256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb400003b40 con 0x7fb3f8003f40 2024-04-21T08:57:44.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4101f0680 con 0x7fb3f8003f40 2024-04-21T08:57:44.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb3feffd640 1 -- 172.21.15.26:0/2127272256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400004020 con 0x7fb3f8003f40 2024-04-21T08:57:44.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4101f0c00 con 0x7fb3f8003f40 2024-04-21T08:57:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb410075ef0 con 0x7fb3f8003f40 2024-04-21T08:57:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb3feffd640 1 -- 172.21.15.26:0/2127272256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb4000041c0 con 0x7fb3f8003f40 2024-04-21T08:57:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb3feffd640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb3f00683b0 0x7fb3f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb3feffd640 1 -- 172.21.15.26:0/2127272256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb4000871c0 con 0x7fb3f8003f40 2024-04-21T08:57:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.778+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb3f00683b0 0x7fb3f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:44.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.782+0000 7fb40dd9b640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb3f00683b0 0x7fb3f006a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4040ae000 tx=0x7fb404001a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:44.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.782+0000 7fb3feffd640 1 -- 172.21.15.26:0/2127272256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb400012070 con 0x7fb3f8003f40 2024-04-21T08:57:44.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.946+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4100b5e40 con 0x7fb3f8003f40 2024-04-21T08:57:44.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb3feffd640 1 -- 172.21.15.26:0/2127272256 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16610 (secure 0 0 0) 0x7fb4000576f0 con 0x7fb3f8003f40 2024-04-21T08:57:44.952 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:44.952 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":20,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:43.594642+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb3f00683b0 msgr2=0x7fb3f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb3f00683b0 0x7fb3f006a870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb4040ae000 tx=0x7fb404001a50 comp rx=0 tx=0).stop 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 msgr2=0x7fb41015a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb41015a240 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fb40000f350 tx=0x7fb40000f810 comp rx=0 tx=0).stop 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 shutdown_connections 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb4101579b0 0x7fb4101e44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb41015ab90 0x7fb4101e3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb3f00683b0 0x7fb3f006a870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 --2- 172.21.15.26:0/2127272256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3f8003f40 0x7fb41015a240 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.950+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 >> 172.21.15.26:0/2127272256 conn(0x7fb41006dea0 msgr2=0x7fb4101511e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.954+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 shutdown_connections 2024-04-21T08:57:44.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:44.954+0000 7fb414f35640 1 -- 172.21.15.26:0/2127272256 wait complete. 2024-04-21T08:57:44.972 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-21T08:57:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec8571640 1 Processor -- start 2024-04-21T08:57:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec8571640 1 -- start start 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec8571640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ec006caf0 0x7f6ec0157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec8571640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec00ce790 0x7f6ec01584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec8571640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec00c9480 con 0x7f6ec00ce3b0 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec8571640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec006cfc0 con 0x7f6ec006caf0 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec8571640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec00c9720 con 0x7f6ec00ce790 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec5b0c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ec006caf0 0x7f6ec0157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec630d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6ec00ce3b0 0x7f6ec006fc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39708/0 (socket says 172.21.15.26:39708) 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec630d640 1 -- 172.21.15.26:0/3262498198 learned_addr learned my addr 172.21.15.26:0/3262498198 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:45.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec6b0e640 1 --2- 172.21.15.26:0/3262498198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec00ce790 0x7f6ec01584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec5b0c640 1 -- 172.21.15.26:0/3262498198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec00ce790 msgr2=0x7f6ec01584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec5b0c640 1 --2- 172.21.15.26:0/3262498198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec00ce790 0x7f6ec01584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec5b0c640 1 -- 172.21.15.26:0/3262498198 >> v1:172.21.15.26:6789/0 conn(0x7f6ec00ce3b0 legacy=0x7f6ec006fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec5b0c640 1 -- 172.21.15.26:0/3262498198 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec00c9a00 con 0x7f6ec006caf0 2024-04-21T08:57:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec530b640 1 -- 172.21.15.26:0/3262498198 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168773497 0 0) 0x7f6ec00c9480 con 0x7f6ec00ce3b0 2024-04-21T08:57:45.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.094+0000 7f6ec6b0e640 1 --2- 172.21.15.26:0/3262498198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec00ce790 0x7f6ec01584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:45.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec5b0c640 1 --2- 172.21.15.26:0/3262498198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec006caf0 0x7f6ec0157fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00097c0 tx=0x7f6eb001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d9d358f21ef200 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec530b640 1 -- 172.21.15.26:0/3262498198 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00ab610 con 0x7f6ec006caf0 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec530b640 1 -- 172.21.15.26:0/3262498198 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb00b0070 con 0x7f6ec006caf0 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec530b640 1 -- 172.21.15.26:0/3262498198 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00ab9d0 con 0x7f6ec006caf0 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- 172.21.15.26:0/3262498198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec006caf0 msgr2=0x7f6ec0157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3262498198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec006caf0 0x7f6ec0157fa0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6eb00097c0 tx=0x7f6eb001c470 comp rx=0 tx=0).stop 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- 172.21.15.26:0/3262498198 shutdown_connections 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3262498198 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec00ce790 0x7f6ec01584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3262498198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec006caf0 0x7f6ec0157fa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- 172.21.15.26:0/3262498198 >> 172.21.15.26:0/3262498198 conn(0x7f6ec0067760 msgr2=0x7f6ec0067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- 172.21.15.26:0/3262498198 shutdown_connections 2024-04-21T08:57:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- 172.21.15.26:0/3262498198 wait complete. 2024-04-21T08:57:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 Processor -- start 2024-04-21T08:57:45.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- start start 2024-04-21T08:57:45.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec006caf0 0x7f6ec015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec00ce3b0 0x7f6ec00b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec00ce790 0x7f6ec00b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec0167a70 con 0x7f6ec00ce790 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec01678f0 con 0x7f6ec00ce3b0 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec8571640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec0167bf0 con 0x7f6ec006caf0 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec00ce790 0x7f6ec00b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec00ce790 0x7f6ec00b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36566/0 (socket says 172.21.15.26:36566) 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 -- 172.21.15.26:0/3327084959 learned_addr learned my addr 172.21.15.26:0/3327084959 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec630d640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec006caf0 0x7f6ec015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 -- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec006caf0 msgr2=0x7f6ec015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec006caf0 0x7f6ec015a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 -- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec00ce3b0 msgr2=0x7f6ec00b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec00ce3b0 0x7f6ec00b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:45.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.098+0000 7f6ec6b0e640 1 -- 172.21.15.26:0/3327084959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec00cdec0 con 0x7f6ec00ce790 2024-04-21T08:57:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6ec6b0e640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec00ce790 0x7f6ec00b1410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800cd50 tx=0x7f6eb800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6eb6ffd640 1 -- 172.21.15.26:0/3327084959 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800f680 con 0x7f6ec00ce790 2024-04-21T08:57:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6eb6ffd640 1 -- 172.21.15.26:0/3327084959 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb800f840 con 0x7f6ec00ce790 2024-04-21T08:57:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec00b2cf0 con 0x7f6ec00ce790 2024-04-21T08:57:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6eb6ffd640 1 -- 172.21.15.26:0/3327084959 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb800fc30 con 0x7f6ec00ce790 2024-04-21T08:57:45.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec00b0620 con 0x7f6ec00ce790 2024-04-21T08:57:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec0074320 con 0x7f6ec00ce790 2024-04-21T08:57:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6eb6ffd640 1 -- 172.21.15.26:0/3327084959 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6eb800e3e0 con 0x7f6ec00ce790 2024-04-21T08:57:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6eb6ffd640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6ea4068380 0x7f6ea406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6eb6ffd640 1 -- 172.21.15.26:0/3327084959 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6eb8087920 con 0x7f6ec00ce790 2024-04-21T08:57:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6ec630d640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6ea4068380 0x7f6ea406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:45.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.102+0000 7f6ec630d640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6ea4068380 0x7f6ea406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc000f70 tx=0x7f6ebc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:45.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.106+0000 7f6eb6ffd640 1 -- 172.21.15.26:0/3327084959 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6eb8014030 con 0x7f6ec00ce790 2024-04-21T08:57:45.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:45.306+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6ec00c83c0 con 0x7f6ec00ce790 2024-04-21T08:57:46.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.290+0000 7f6eb6ffd640 1 -- 172.21.15.26:0/3327084959 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f6eb8057d30 con 0x7f6ec00ce790 2024-04-21T08:57:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6ea4068380 msgr2=0x7f6ea406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:46.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6ea4068380 0x7f6ea406a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc000f70 tx=0x7f6ebc009040 comp rx=0 tx=0).stop 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec00ce790 msgr2=0x7f6ec00b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec00ce790 0x7f6ec00b1410 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6eb800cd50 tx=0x7f6eb800a650 comp rx=0 tx=0).stop 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 shutdown_connections 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6ea4068380 0x7f6ea406a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ec00ce790 0x7f6ec00b1410 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6ec00ce3b0 0x7f6ec00b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 --2- 172.21.15.26:0/3327084959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6ec006caf0 0x7f6ec015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 >> 172.21.15.26:0/3327084959 conn(0x7f6ec0067760 msgr2=0x7f6ec00ca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 shutdown_connections 2024-04-21T08:57:46.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.294+0000 7f6ec8571640 1 -- 172.21.15.26:0/3327084959 wait complete. 2024-04-21T08:57:46.318 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-21T08:57:46.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-21T08:57:46.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb452c640 1 Processor -- start 2024-04-21T08:57:46.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb452c640 1 -- start start 2024-04-21T08:57:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb452c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffbac151bc0 0x7ffbac072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb452c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ffbac151fa0 0x7ffbac0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb452c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac0bfbb0 con 0x7ffbac0c5e30 2024-04-21T08:57:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb452c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ffbac06d1b0 con 0x7ffbac151bc0 2024-04-21T08:57:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb452c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ffbac06ced0 con 0x7ffbac151fa0 2024-04-21T08:57:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffbac151bc0 0x7ffbac072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:46.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffbac151bc0 0x7ffbac072d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36572/0 (socket says 172.21.15.26:36572) 2024-04-21T08:57:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 -- 172.21.15.26:0/3366870341 learned_addr learned my addr 172.21.15.26:0/3366870341 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb1ac7640 1 --2- 172.21.15.26:0/3366870341 >> v2:172.21.15.169:3300/0 conn(0x7ffbac151fa0 0x7ffbac0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 -- 172.21.15.26:0/3366870341 >> v2:172.21.15.169:3300/0 conn(0x7ffbac151fa0 msgr2=0x7ffbac0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 --2- 172.21.15.26:0/3366870341 >> v2:172.21.15.169:3300/0 conn(0x7ffbac151fa0 0x7ffbac0732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 -- 172.21.15.26:0/3366870341 >> v1:172.21.15.169:6789/0 conn(0x7ffbac0c5e30 legacy=0x7ffbac157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 -- 172.21.15.26:0/3366870341 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac071fd0 con 0x7ffbac151bc0 2024-04-21T08:57:46.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb1ac7640 1 --2- 172.21.15.26:0/3366870341 >> v2:172.21.15.169:3300/0 conn(0x7ffbac151fa0 0x7ffbac0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:46.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.450+0000 7ffbb22c8640 1 --2- 172.21.15.26:0/3366870341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac072d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbac070580 tx=0x7ffba801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba9be1a1b5c5771 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:46.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb12c6640 1 -- 172.21.15.26:0/3366870341 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80aa620 con 0x7ffbac151bc0 2024-04-21T08:57:46.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb12c6640 1 -- 172.21.15.26:0/3366870341 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba80af070 con 0x7ffbac151bc0 2024-04-21T08:57:46.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb12c6640 1 -- 172.21.15.26:0/3366870341 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba80aa9e0 con 0x7ffbac151bc0 2024-04-21T08:57:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- 172.21.15.26:0/3366870341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 msgr2=0x7ffbac072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3366870341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac072d90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffbac070580 tx=0x7ffba801c4c0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- 172.21.15.26:0/3366870341 shutdown_connections 2024-04-21T08:57:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3366870341 >> v2:172.21.15.169:3300/0 conn(0x7ffbac151fa0 0x7ffbac0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3366870341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac072d90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- 172.21.15.26:0/3366870341 >> 172.21.15.26:0/3366870341 conn(0x7ffbac0cbef0 msgr2=0x7ffbac0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- 172.21.15.26:0/3366870341 shutdown_connections 2024-04-21T08:57:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- 172.21.15.26:0/3366870341 wait complete. 2024-04-21T08:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 Processor -- start 2024-04-21T08:57:46.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- start start 2024-04-21T08:57:46.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbac0c5e30 0x7ffbac0c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbac151fa0 0x7ffbac1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac06cc80 con 0x7ffbac151bc0 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac06cb00 con 0x7ffbac0c5e30 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb452c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ffbac164320 con 0x7ffbac151fa0 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb1ac7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb1ac7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36580/0 (socket says 172.21.15.26:36580) 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb1ac7640 1 -- 172.21.15.26:0/3673316391 learned_addr learned my addr 172.21.15.26:0/3673316391 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb22c8640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbac0c5e30 0x7ffbac0c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.454+0000 7ffbb2ac9640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbac151fa0 0x7ffbac1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb1ac7640 1 -- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbac151fa0 msgr2=0x7ffbac1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb1ac7640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbac151fa0 0x7ffbac1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb1ac7640 1 -- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbac0c5e30 msgr2=0x7ffbac0c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb1ac7640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbac0c5e30 0x7ffbac0c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb1ac7640 1 -- 172.21.15.26:0/3673316391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac0bf4d0 con 0x7ffbac151bc0 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb1ac7640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac154460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00c7f0 tx=0x7ffb9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffba2ffd640 1 -- 172.21.15.26:0/3673316391 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c015070 con 0x7ffbac151bc0 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffba2ffd640 1 -- 172.21.15.26:0/3673316391 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb9c007820 con 0x7ffbac151bc0 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac1539d0 con 0x7ffbac151bc0 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffba2ffd640 1 -- 172.21.15.26:0/3673316391 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c007c10 con 0x7ffbac151bc0 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac1528b0 con 0x7ffbac151bc0 2024-04-21T08:57:46.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbac074320 con 0x7ffbac151bc0 2024-04-21T08:57:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffba2ffd640 1 -- 172.21.15.26:0/3673316391 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb9c018070 con 0x7ffbac151bc0 2024-04-21T08:57:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffba2ffd640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ffb90068380 0x7ffb9006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffba2ffd640 1 -- 172.21.15.26:0/3673316391 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffb9c086a40 con 0x7ffbac151bc0 2024-04-21T08:57:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.458+0000 7ffbb22c8640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ffb90068380 0x7ffb9006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.462+0000 7ffbb22c8640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ffb90068380 0x7ffb9006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffba80ae000 tx=0x7ffba80a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:46.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.462+0000 7ffba2ffd640 1 -- 172.21.15.26:0/3673316391 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffb9c057070 con 0x7ffbac151bc0 2024-04-21T08:57:46.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:46.662+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ffbac0c6380 con 0x7ffbac151bc0 2024-04-21T08:57:47.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.298+0000 7ffba2ffd640 1 -- 172.21.15.26:0/3673316391 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7ffb9c056970 con 0x7ffbac151bc0 2024-04-21T08:57:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ffb90068380 msgr2=0x7ffb9006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:47.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ffb90068380 0x7ffb9006a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffba80ae000 tx=0x7ffba80a7000 comp rx=0 tx=0).stop 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 msgr2=0x7ffbac154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac154460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c00c7f0 tx=0x7ffb9c00ccb0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 shutdown_connections 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffbac151fa0 0x7ffbac1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ffb90068380 0x7ffb9006a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffbac151bc0 0x7ffbac154460 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 --2- 172.21.15.26:0/3673316391 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffbac0c5e30 0x7ffbac0c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 >> 172.21.15.26:0/3673316391 conn(0x7ffbac0cbef0 msgr2=0x7ffbac0af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 shutdown_connections 2024-04-21T08:57:47.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.302+0000 7ffbb452c640 1 -- 172.21.15.26:0/3673316391 wait complete. 2024-04-21T08:57:47.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-21T08:57:47.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1f4da640 1 Processor -- start 2024-04-21T08:57:47.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1f4da640 1 -- start start 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1f4da640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9f18154cc0 0x7f9f180ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1f4da640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9f181550a0 0x7f9f180d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1f4da640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1815ef30 con 0x7f9f180ccfe0 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1f4da640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9f180b3fd0 con 0x7f9f18154cc0 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1f4da640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9f180b42b0 con 0x7f9f181550a0 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1d276640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9f18154cc0 0x7f9f180ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1d276640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9f18154cc0 0x7f9f180ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36594/0 (socket says 172.21.15.26:36594) 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1d276640 1 -- 172.21.15.26:0/1650829044 learned_addr learned my addr 172.21.15.26:0/1650829044 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:47.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1ca75640 1 --2- 172.21.15.26:0/1650829044 >> v2:172.21.15.169:3300/0 conn(0x7f9f181550a0 0x7f9f180d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:47.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1d276640 1 -- 172.21.15.26:0/1650829044 >> v2:172.21.15.169:3300/0 conn(0x7f9f181550a0 msgr2=0x7f9f180d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:47.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1d276640 1 --2- 172.21.15.26:0/1650829044 >> v2:172.21.15.169:3300/0 conn(0x7f9f181550a0 0x7f9f180d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1d276640 1 -- 172.21.15.26:0/1650829044 >> v1:172.21.15.169:6789/0 conn(0x7f9f180ccfe0 legacy=0x7f9f1815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:47.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.454+0000 7f9f1d276640 1 -- 172.21.15.26:0/1650829044 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f180b4590 con 0x7f9f18154cc0 2024-04-21T08:57:47.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1d276640 1 --2- 172.21.15.26:0/1650829044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f18154cc0 0x7f9f180ccaa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f180cde20 tx=0x7f9f1401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c261f6cb519e8f8e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:47.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f0ffff640 1 -- 172.21.15.26:0/1650829044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140b5070 con 0x7f9f18154cc0 2024-04-21T08:57:47.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f0ffff640 1 -- 172.21.15.26:0/1650829044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f140a89d0 con 0x7f9f18154cc0 2024-04-21T08:57:47.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f0ffff640 1 -- 172.21.15.26:0/1650829044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f140a8da0 con 0x7f9f18154cc0 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 -- 172.21.15.26:0/1650829044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f18154cc0 msgr2=0x7f9f180ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/1650829044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f18154cc0 0x7f9f180ccaa0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9f180cde20 tx=0x7f9f1401ecd0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 -- 172.21.15.26:0/1650829044 shutdown_connections 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/1650829044 >> v2:172.21.15.169:3300/0 conn(0x7f9f181550a0 0x7f9f180d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/1650829044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f18154cc0 0x7f9f180ccaa0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 -- 172.21.15.26:0/1650829044 >> 172.21.15.26:0/1650829044 conn(0x7f9f1806de80 msgr2=0x7f9f1806e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 -- 172.21.15.26:0/1650829044 shutdown_connections 2024-04-21T08:57:47.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 -- 172.21.15.26:0/1650829044 wait complete. 2024-04-21T08:57:47.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.458+0000 7f9f1f4da640 1 Processor -- start 2024-04-21T08:57:47.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 -- start start 2024-04-21T08:57:47.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f180ccfe0 0x7f9f181f12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:47.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f18154cc0 0x7f9f18150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:47.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f181550a0 0x7f9f181595b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:47.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9f1815ae60 con 0x7f9f181550a0 2024-04-21T08:57:47.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9f180b5070 con 0x7f9f180ccfe0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9f180d0890 con 0x7f9f18154cc0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f181550a0 0x7f9f181595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f181550a0 0x7f9f181595b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36602/0 (socket says 172.21.15.26:36602) 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 -- 172.21.15.26:0/315479854 learned_addr learned my addr 172.21.15.26:0/315479854 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1ca75640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f18154cc0 0x7f9f18150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 -- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f18154cc0 msgr2=0x7f9f18150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f18154cc0 0x7f9f18150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1d276640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f180ccfe0 0x7f9f181f12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 -- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f180ccfe0 msgr2=0x7f9f181f12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f180ccfe0 0x7f9f181f12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 -- 172.21.15.26:0/315479854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f180c6d80 con 0x7f9f181550a0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1da77640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f181550a0 0x7f9f181595b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000c7b0 tx=0x7f9f1000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f0dffb640 1 -- 172.21.15.26:0/315479854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f10004b70 con 0x7f9f181550a0 2024-04-21T08:57:47.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f0dffb640 1 -- 172.21.15.26:0/315479854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f10004d10 con 0x7f9f181550a0 2024-04-21T08:57:47.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f180c67c0 con 0x7f9f181550a0 2024-04-21T08:57:47.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f0dffb640 1 -- 172.21.15.26:0/315479854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1000aa90 con 0x7f9f181550a0 2024-04-21T08:57:47.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f18158ad0 con 0x7f9f181550a0 2024-04-21T08:57:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f18074320 con 0x7f9f181550a0 2024-04-21T08:57:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f0dffb640 1 -- 172.21.15.26:0/315479854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9f1000ac30 con 0x7f9f181550a0 2024-04-21T08:57:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f0dffb640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9efc068380 0x7f9efc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.462+0000 7f9f0dffb640 1 -- 172.21.15.26:0/315479854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9f10086fc0 con 0x7f9f181550a0 2024-04-21T08:57:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.466+0000 7f9f1d276640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9efc068380 0x7f9efc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:47.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.466+0000 7f9f1d276640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9efc068380 0x7f9efc06a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f140b2000 tx=0x7f9f140aa070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:47.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.470+0000 7f9f0dffb640 1 -- 172.21.15.26:0/315479854 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9f100574f0 con 0x7f9f181550a0 2024-04-21T08:57:47.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:47.670+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9f180ca780 con 0x7f9f181550a0 2024-04-21T08:57:48.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.302+0000 7f9f0dffb640 1 -- 172.21.15.26:0/315479854 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v7) ==== 115+0+0 (secure 0 0 0) 0x7f9f10056df0 con 0x7f9f181550a0 2024-04-21T08:57:48.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9efc068380 msgr2=0x7f9efc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9efc068380 0x7f9efc06a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9f140b2000 tx=0x7f9f140aa070 comp rx=0 tx=0).stop 2024-04-21T08:57:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f181550a0 msgr2=0x7f9f181595b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f181550a0 0x7f9f181595b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9f1000c7b0 tx=0x7f9f1000cc70 comp rx=0 tx=0).stop 2024-04-21T08:57:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 shutdown_connections 2024-04-21T08:57:48.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9efc068380 0x7f9efc06a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9f181550a0 0x7f9f181595b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9f18154cc0 0x7f9f18150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 --2- 172.21.15.26:0/315479854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9f180ccfe0 0x7f9f181f12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 >> 172.21.15.26:0/315479854 conn(0x7f9f1806de80 msgr2=0x7f9f180cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 shutdown_connections 2024-04-21T08:57:48.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.306+0000 7f9f1f4da640 1 -- 172.21.15.26:0/315479854 wait complete. 2024-04-21T08:57:48.327 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-21T08:57:48.327 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:57:48.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb344d640 1 Processor -- start 2024-04-21T08:57:48.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb344d640 1 -- start start 2024-04-21T08:57:48.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb344d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfac0c52b0 0x7fdfac0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb344d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdfac0c5690 0x7fdfac1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb344d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfac0c6050 con 0x7fdfac073b50 2024-04-21T08:57:48.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb344d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdfac0c5e00 con 0x7fdfac0c5690 2024-04-21T08:57:48.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb344d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdfac0c6330 con 0x7fdfac0c52b0 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb09e8640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fdfac073b50 0x7fdfac1529d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42280/0 (socket says 172.21.15.26:42280) 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb09e8640 1 -- 172.21.15.26:0/845254959 learned_addr learned my addr 172.21.15.26:0/845254959 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722600107 0 0) 0x7fdfac0c6050 con 0x7fdfac073b50 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfac0c52b0 0x7fdfac0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb19ea640 1 --2- 172.21.15.26:0/845254959 >> v2:172.21.15.169:3300/0 conn(0x7fdfac0c5690 0x7fdfac1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf98003530 con 0x7fdfac073b50 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4051960857 0 0) 0x7fdf98003530 con 0x7fdfac073b50 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfac0c52b0 msgr2=0x7fdfac0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfac0c52b0 0x7fdfac0c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 >> v2:172.21.15.169:3300/0 conn(0x7fdfac0c5690 msgr2=0x7fdfac1595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 --2- 172.21.15.26:0/845254959 >> v2:172.21.15.169:3300/0 conn(0x7fdfac0c5690 0x7fdfac1595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac0c3470 con 0x7fdfac073b50 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fdf9c001680 con 0x7fdfac073b50 2024-04-21T08:57:48.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 >> v1:172.21.15.26:6789/0 conn(0x7fdfac073b50 legacy=0x7fdfac1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980039c0 0x7fdf98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfac0c52b0 0x7fdf98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf98004d50 0x7fdf980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0c5e00 con 0x7fdf980039c0 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0c6330 con 0x7fdf98004d50 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdf9800ba50 con 0x7fdfac0c52b0 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980039c0 0x7fdf98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb11e9640 1 -- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfac0c52b0 msgr2=0x7fdf98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfac0c52b0 0x7fdf98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb11e9640 1 -- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf98004d50 msgr2=0x7fdf980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:48.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf98004d50 0x7fdf980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.454+0000 7fdfb11e9640 1 -- 172.21.15.26:0/845254959 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf98003530 con 0x7fdf980039c0 2024-04-21T08:57:48.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980039c0 0x7fdf98003de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009ac0 tx=0x7fdfa801ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf3f7eed668bd47 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:48.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80b2070 con 0x7fdf980039c0 2024-04-21T08:57:48.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa80a5570 con 0x7fdf980039c0 2024-04-21T08:57:48.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfa3fff640 1 -- 172.21.15.26:0/845254959 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8009690 con 0x7fdf980039c0 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 -- 172.21.15.26:0/845254959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980039c0 msgr2=0x7fdf98003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 --2- 172.21.15.26:0/845254959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdf980039c0 0x7fdf98003de0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009ac0 tx=0x7fdfa801ca90 comp rx=0 tx=0).stop 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb19ea640 1 -- 172.21.15.26:0/845254959 reap_dead start 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 -- 172.21.15.26:0/845254959 shutdown_connections 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 -- 172.21.15.26:0/845254959 >> 172.21.15.26:0/845254959 conn(0x7fdfac0c8960 msgr2=0x7fdfac0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 -- 172.21.15.26:0/845254959 shutdown_connections 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 -- 172.21.15.26:0/845254959 wait complete. 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 Processor -- start 2024-04-21T08:57:48.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.458+0000 7fdfb344d640 1 -- start start 2024-04-21T08:57:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980039c0 0x7fdfac06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfac15f4b0 0x7fdfac15f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfac1f4c60 0x7fdfac1f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac1636e0 con 0x7fdfac15f4b0 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0c9860 con 0x7fdfac1f4c60 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdfac163860 con 0x7fdf980039c0 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfac15f4b0 0x7fdfac15f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfac15f4b0 0x7fdfac15f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53936/0 (socket says 172.21.15.26:53936) 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 -- 172.21.15.26:0/2898741907 learned_addr learned my addr 172.21.15.26:0/2898741907 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980039c0 0x7fdfac06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb19ea640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfac1f4c60 0x7fdfac1f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 -- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980039c0 msgr2=0x7fdfac06ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980039c0 0x7fdfac06ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 -- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfac1f4c60 msgr2=0x7fdfac1f50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfac1f4c60 0x7fdfac1f50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 -- 172.21.15.26:0/2898741907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac1f5610 con 0x7fdfac15f4b0 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb19ea640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfac1f4c60 0x7fdfac1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb09e8640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfac15f4b0 0x7fdfac15f8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c7a0 tx=0x7fdf9c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfa1ffb640 1 -- 172.21.15.26:0/2898741907 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c018070 con 0x7fdfac15f4b0 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfa1ffb640 1 -- 172.21.15.26:0/2898741907 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf9c0074e0 con 0x7fdfac15f4b0 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfa1ffb640 1 -- 172.21.15.26:0/2898741907 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf9c004a30 con 0x7fdfac15f4b0 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfac1615d0 con 0x7fdfac15f4b0 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfac161b90 con 0x7fdfac15f4b0 2024-04-21T08:57:48.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfac075ef0 con 0x7fdfac15f4b0 2024-04-21T08:57:48.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfa1ffb640 1 -- 172.21.15.26:0/2898741907 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdf9c01b070 con 0x7fdfac15f4b0 2024-04-21T08:57:48.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfa1ffb640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdf900683b0 0x7fdf9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfa1ffb640 1 -- 172.21.15.26:0/2898741907 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fdf9c085f30 con 0x7fdfac15f4b0 2024-04-21T08:57:48.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.462+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdf900683b0 0x7fdf9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.466+0000 7fdfb11e9640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdf900683b0 0x7fdf9006a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80af000 tx=0x7fdfa80046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:48.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.466+0000 7fdfa1ffb640 1 -- 172.21.15.26:0/2898741907 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdf9c0564f0 con 0x7fdfac15f4b0 2024-04-21T08:57:48.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfac06f8f0 con 0x7fdfac15f4b0 2024-04-21T08:57:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfa1ffb640 1 -- 172.21.15.26:0/2898741907 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6822 (secure 0 0 0) 0x7fdf9c055df0 con 0x7fdfac15f4b0 2024-04-21T08:57:48.660 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:48.660 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:47.675746+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-21T08:57:48.660 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 7 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdf900683b0 msgr2=0x7fdf9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdf900683b0 0x7fdf9006a870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80af000 tx=0x7fdfa80046d0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfac15f4b0 msgr2=0x7fdfac15f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfac15f4b0 0x7fdfac15f8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c00c7a0 tx=0x7fdf9c00cc60 comp rx=0 tx=0).stop 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 shutdown_connections 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfac1f4c60 0x7fdfac1f50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdf900683b0 0x7fdf9006a870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdfac15f4b0 0x7fdfac15f8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 --2- 172.21.15.26:0/2898741907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980039c0 0x7fdfac06ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 >> 172.21.15.26:0/2898741907 conn(0x7fdfac0c8960 msgr2=0x7fdfac152810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:48.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 shutdown_connections 2024-04-21T08:57:48.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.658+0000 7fdfb344d640 1 -- 172.21.15.26:0/2898741907 wait complete. 2024-04-21T08:57:48.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:48.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa9e5c640 1 Processor -- start 2024-04-21T08:57:48.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa9e5c640 1 -- start start 2024-04-21T08:57:48.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa9e5c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faaa4073b50 0x7faaa40c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa9e5c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faaa40c5690 0x7faaa41595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa9e5c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa40c6050 con 0x7faaa40c52b0 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa9e5c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7faaa40c5e00 con 0x7faaa4073b50 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa9e5c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7faaa40c6330 con 0x7faaa40c5690 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faa9bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faaa4073b50 0x7faaa40c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faa9bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7faaa4073b50 0x7faaa40c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53950/0 (socket says 172.21.15.26:53950) 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faa9bfff640 1 -- 172.21.15.26:0/2203554154 learned_addr learned my addr 172.21.15.26:0/2203554154 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faaa3fff640 1 --2- 172.21.15.26:0/2203554154 >> v2:172.21.15.169:3300/0 conn(0x7faaa40c5690 0x7faaa41595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faa9bfff640 1 -- 172.21.15.26:0/2203554154 >> v2:172.21.15.169:3300/0 conn(0x7faaa40c5690 msgr2=0x7faaa41595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faa9bfff640 1 --2- 172.21.15.26:0/2203554154 >> v2:172.21.15.169:3300/0 conn(0x7faaa40c5690 0x7faaa41595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faa9bfff640 1 -- 172.21.15.26:0/2203554154 >> v1:172.21.15.169:6789/0 conn(0x7faaa40c52b0 legacy=0x7faaa41529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.798+0000 7faa9bfff640 1 -- 172.21.15.26:0/2203554154 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa40c3470 con 0x7faaa4073b50 2024-04-21T08:57:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faa9bfff640 1 --2- 172.21.15.26:0/2203554154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa4073b50 0x7faaa40c9450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faaa40c9d90 tx=0x7faa8c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60856c7c2d3e3aa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa2ffd640 1 -- 172.21.15.26:0/2203554154 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0b1070 con 0x7faaa4073b50 2024-04-21T08:57:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa2ffd640 1 -- 172.21.15.26:0/2203554154 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa8c0ac640 con 0x7faaa4073b50 2024-04-21T08:57:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa2ffd640 1 -- 172.21.15.26:0/2203554154 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c0aca10 con 0x7faaa4073b50 2024-04-21T08:57:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2203554154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa4073b50 msgr2=0x7faaa40c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2203554154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa4073b50 0x7faaa40c9450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faaa40c9d90 tx=0x7faa8c01c400 comp rx=0 tx=0).stop 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2203554154 shutdown_connections 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2203554154 >> v2:172.21.15.169:3300/0 conn(0x7faaa40c5690 0x7faaa41595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2203554154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa4073b50 0x7faaa40c9450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2203554154 >> 172.21.15.26:0/2203554154 conn(0x7faaa40c8960 msgr2=0x7faaa40c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2203554154 shutdown_connections 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2203554154 wait complete. 2024-04-21T08:57:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 Processor -- start 2024-04-21T08:57:48.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- start start 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faaa4073b50 0x7faaa414a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faaa40c52b0 0x7faaa41f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa40c5690 0x7faaa41f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faaa4165870 con 0x7faaa40c5690 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faaa41656f0 con 0x7faaa4073b50 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa9e5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faaa41659f0 con 0x7faaa40c52b0 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa40c5690 0x7faaa41f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa40c5690 0x7faaa41f5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53964/0 (socket says 172.21.15.26:53964) 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 -- 172.21.15.26:0/2042945541 learned_addr learned my addr 172.21.15.26:0/2042945541 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa37fe640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faaa4073b50 0x7faaa414a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faa9bfff640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faaa40c52b0 0x7faaa41f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 -- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faaa40c52b0 msgr2=0x7faaa41f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faaa40c52b0 0x7faaa41f5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 -- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faaa4073b50 msgr2=0x7faaa414a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faaa4073b50 0x7faaa414a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 -- 172.21.15.26:0/2042945541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa41f5dc0 con 0x7faaa40c5690 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa3fff640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa40c5690 0x7faaa41f5880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa9c007e60 tx=0x7faa9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.802+0000 7faaa0ff9640 1 -- 172.21.15.26:0/2042945541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c014420 con 0x7faaa40c5690 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa0ff9640 1 -- 172.21.15.26:0/2042945541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c019070 con 0x7faaa40c5690 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa40c2320 con 0x7faaa40c5690 2024-04-21T08:57:48.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa0ff9640 1 -- 172.21.15.26:0/2042945541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c014820 con 0x7faaa40c5690 2024-04-21T08:57:48.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa4144ab0 con 0x7faaa40c5690 2024-04-21T08:57:48.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaa4075ef0 con 0x7faaa40c5690 2024-04-21T08:57:48.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa0ff9640 1 -- 172.21.15.26:0/2042945541 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faa9c0149c0 con 0x7faaa40c5690 2024-04-21T08:57:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa0ff9640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7faa84068380 0x7faa8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa0ff9640 1 -- 172.21.15.26:0/2042945541 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faa9c0873e0 con 0x7faaa40c5690 2024-04-21T08:57:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa37fe640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7faa84068380 0x7faa8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:48.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.806+0000 7faaa37fe640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7faa84068380 0x7faa8406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa94001650 tx=0x7faa94009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:48.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.810+0000 7faaa0ff9640 1 -- 172.21.15.26:0/2042945541 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faa9c057870 con 0x7faaa40c5690 2024-04-21T08:57:48.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.970+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faaa4152e70 con 0x7faaa40c5690 2024-04-21T08:57:48.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.974+0000 7faaa0ff9640 1 -- 172.21.15.26:0/2042945541 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7faa9c057170 con 0x7faaa40c5690 2024-04-21T08:57:48.977 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:48.977 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7faa84068380 msgr2=0x7faa8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7faa84068380 0x7faa8406a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa94001650 tx=0x7faa94009040 comp rx=0 tx=0).stop 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa40c5690 msgr2=0x7faaa41f5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa40c5690 0x7faaa41f5880 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7faa9c007e60 tx=0x7faa9c00e4b0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 shutdown_connections 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7faa84068380 0x7faa8406a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faaa40c5690 0x7faaa41f5880 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faaa40c52b0 0x7faaa41f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 --2- 172.21.15.26:0/2042945541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faaa4073b50 0x7faaa414a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 >> 172.21.15.26:0/2042945541 conn(0x7faaa40c8960 msgr2=0x7faaa40cb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 shutdown_connections 2024-04-21T08:57:48.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:48.978+0000 7faaa9e5c640 1 -- 172.21.15.26:0/2042945541 wait complete. 2024-04-21T08:57:48.995 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-21T08:57:48.996 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T08:57:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.106+0000 7f2d121a9640 1 Processor -- start 2024-04-21T08:57:49.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.106+0000 7f2d121a9640 1 -- start start 2024-04-21T08:57:49.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d0c0c8b50 0x7f2d0c06caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0c15ac40 con 0x7f2d0c06d030 2024-04-21T08:57:49.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0c0c8fa0 con 0x7f2d0c0b3120 2024-04-21T08:57:49.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2d0c06fb90 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2d0c0c8b50 0x7f2d0c06caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2d0c06d030 0x7f2d0c15b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42296/0 (socket says 172.21.15.26:42296) 2024-04-21T08:57:49.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0bfff640 1 -- 172.21.15.26:0/632603669 learned_addr learned my addr 172.21.15.26:0/632603669 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:49.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0affd640 1 -- 172.21.15.26:0/632603669 >> v1:172.21.15.169:6789/0 conn(0x7f2d0c0b3120 legacy=0x7f2d0c06f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:49.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0affd640 1 -- 172.21.15.26:0/632603669 >> v1:172.21.15.26:6789/0 conn(0x7f2d0c06d030 legacy=0x7f2d0c15b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0affd640 1 -- 172.21.15.26:0/632603669 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c0ce080 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0affd640 1 --2- 172.21.15.26:0/632603669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c06caf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d000097c0 tx=0x7f2d0001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec500b4044e8c508 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/632603669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d000b5070 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/632603669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d000a8950 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d0a7fc640 1 -- 172.21.15.26:0/632603669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d000a8d20 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 -- 172.21.15.26:0/632603669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 msgr2=0x7f2d0c06caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 --2- 172.21.15.26:0/632603669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c06caf0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2d000097c0 tx=0x7f2d0001ec50 comp rx=0 tx=0).stop 2024-04-21T08:57:49.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 -- 172.21.15.26:0/632603669 shutdown_connections 2024-04-21T08:57:49.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 --2- 172.21.15.26:0/632603669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c06caf0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.110+0000 7f2d121a9640 1 -- 172.21.15.26:0/632603669 >> 172.21.15.26:0/632603669 conn(0x7f2d0c067760 msgr2=0x7f2d0c067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:49.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- 172.21.15.26:0/632603669 shutdown_connections 2024-04-21T08:57:49.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- 172.21.15.26:0/632603669 wait complete. 2024-04-21T08:57:49.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 Processor -- start 2024-04-21T08:57:49.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- start start 2024-04-21T08:57:49.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d0c06d030 0x7f2d0c1e3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d0c0b3120 0x7f2d0c150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c14eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c0ce920 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c0ce640 con 0x7f2d0c06d030 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c0b3500 con 0x7f2d0c0b3120 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c14eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c14eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53970/0 (socket says 172.21.15.26:53970) 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 -- 172.21.15.26:0/3966977606 learned_addr learned my addr 172.21.15.26:0/3966977606 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0affd640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d0c0b3120 0x7f2d0c150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0b7fe640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d0c06d030 0x7f2d0c1e3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 -- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d0c0b3120 msgr2=0x7f2d0c150110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d0c0b3120 0x7f2d0c150110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 -- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d0c06d030 msgr2=0x7f2d0c1e3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d0c06d030 0x7f2d0c1e3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 -- 172.21.15.26:0/3966977606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c1e4430 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d0bfff640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c14eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400cbc0 tx=0x7f2d0400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2cf3fff640 1 -- 172.21.15.26:0/3966977606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04017070 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2cf3fff640 1 -- 172.21.15.26:0/3966977606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d0400ad40 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c1e66d0 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2cf3fff640 1 -- 172.21.15.26:0/3966977606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04012600 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.114+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c1e6c70 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.118+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d0c075ef0 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.118+0000 7f2cf3fff640 1 -- 172.21.15.26:0/3966977606 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2d0401a070 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.118+0000 7f2cf3fff640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2cf8068380 0x7f2cf806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.118+0000 7f2cf3fff640 1 -- 172.21.15.26:0/3966977606 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2d04086730 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.118+0000 7f2d0b7fe640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2cf8068380 0x7f2cf806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.118+0000 7f2d0b7fe640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2cf8068380 0x7f2cf806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004e30 tx=0x7f2cfc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.122+0000 7f2cf3fff640 1 -- 172.21.15.26:0/3966977606 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2d0c15ac40 con 0x7f2d0c0c8b50 2024-04-21T08:57:49.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.282+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d0c15a610 con 0x7f2cf8068380 2024-04-21T08:57:49.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.306+0000 7f2cf3fff640 1 -- 172.21.15.26:0/3966977606 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251928 (secure 0 0 0) 0x7f2d0c15a610 con 0x7f2cf8068380 2024-04-21T08:57:49.309 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:49.314 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.310+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2cf8068380 msgr2=0x7f2cf806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.310+0000 7f2d121a9640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2cf8068380 0x7f2cf806a840 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc004e30 tx=0x7f2cfc009040 comp rx=0 tx=0).stop 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.310+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 msgr2=0x7f2d0c14eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.310+0000 7f2d121a9640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c14eb30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2d0400cbc0 tx=0x7f2d0400a430 comp rx=0 tx=0).stop 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 shutdown_connections 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2cf8068380 0x7f2cf806a840 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2d0c0c8b50 0x7f2d0c14eb30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2d0c0b3120 0x7f2d0c150110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 --2- 172.21.15.26:0/3966977606 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2d0c06d030 0x7f2d0c1e3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 >> 172.21.15.26:0/3966977606 conn(0x7f2d0c067760 msgr2=0x7f2d0c0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 shutdown_connections 2024-04-21T08:57:49.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.314+0000 7f2d121a9640 1 -- 172.21.15.26:0/3966977606 wait complete. 2024-04-21T08:57:49.334 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-21T08:57:49.124297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234576,"kb_used_data":1760,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740144,"statfs":{"total":773094113280,"available":772853907456,"internally_reserved":0,"allocated":1802240,"data_stored":1768584,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.892987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478008+0000","last_change":"2024-04-21T08:57:44.312400+0000","last_active":"2024-04-21T08:57:45.478008+0000","last_peered":"2024-04-21T08:57:45.478008+0000","last_clean":"2024-04-21T08:57:45.478008+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T08:57:45.478008+0000","last_undegraded":"2024-04-21T08:57:45.478008+0000","last_fullsized":"2024-04-21T08:57:45.478008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302244+0000","last_change":"2024-04-21T08:57:44.307469+0000","last_active":"2024-04-21T08:57:45.302244+0000","last_peered":"2024-04-21T08:57:45.302244+0000","last_clean":"2024-04-21T08:57:45.302244+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T08:57:45.302244+0000","last_undegraded":"2024-04-21T08:57:45.302244+0000","last_fullsized":"2024-04-21T08:57:45.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301915+0000","last_change":"2024-04-21T08:57:44.283704+0000","last_active":"2024-04-21T08:57:45.301915+0000","last_peered":"2024-04-21T08:57:45.301915+0000","last_clean":"2024-04-21T08:57:45.301915+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T08:57:45.301915+0000","last_undegraded":"2024-04-21T08:57:45.301915+0000","last_fullsized":"2024-04-21T08:57:45.301915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:22:29.477559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474882+0000","last_change":"2024-04-21T08:57:44.297940+0000","last_active":"2024-04-21T08:57:45.474882+0000","last_peered":"2024-04-21T08:57:45.474882+0000","last_clean":"2024-04-21T08:57:45.474882+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T08:57:45.474882+0000","last_undegraded":"2024-04-21T08:57:45.474882+0000","last_fullsized":"2024-04-21T08:57:45.474882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477621+0000","last_change":"2024-04-21T08:57:44.319147+0000","last_active":"2024-04-21T08:57:45.477621+0000","last_peered":"2024-04-21T08:57:45.477621+0000","last_clean":"2024-04-21T08:57:45.477621+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T08:57:45.477621+0000","last_undegraded":"2024-04-21T08:57:45.477621+0000","last_fullsized":"2024-04-21T08:57:45.477621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475406+0000","last_change":"2024-04-21T08:57:44.292228+0000","last_active":"2024-04-21T08:57:45.475406+0000","last_peered":"2024-04-21T08:57:45.475406+0000","last_clean":"2024-04-21T08:57:45.475406+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T08:57:45.475406+0000","last_undegraded":"2024-04-21T08:57:45.475406+0000","last_fullsized":"2024-04-21T08:57:45.475406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476097+0000","last_change":"2024-04-21T08:57:44.307483+0000","last_active":"2024-04-21T08:57:45.476097+0000","last_peered":"2024-04-21T08:57:45.476097+0000","last_clean":"2024-04-21T08:57:45.476097+0000","last_became_active":"2024-04-21T08:57:44.307147+0000","last_became_peered":"2024-04-21T08:57:44.307147+0000","last_unstale":"2024-04-21T08:57:45.476097+0000","last_undegraded":"2024-04-21T08:57:45.476097+0000","last_fullsized":"2024-04-21T08:57:45.476097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301538+0000","last_change":"2024-04-21T08:57:44.316305+0000","last_active":"2024-04-21T08:57:45.301538+0000","last_peered":"2024-04-21T08:57:45.301538+0000","last_clean":"2024-04-21T08:57:45.301538+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T08:57:45.301538+0000","last_undegraded":"2024-04-21T08:57:45.301538+0000","last_fullsized":"2024-04-21T08:57:45.301538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:02.718251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296716+0000","last_change":"2024-04-21T08:57:44.306928+0000","last_active":"2024-04-21T08:57:45.296716+0000","last_peered":"2024-04-21T08:57:45.296716+0000","last_clean":"2024-04-21T08:57:45.296716+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T08:57:45.296716+0000","last_undegraded":"2024-04-21T08:57:45.296716+0000","last_fullsized":"2024-04-21T08:57:45.296716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:47.382588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477106+0000","last_change":"2024-04-21T08:57:44.307925+0000","last_active":"2024-04-21T08:57:45.477106+0000","last_peered":"2024-04-21T08:57:45.477106+0000","last_clean":"2024-04-21T08:57:45.477106+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T08:57:45.477106+0000","last_undegraded":"2024-04-21T08:57:45.477106+0000","last_fullsized":"2024-04-21T08:57:45.477106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475344+0000","last_change":"2024-04-21T08:57:44.312289+0000","last_active":"2024-04-21T08:57:45.475344+0000","last_peered":"2024-04-21T08:57:45.475344+0000","last_clean":"2024-04-21T08:57:45.475344+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T08:57:45.475344+0000","last_undegraded":"2024-04-21T08:57:45.475344+0000","last_fullsized":"2024-04-21T08:57:45.475344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477952+0000","last_change":"2024-04-21T08:57:44.315406+0000","last_active":"2024-04-21T08:57:45.477952+0000","last_peered":"2024-04-21T08:57:45.477952+0000","last_clean":"2024-04-21T08:57:45.477952+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T08:57:45.477952+0000","last_undegraded":"2024-04-21T08:57:45.477952+0000","last_fullsized":"2024-04-21T08:57:45.477952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475316+0000","last_change":"2024-04-21T08:57:44.321357+0000","last_active":"2024-04-21T08:57:45.475316+0000","last_peered":"2024-04-21T08:57:45.475316+0000","last_clean":"2024-04-21T08:57:45.475316+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T08:57:45.475316+0000","last_undegraded":"2024-04-21T08:57:45.475316+0000","last_fullsized":"2024-04-21T08:57:45.475316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:01:59.921966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475445+0000","last_change":"2024-04-21T08:57:44.315428+0000","last_active":"2024-04-21T08:57:45.475445+0000","last_peered":"2024-04-21T08:57:45.475445+0000","last_clean":"2024-04-21T08:57:45.475445+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T08:57:45.475445+0000","last_undegraded":"2024-04-21T08:57:45.475445+0000","last_fullsized":"2024-04-21T08:57:45.475445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301076+0000","last_change":"2024-04-21T08:57:44.285663+0000","last_active":"2024-04-21T08:57:45.301076+0000","last_peered":"2024-04-21T08:57:45.301076+0000","last_clean":"2024-04-21T08:57:45.301076+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T08:57:45.301076+0000","last_undegraded":"2024-04-21T08:57:45.301076+0000","last_fullsized":"2024-04-21T08:57:45.301076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:54:18.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474994+0000","last_change":"2024-04-21T08:57:44.288842+0000","last_active":"2024-04-21T08:57:45.474994+0000","last_peered":"2024-04-21T08:57:45.474994+0000","last_clean":"2024-04-21T08:57:45.474994+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T08:57:45.474994+0000","last_undegraded":"2024-04-21T08:57:45.474994+0000","last_fullsized":"2024-04-21T08:57:45.474994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479022+0000","last_change":"2024-04-21T08:57:44.320371+0000","last_active":"2024-04-21T08:57:45.479022+0000","last_peered":"2024-04-21T08:57:45.479022+0000","last_clean":"2024-04-21T08:57:45.479022+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T08:57:45.479022+0000","last_undegraded":"2024-04-21T08:57:45.479022+0000","last_fullsized":"2024-04-21T08:57:45.479022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:37:23.456724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474849+0000","last_change":"2024-04-21T08:57:44.302161+0000","last_active":"2024-04-21T08:57:45.474849+0000","last_peered":"2024-04-21T08:57:45.474849+0000","last_clean":"2024-04-21T08:57:45.474849+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T08:57:45.474849+0000","last_undegraded":"2024-04-21T08:57:45.474849+0000","last_fullsized":"2024-04-21T08:57:45.474849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478601+0000","last_change":"2024-04-21T08:57:44.289531+0000","last_active":"2024-04-21T08:57:45.478601+0000","last_peered":"2024-04-21T08:57:45.478601+0000","last_clean":"2024-04-21T08:57:45.478601+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T08:57:45.478601+0000","last_undegraded":"2024-04-21T08:57:45.478601+0000","last_fullsized":"2024-04-21T08:57:45.478601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:42:25.869615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477213+0000","last_change":"2024-04-21T08:57:44.315116+0000","last_active":"2024-04-21T08:57:45.477213+0000","last_peered":"2024-04-21T08:57:45.477213+0000","last_clean":"2024-04-21T08:57:45.477213+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T08:57:45.477213+0000","last_undegraded":"2024-04-21T08:57:45.477213+0000","last_fullsized":"2024-04-21T08:57:45.477213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300338+0000","last_change":"2024-04-21T08:57:44.299295+0000","last_active":"2024-04-21T08:57:45.300338+0000","last_peered":"2024-04-21T08:57:45.300338+0000","last_clean":"2024-04-21T08:57:45.300338+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T08:57:45.300338+0000","last_undegraded":"2024-04-21T08:57:45.300338+0000","last_fullsized":"2024-04-21T08:57:45.300338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:32:23.460346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296074+0000","last_change":"2024-04-21T08:57:44.293141+0000","last_active":"2024-04-21T08:57:45.296074+0000","last_peered":"2024-04-21T08:57:45.296074+0000","last_clean":"2024-04-21T08:57:45.296074+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T08:57:45.296074+0000","last_undegraded":"2024-04-21T08:57:45.296074+0000","last_fullsized":"2024-04-21T08:57:45.296074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301628+0000","last_change":"2024-04-21T08:57:44.291347+0000","last_active":"2024-04-21T08:57:45.301628+0000","last_peered":"2024-04-21T08:57:45.301628+0000","last_clean":"2024-04-21T08:57:45.301628+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T08:57:45.301628+0000","last_undegraded":"2024-04-21T08:57:45.301628+0000","last_fullsized":"2024-04-21T08:57:45.301628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:29.349924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475426+0000","last_change":"2024-04-21T08:57:44.283481+0000","last_active":"2024-04-21T08:57:45.475426+0000","last_peered":"2024-04-21T08:57:45.475426+0000","last_clean":"2024-04-21T08:57:45.475426+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T08:57:45.475426+0000","last_undegraded":"2024-04-21T08:57:45.475426+0000","last_fullsized":"2024-04-21T08:57:45.475426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302199+0000","last_change":"2024-04-21T08:57:44.304218+0000","last_active":"2024-04-21T08:57:45.302199+0000","last_peered":"2024-04-21T08:57:45.302199+0000","last_clean":"2024-04-21T08:57:45.302199+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T08:57:45.302199+0000","last_undegraded":"2024-04-21T08:57:45.302199+0000","last_fullsized":"2024-04-21T08:57:45.302199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476814+0000","last_change":"2024-04-21T08:57:44.305569+0000","last_active":"2024-04-21T08:57:45.476814+0000","last_peered":"2024-04-21T08:57:45.476814+0000","last_clean":"2024-04-21T08:57:45.476814+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T08:57:45.476814+0000","last_undegraded":"2024-04-21T08:57:45.476814+0000","last_fullsized":"2024-04-21T08:57:45.476814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476147+0000","last_change":"2024-04-21T08:57:44.314872+0000","last_active":"2024-04-21T08:57:45.476147+0000","last_peered":"2024-04-21T08:57:45.476147+0000","last_clean":"2024-04-21T08:57:45.476147+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T08:57:45.476147+0000","last_undegraded":"2024-04-21T08:57:45.476147+0000","last_fullsized":"2024-04-21T08:57:45.476147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475471+0000","last_change":"2024-04-21T08:57:44.320786+0000","last_active":"2024-04-21T08:57:45.475471+0000","last_peered":"2024-04-21T08:57:45.475471+0000","last_clean":"2024-04-21T08:57:45.475471+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T08:57:45.475471+0000","last_undegraded":"2024-04-21T08:57:45.475471+0000","last_fullsized":"2024-04-21T08:57:45.475471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301360+0000","last_change":"2024-04-21T08:57:44.292576+0000","last_active":"2024-04-21T08:57:45.301360+0000","last_peered":"2024-04-21T08:57:45.301360+0000","last_clean":"2024-04-21T08:57:45.301360+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T08:57:45.301360+0000","last_undegraded":"2024-04-21T08:57:45.301360+0000","last_fullsized":"2024-04-21T08:57:45.301360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:41:15.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476800+0000","last_change":"2024-04-21T08:57:44.301159+0000","last_active":"2024-04-21T08:57:45.476800+0000","last_peered":"2024-04-21T08:57:45.476800+0000","last_clean":"2024-04-21T08:57:45.476800+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T08:57:45.476800+0000","last_undegraded":"2024-04-21T08:57:45.476800+0000","last_fullsized":"2024-04-21T08:57:45.476800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473997+0000","last_change":"2024-04-21T08:57:44.295923+0000","last_active":"2024-04-21T08:57:45.473997+0000","last_peered":"2024-04-21T08:57:45.473997+0000","last_clean":"2024-04-21T08:57:45.473997+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T08:57:45.473997+0000","last_undegraded":"2024-04-21T08:57:45.473997+0000","last_fullsized":"2024-04-21T08:57:45.473997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474254+0000","last_change":"2024-04-21T08:57:44.317457+0000","last_active":"2024-04-21T08:57:45.474254+0000","last_peered":"2024-04-21T08:57:45.474254+0000","last_clean":"2024-04-21T08:57:45.474254+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T08:57:45.474254+0000","last_undegraded":"2024-04-21T08:57:45.474254+0000","last_fullsized":"2024-04-21T08:57:45.474254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:17.843858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296164+0000","last_change":"2024-04-21T08:57:44.293278+0000","last_active":"2024-04-21T08:57:45.296164+0000","last_peered":"2024-04-21T08:57:45.296164+0000","last_clean":"2024-04-21T08:57:45.296164+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T08:57:45.296164+0000","last_undegraded":"2024-04-21T08:57:45.296164+0000","last_fullsized":"2024-04-21T08:57:45.296164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301713+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T08:57:45.301713+0000","last_peered":"2024-04-21T08:57:45.301713+0000","last_clean":"2024-04-21T08:57:45.301713+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T08:57:45.301713+0000","last_undegraded":"2024-04-21T08:57:45.301713+0000","last_fullsized":"2024-04-21T08:57:45.301713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300238+0000","last_change":"2024-04-21T08:57:44.308011+0000","last_active":"2024-04-21T08:57:45.300238+0000","last_peered":"2024-04-21T08:57:45.300238+0000","last_clean":"2024-04-21T08:57:45.300238+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T08:57:45.300238+0000","last_undegraded":"2024-04-21T08:57:45.300238+0000","last_fullsized":"2024-04-21T08:57:45.300238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:45.396672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478165+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T08:57:45.478165+0000","last_peered":"2024-04-21T08:57:45.478165+0000","last_clean":"2024-04-21T08:57:45.478165+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T08:57:45.478165+0000","last_undegraded":"2024-04-21T08:57:45.478165+0000","last_fullsized":"2024-04-21T08:57:45.478165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475213+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T08:57:45.475213+0000","last_peered":"2024-04-21T08:57:45.475213+0000","last_clean":"2024-04-21T08:57:45.475213+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T08:57:45.475213+0000","last_undegraded":"2024-04-21T08:57:45.475213+0000","last_fullsized":"2024-04-21T08:57:45.475213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302334+0000","last_change":"2024-04-21T08:57:44.307616+0000","last_active":"2024-04-21T08:57:45.302334+0000","last_peered":"2024-04-21T08:57:45.302334+0000","last_clean":"2024-04-21T08:57:45.302334+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T08:57:45.302334+0000","last_undegraded":"2024-04-21T08:57:45.302334+0000","last_fullsized":"2024-04-21T08:57:45.302334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475348+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T08:57:45.475348+0000","last_peered":"2024-04-21T08:57:45.475348+0000","last_clean":"2024-04-21T08:57:45.475348+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T08:57:45.475348+0000","last_undegraded":"2024-04-21T08:57:45.475348+0000","last_fullsized":"2024-04-21T08:57:45.475348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300102+0000","last_change":"2024-04-21T08:57:44.285516+0000","last_active":"2024-04-21T08:57:45.300102+0000","last_peered":"2024-04-21T08:57:45.300102+0000","last_clean":"2024-04-21T08:57:45.300102+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T08:57:45.300102+0000","last_undegraded":"2024-04-21T08:57:45.300102+0000","last_fullsized":"2024-04-21T08:57:45.300102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296625+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T08:57:45.296625+0000","last_peered":"2024-04-21T08:57:45.296625+0000","last_clean":"2024-04-21T08:57:45.296625+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T08:57:45.296625+0000","last_undegraded":"2024-04-21T08:57:45.296625+0000","last_fullsized":"2024-04-21T08:57:45.296625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477228+0000","last_change":"2024-04-21T08:57:44.305837+0000","last_active":"2024-04-21T08:57:45.477228+0000","last_peered":"2024-04-21T08:57:45.477228+0000","last_clean":"2024-04-21T08:57:45.477228+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T08:57:45.477228+0000","last_undegraded":"2024-04-21T08:57:45.477228+0000","last_fullsized":"2024-04-21T08:57:45.477228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477323+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T08:57:45.477323+0000","last_peered":"2024-04-21T08:57:45.477323+0000","last_clean":"2024-04-21T08:57:45.477323+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T08:57:45.477323+0000","last_undegraded":"2024-04-21T08:57:45.477323+0000","last_fullsized":"2024-04-21T08:57:45.477323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302616+0000","last_change":"2024-04-21T08:57:44.305156+0000","last_active":"2024-04-21T08:57:45.302616+0000","last_peered":"2024-04-21T08:57:45.302616+0000","last_clean":"2024-04-21T08:57:45.302616+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T08:57:45.302616+0000","last_undegraded":"2024-04-21T08:57:45.302616+0000","last_fullsized":"2024-04-21T08:57:45.302616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474495+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T08:57:45.474495+0000","last_peered":"2024-04-21T08:57:45.474495+0000","last_clean":"2024-04-21T08:57:45.474495+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T08:57:45.474495+0000","last_undegraded":"2024-04-21T08:57:45.474495+0000","last_fullsized":"2024-04-21T08:57:45.474495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476386+0000","last_change":"2024-04-21T08:57:44.296804+0000","last_active":"2024-04-21T08:57:45.476386+0000","last_peered":"2024-04-21T08:57:45.476386+0000","last_clean":"2024-04-21T08:57:45.476386+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T08:57:45.476386+0000","last_undegraded":"2024-04-21T08:57:45.476386+0000","last_fullsized":"2024-04-21T08:57:45.476386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475031+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T08:57:45.475031+0000","last_peered":"2024-04-21T08:57:45.475031+0000","last_clean":"2024-04-21T08:57:45.475031+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T08:57:45.475031+0000","last_undegraded":"2024-04-21T08:57:45.475031+0000","last_fullsized":"2024-04-21T08:57:45.475031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475742+0000","last_change":"2024-04-21T08:57:44.323678+0000","last_active":"2024-04-21T08:57:45.475742+0000","last_peered":"2024-04-21T08:57:45.475742+0000","last_clean":"2024-04-21T08:57:45.475742+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T08:57:45.475742+0000","last_undegraded":"2024-04-21T08:57:45.475742+0000","last_fullsized":"2024-04-21T08:57:45.475742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474367+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T08:57:45.474367+0000","last_peered":"2024-04-21T08:57:45.474367+0000","last_clean":"2024-04-21T08:57:45.474367+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T08:57:45.474367+0000","last_undegraded":"2024-04-21T08:57:45.474367+0000","last_fullsized":"2024-04-21T08:57:45.474367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475320+0000","last_change":"2024-04-21T08:57:44.310092+0000","last_active":"2024-04-21T08:57:45.475320+0000","last_peered":"2024-04-21T08:57:45.475320+0000","last_clean":"2024-04-21T08:57:45.475320+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T08:57:45.475320+0000","last_undegraded":"2024-04-21T08:57:45.475320+0000","last_fullsized":"2024-04-21T08:57:45.475320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:03.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478308+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T08:57:45.478308+0000","last_peered":"2024-04-21T08:57:45.478308+0000","last_clean":"2024-04-21T08:57:45.478308+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T08:57:45.478308+0000","last_undegraded":"2024-04-21T08:57:45.478308+0000","last_fullsized":"2024-04-21T08:57:45.478308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477225+0000","last_change":"2024-04-21T08:57:44.320598+0000","last_active":"2024-04-21T08:57:45.477225+0000","last_peered":"2024-04-21T08:57:45.477225+0000","last_clean":"2024-04-21T08:57:45.477225+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T08:57:45.477225+0000","last_undegraded":"2024-04-21T08:57:45.477225+0000","last_fullsized":"2024-04-21T08:57:45.477225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:51.743927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476234+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T08:57:45.476234+0000","last_peered":"2024-04-21T08:57:45.476234+0000","last_clean":"2024-04-21T08:57:45.476234+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T08:57:45.476234+0000","last_undegraded":"2024-04-21T08:57:45.476234+0000","last_fullsized":"2024-04-21T08:57:45.476234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295791+0000","last_change":"2024-04-21T08:57:44.292658+0000","last_active":"2024-04-21T08:57:45.295791+0000","last_peered":"2024-04-21T08:57:45.295791+0000","last_clean":"2024-04-21T08:57:45.295791+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T08:57:45.295791+0000","last_undegraded":"2024-04-21T08:57:45.295791+0000","last_fullsized":"2024-04-21T08:57:45.295791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300452+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T08:57:45.300452+0000","last_peered":"2024-04-21T08:57:45.300452+0000","last_clean":"2024-04-21T08:57:45.300452+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T08:57:45.300452+0000","last_undegraded":"2024-04-21T08:57:45.300452+0000","last_fullsized":"2024-04-21T08:57:45.300452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475925+0000","last_change":"2024-04-21T08:57:44.289358+0000","last_active":"2024-04-21T08:57:45.475925+0000","last_peered":"2024-04-21T08:57:45.475925+0000","last_clean":"2024-04-21T08:57:45.475925+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T08:57:45.475925+0000","last_undegraded":"2024-04-21T08:57:45.475925+0000","last_fullsized":"2024-04-21T08:57:45.475925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478105+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T08:57:45.478105+0000","last_peered":"2024-04-21T08:57:45.478105+0000","last_clean":"2024-04-21T08:57:45.478105+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T08:57:45.478105+0000","last_undegraded":"2024-04-21T08:57:45.478105+0000","last_fullsized":"2024-04-21T08:57:45.478105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477620+0000","last_change":"2024-04-21T08:57:44.321062+0000","last_active":"2024-04-21T08:57:45.477620+0000","last_peered":"2024-04-21T08:57:45.477620+0000","last_clean":"2024-04-21T08:57:45.477620+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T08:57:45.477620+0000","last_undegraded":"2024-04-21T08:57:45.477620+0000","last_fullsized":"2024-04-21T08:57:45.477620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300838+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T08:57:45.300838+0000","last_peered":"2024-04-21T08:57:45.300838+0000","last_clean":"2024-04-21T08:57:45.300838+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T08:57:45.300838+0000","last_undegraded":"2024-04-21T08:57:45.300838+0000","last_fullsized":"2024-04-21T08:57:45.300838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477974+0000","last_change":"2024-04-21T08:57:44.315764+0000","last_active":"2024-04-21T08:57:45.477974+0000","last_peered":"2024-04-21T08:57:45.477974+0000","last_clean":"2024-04-21T08:57:45.477974+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T08:57:45.477974+0000","last_undegraded":"2024-04-21T08:57:45.477974+0000","last_fullsized":"2024-04-21T08:57:45.477974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302175+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T08:57:45.302175+0000","last_peered":"2024-04-21T08:57:45.302175+0000","last_clean":"2024-04-21T08:57:45.302175+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T08:57:45.302175+0000","last_undegraded":"2024-04-21T08:57:45.302175+0000","last_fullsized":"2024-04-21T08:57:45.302175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477623+0000","last_change":"2024-04-21T08:57:44.315316+0000","last_active":"2024-04-21T08:57:45.477623+0000","last_peered":"2024-04-21T08:57:45.477623+0000","last_clean":"2024-04-21T08:57:45.477623+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T08:57:45.477623+0000","last_undegraded":"2024-04-21T08:57:45.477623+0000","last_fullsized":"2024-04-21T08:57:45.477623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475756+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T08:57:45.475756+0000","last_peered":"2024-04-21T08:57:45.475756+0000","last_clean":"2024-04-21T08:57:45.475756+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T08:57:45.475756+0000","last_undegraded":"2024-04-21T08:57:45.475756+0000","last_fullsized":"2024-04-21T08:57:45.475756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478318+0000","last_change":"2024-04-21T08:57:44.298472+0000","last_active":"2024-04-21T08:57:45.478318+0000","last_peered":"2024-04-21T08:57:45.478318+0000","last_clean":"2024-04-21T08:57:45.478318+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T08:57:45.478318+0000","last_undegraded":"2024-04-21T08:57:45.478318+0000","last_fullsized":"2024-04-21T08:57:45.478318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:14:06.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295542+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T08:57:45.295542+0000","last_peered":"2024-04-21T08:57:45.295542+0000","last_clean":"2024-04-21T08:57:45.295542+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T08:57:45.295542+0000","last_undegraded":"2024-04-21T08:57:45.295542+0000","last_fullsized":"2024-04-21T08:57:45.295542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477601+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T08:57:45.477601+0000","last_peered":"2024-04-21T08:57:45.477601+0000","last_clean":"2024-04-21T08:57:45.477601+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T08:57:45.477601+0000","last_undegraded":"2024-04-21T08:57:45.477601+0000","last_fullsized":"2024-04-21T08:57:45.477601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300093+0000","last_change":"2024-04-21T08:57:44.289877+0000","last_active":"2024-04-21T08:57:45.300093+0000","last_peered":"2024-04-21T08:57:45.300093+0000","last_clean":"2024-04-21T08:57:45.300093+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T08:57:45.300093+0000","last_undegraded":"2024-04-21T08:57:45.300093+0000","last_fullsized":"2024-04-21T08:57:45.300093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475561+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T08:57:45.475561+0000","last_peered":"2024-04-21T08:57:45.475561+0000","last_clean":"2024-04-21T08:57:45.475561+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T08:57:45.475561+0000","last_undegraded":"2024-04-21T08:57:45.475561+0000","last_fullsized":"2024-04-21T08:57:45.475561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474956+0000","last_change":"2024-04-21T08:57:44.309539+0000","last_active":"2024-04-21T08:57:45.474956+0000","last_peered":"2024-04-21T08:57:45.474956+0000","last_clean":"2024-04-21T08:57:45.474956+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T08:57:45.474956+0000","last_undegraded":"2024-04-21T08:57:45.474956+0000","last_fullsized":"2024-04-21T08:57:45.474956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:47:34.419511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473930+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T08:57:45.473930+0000","last_peered":"2024-04-21T08:57:45.473930+0000","last_clean":"2024-04-21T08:57:45.473930+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T08:57:45.473930+0000","last_undegraded":"2024-04-21T08:57:45.473930+0000","last_fullsized":"2024-04-21T08:57:45.473930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301947+0000","last_change":"2024-04-21T08:57:44.298533+0000","last_active":"2024-04-21T08:57:45.301947+0000","last_peered":"2024-04-21T08:57:45.301947+0000","last_clean":"2024-04-21T08:57:45.301947+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T08:57:45.301947+0000","last_undegraded":"2024-04-21T08:57:45.301947+0000","last_fullsized":"2024-04-21T08:57:45.301947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478433+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T08:57:45.478433+0000","last_peered":"2024-04-21T08:57:45.478433+0000","last_clean":"2024-04-21T08:57:45.478433+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T08:57:45.478433+0000","last_undegraded":"2024-04-21T08:57:45.478433+0000","last_fullsized":"2024-04-21T08:57:45.478433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477998+0000","last_change":"2024-04-21T08:57:44.315633+0000","last_active":"2024-04-21T08:57:45.477998+0000","last_peered":"2024-04-21T08:57:45.477998+0000","last_clean":"2024-04-21T08:57:45.477998+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T08:57:45.477998+0000","last_undegraded":"2024-04-21T08:57:45.477998+0000","last_fullsized":"2024-04-21T08:57:45.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301760+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T08:57:45.301760+0000","last_peered":"2024-04-21T08:57:45.301760+0000","last_clean":"2024-04-21T08:57:45.301760+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T08:57:45.301760+0000","last_undegraded":"2024-04-21T08:57:45.301760+0000","last_fullsized":"2024-04-21T08:57:45.301760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475775+0000","last_change":"2024-04-21T08:57:44.318478+0000","last_active":"2024-04-21T08:57:45.475775+0000","last_peered":"2024-04-21T08:57:45.475775+0000","last_clean":"2024-04-21T08:57:45.475775+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T08:57:45.475775+0000","last_undegraded":"2024-04-21T08:57:45.475775+0000","last_fullsized":"2024-04-21T08:57:45.475775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478561+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T08:57:45.478561+0000","last_peered":"2024-04-21T08:57:45.478561+0000","last_clean":"2024-04-21T08:57:45.478561+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T08:57:45.478561+0000","last_undegraded":"2024-04-21T08:57:45.478561+0000","last_fullsized":"2024-04-21T08:57:45.478561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475343+0000","last_change":"2024-04-21T08:57:44.305172+0000","last_active":"2024-04-21T08:57:45.475343+0000","last_peered":"2024-04-21T08:57:45.475343+0000","last_clean":"2024-04-21T08:57:45.475343+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T08:57:45.475343+0000","last_undegraded":"2024-04-21T08:57:45.475343+0000","last_fullsized":"2024-04-21T08:57:45.475343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:13:46.282333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301089+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T08:57:45.301089+0000","last_peered":"2024-04-21T08:57:45.301089+0000","last_clean":"2024-04-21T08:57:45.301089+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T08:57:45.301089+0000","last_undegraded":"2024-04-21T08:57:45.301089+0000","last_fullsized":"2024-04-21T08:57:45.301089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300739+0000","last_change":"2024-04-21T08:57:44.311283+0000","last_active":"2024-04-21T08:57:45.300739+0000","last_peered":"2024-04-21T08:57:45.300739+0000","last_clean":"2024-04-21T08:57:45.300739+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T08:57:45.300739+0000","last_undegraded":"2024-04-21T08:57:45.300739+0000","last_fullsized":"2024-04-21T08:57:45.300739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:06:14.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479036+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T08:57:45.479036+0000","last_peered":"2024-04-21T08:57:45.479036+0000","last_clean":"2024-04-21T08:57:45.479036+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T08:57:45.479036+0000","last_undegraded":"2024-04-21T08:57:45.479036+0000","last_fullsized":"2024-04-21T08:57:45.479036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300568+0000","last_change":"2024-04-21T08:57:44.293449+0000","last_active":"2024-04-21T08:57:45.300568+0000","last_peered":"2024-04-21T08:57:45.300568+0000","last_clean":"2024-04-21T08:57:45.300568+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T08:57:45.300568+0000","last_undegraded":"2024-04-21T08:57:45.300568+0000","last_fullsized":"2024-04-21T08:57:45.300568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:13:04.768707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474913+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T08:57:45.474913+0000","last_peered":"2024-04-21T08:57:45.474913+0000","last_clean":"2024-04-21T08:57:45.474913+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T08:57:45.474913+0000","last_undegraded":"2024-04-21T08:57:45.474913+0000","last_fullsized":"2024-04-21T08:57:45.474913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476103+0000","last_change":"2024-04-21T08:57:44.294831+0000","last_active":"2024-04-21T08:57:45.476103+0000","last_peered":"2024-04-21T08:57:45.476103+0000","last_clean":"2024-04-21T08:57:45.476103+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T08:57:45.476103+0000","last_undegraded":"2024-04-21T08:57:45.476103+0000","last_fullsized":"2024-04-21T08:57:45.476103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300649+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T08:57:45.300649+0000","last_peered":"2024-04-21T08:57:45.300649+0000","last_clean":"2024-04-21T08:57:45.300649+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T08:57:45.300649+0000","last_undegraded":"2024-04-21T08:57:45.300649+0000","last_fullsized":"2024-04-21T08:57:45.300649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.299620+0000","last_change":"2024-04-21T08:57:44.299090+0000","last_active":"2024-04-21T08:57:45.299620+0000","last_peered":"2024-04-21T08:57:45.299620+0000","last_clean":"2024-04-21T08:57:45.299620+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T08:57:45.299620+0000","last_undegraded":"2024-04-21T08:57:45.299620+0000","last_fullsized":"2024-04-21T08:57:45.299620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475613+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T08:57:45.475613+0000","last_peered":"2024-04-21T08:57:45.475613+0000","last_clean":"2024-04-21T08:57:45.475613+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T08:57:45.475613+0000","last_undegraded":"2024-04-21T08:57:45.475613+0000","last_fullsized":"2024-04-21T08:57:45.475613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474385+0000","last_change":"2024-04-21T08:57:44.317697+0000","last_active":"2024-04-21T08:57:45.474385+0000","last_peered":"2024-04-21T08:57:45.474385+0000","last_clean":"2024-04-21T08:57:45.474385+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T08:57:45.474385+0000","last_undegraded":"2024-04-21T08:57:45.474385+0000","last_fullsized":"2024-04-21T08:57:45.474385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477353+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T08:57:45.477353+0000","last_peered":"2024-04-21T08:57:45.477353+0000","last_clean":"2024-04-21T08:57:45.477353+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T08:57:45.477353+0000","last_undegraded":"2024-04-21T08:57:45.477353+0000","last_fullsized":"2024-04-21T08:57:45.477353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478072+0000","last_change":"2024-04-21T08:57:44.300498+0000","last_active":"2024-04-21T08:57:45.478072+0000","last_peered":"2024-04-21T08:57:45.478072+0000","last_clean":"2024-04-21T08:57:45.478072+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T08:57:45.478072+0000","last_undegraded":"2024-04-21T08:57:45.478072+0000","last_fullsized":"2024-04-21T08:57:45.478072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:36:51.242004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478121+0000","last_change":"2024-04-21T08:57:44.321085+0000","last_active":"2024-04-21T08:57:45.478121+0000","last_peered":"2024-04-21T08:57:45.478121+0000","last_clean":"2024-04-21T08:57:45.478121+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T08:57:45.478121+0000","last_undegraded":"2024-04-21T08:57:45.478121+0000","last_fullsized":"2024-04-21T08:57:45.478121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:49.754472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477804+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T08:57:45.477804+0000","last_peered":"2024-04-21T08:57:45.477804+0000","last_clean":"2024-04-21T08:57:45.477804+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T08:57:45.477804+0000","last_undegraded":"2024-04-21T08:57:45.477804+0000","last_fullsized":"2024-04-21T08:57:45.477804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296663+0000","last_change":"2024-04-21T08:57:44.315810+0000","last_active":"2024-04-21T08:57:45.296663+0000","last_peered":"2024-04-21T08:57:45.296663+0000","last_clean":"2024-04-21T08:57:45.296663+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T08:57:45.296663+0000","last_undegraded":"2024-04-21T08:57:45.296663+0000","last_fullsized":"2024-04-21T08:57:45.296663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475884+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T08:57:45.475884+0000","last_peered":"2024-04-21T08:57:45.475884+0000","last_clean":"2024-04-21T08:57:45.475884+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T08:57:45.475884+0000","last_undegraded":"2024-04-21T08:57:45.475884+0000","last_fullsized":"2024-04-21T08:57:45.475884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302388+0000","last_change":"2024-04-21T08:57:44.303912+0000","last_active":"2024-04-21T08:57:45.302388+0000","last_peered":"2024-04-21T08:57:45.302388+0000","last_clean":"2024-04-21T08:57:45.302388+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T08:57:45.302388+0000","last_undegraded":"2024-04-21T08:57:45.302388+0000","last_fullsized":"2024-04-21T08:57:45.302388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302471+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T08:57:45.302471+0000","last_peered":"2024-04-21T08:57:45.302471+0000","last_clean":"2024-04-21T08:57:45.302471+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T08:57:45.302471+0000","last_undegraded":"2024-04-21T08:57:45.302471+0000","last_fullsized":"2024-04-21T08:57:45.302471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302272+0000","last_change":"2024-04-21T08:57:44.301951+0000","last_active":"2024-04-21T08:57:45.302272+0000","last_peered":"2024-04-21T08:57:45.302272+0000","last_clean":"2024-04-21T08:57:45.302272+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T08:57:45.302272+0000","last_undegraded":"2024-04-21T08:57:45.302272+0000","last_fullsized":"2024-04-21T08:57:45.302272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300925+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T08:57:45.300925+0000","last_peered":"2024-04-21T08:57:45.300925+0000","last_clean":"2024-04-21T08:57:45.300925+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T08:57:45.300925+0000","last_undegraded":"2024-04-21T08:57:45.300925+0000","last_fullsized":"2024-04-21T08:57:45.300925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":663849,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":663849,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T08:57:49.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T08:57:49.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.502+0000 7f96a2455640 1 Processor -- start 2024-04-21T08:57:49.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.502+0000 7f96a2455640 1 -- start start 2024-04-21T08:57:49.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a2455640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f969c154eb0 0x7f969c15eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a2455640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c15b3a0 con 0x7f969c0cb120 2024-04-21T08:57:49.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a2455640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c15b680 con 0x7f969c0c7680 2024-04-21T08:57:49.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a2455640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f969c15e130 con 0x7f969c154eb0 2024-04-21T08:57:49.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a09f2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f969c0cb120 0x7f969c0d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42300/0 (socket says 172.21.15.26:42300) 2024-04-21T08:57:49.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a09f2640 1 -- 172.21.15.26:0/3717846977 learned_addr learned my addr 172.21.15.26:0/3717846977 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969bfff640 1 --2- 172.21.15.26:0/3717846977 >> v2:172.21.15.169:3300/0 conn(0x7f969c154eb0 0x7f969c15eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388924371 0 0) 0x7f969c15b3a0 con 0x7f969c0cb120 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003530 con 0x7f969c0cb120 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1171102465 0 0) 0x7f9688003530 con 0x7f969c0cb120 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 >> v2:172.21.15.169:3300/0 conn(0x7f969c154eb0 msgr2=0x7f969c15eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 --2- 172.21.15.26:0/3717846977 >> v2:172.21.15.169:3300/0 conn(0x7f969c154eb0 0x7f969c15eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 >> v1:172.21.15.169:6789/0 conn(0x7f969c0c7680 legacy=0x7f969c15ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c15b960 con 0x7f969c0cb120 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f9694001a00 con 0x7f969c0cb120 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 >> v1:172.21.15.26:6789/0 conn(0x7f969c0cb120 legacy=0x7f969c0d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96880039c0 0x7f9688003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9688004810 0x7f9688004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96880051d0 0x7f968800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f969c15e130 con 0x7f9688004810 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f968800c170 con 0x7f96880039c0 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f968800c370 con 0x7f96880051d0 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969b7fe640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9688004810 0x7f9688004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969bfff640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96880039c0 0x7f9688003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a09f2640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96880051d0 0x7f968800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969b7fe640 1 -- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96880051d0 msgr2=0x7f968800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969b7fe640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f96880051d0 0x7f968800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969b7fe640 1 -- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96880039c0 msgr2=0x7f9688003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969b7fe640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f96880039c0 0x7f9688003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f969b7fe640 1 -- 172.21.15.26:0/3717846977 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688003530 con 0x7f9688004810 2024-04-21T08:57:49.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.506+0000 7f96a09f2640 1 -- 172.21.15.26:0/3717846977 reap_dead start 2024-04-21T08:57:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969b7fe640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9688004810 0x7f9688004c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9684001780 tx=0x7f968401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ef27c7627eaa79 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96840013a0 con 0x7f9688004810 2024-04-21T08:57:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96840052f0 con 0x7f9688004810 2024-04-21T08:57:49.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969affd640 1 -- 172.21.15.26:0/3717846977 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684003840 con 0x7f9688004810 2024-04-21T08:57:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- 172.21.15.26:0/3717846977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9688004810 msgr2=0x7f9688004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9688004810 0x7f9688004c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9684001780 tx=0x7f968401c400 comp rx=0 tx=0).stop 2024-04-21T08:57:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- 172.21.15.26:0/3717846977 shutdown_connections 2024-04-21T08:57:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 --2- 172.21.15.26:0/3717846977 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9688004810 0x7f9688004c90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- 172.21.15.26:0/3717846977 >> 172.21.15.26:0/3717846977 conn(0x7f969c06dea0 msgr2=0x7f969c06e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- 172.21.15.26:0/3717846977 shutdown_connections 2024-04-21T08:57:49.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- 172.21.15.26:0/3717846977 wait complete. 2024-04-21T08:57:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 Processor -- start 2024-04-21T08:57:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- start start 2024-04-21T08:57:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9688004810 0x7f969c157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0c3990 0x7f969c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f969c1500a0 0x7f969c14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f969c15ef90 con 0x7f969c0c3990 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f969c0d09f0 con 0x7f969c1500a0 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a2455640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f969c0cb970 con 0x7f9688004810 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0c3990 0x7f969c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0c3990 0x7f969c155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53988/0 (socket says 172.21.15.26:53988) 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969b7fe640 1 -- 172.21.15.26:0/1371550645 learned_addr learned my addr 172.21.15.26:0/1371550645 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f969bfff640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9688004810 0x7f969c157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.510+0000 7f96a09f2640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f969c1500a0 0x7f969c14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969b7fe640 1 -- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9688004810 msgr2=0x7f969c157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969b7fe640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9688004810 0x7f969c157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969b7fe640 1 -- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f969c1500a0 msgr2=0x7f969c14e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969b7fe640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f969c1500a0 0x7f969c14e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969b7fe640 1 -- 172.21.15.26:0/1371550645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c1578d0 con 0x7f969c0c3990 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f96a09f2640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f969c1500a0 0x7f969c14e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969b7fe640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0c3990 0x7f969c155750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f968401c230 tx=0x7f9688005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f9698ff9640 1 -- 172.21.15.26:0/1371550645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96840013a0 con 0x7f969c0c3990 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f9698ff9640 1 -- 172.21.15.26:0/1371550645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96840ba070 con 0x7f969c0c3990 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f969c0c6240 con 0x7f969c0c3990 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f9698ff9640 1 -- 172.21.15.26:0/1371550645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9684007a40 con 0x7f969c0c3990 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f969c1595e0 con 0x7f969c0c3990 2024-04-21T08:57:49.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f969c075ef0 con 0x7f969c0c3990 2024-04-21T08:57:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f9698ff9640 1 -- 172.21.15.26:0/1371550645 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9684005290 con 0x7f969c0c3990 2024-04-21T08:57:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f9698ff9640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f967c068380 0x7f967c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f9698ff9640 1 -- 172.21.15.26:0/1371550645 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f96841208f0 con 0x7f969c0c3990 2024-04-21T08:57:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969bfff640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f967c068380 0x7f967c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.514+0000 7f969bfff640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f967c068380 0x7f967c06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f968c009c60 tx=0x7f968c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.518+0000 7f9698ff9640 1 -- 172.21.15.26:0/1371550645 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9684016110 con 0x7f969c0c3990 2024-04-21T08:57:49.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.678+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f969c0b5e40 con 0x7f967c068380 2024-04-21T08:57:49.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.698+0000 7f9698ff9640 1 -- 172.21.15.26:0/1371550645 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251928 (secure 0 0 0) 0x7f969c0b5e40 con 0x7f967c068380 2024-04-21T08:57:49.703 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:49.705 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T08:57:49.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f967c068380 msgr2=0x7f967c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f967c068380 0x7f967c06a840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f968c009c60 tx=0x7f968c009190 comp rx=0 tx=0).stop 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0c3990 msgr2=0x7f969c155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0c3990 0x7f969c155750 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f968401c230 tx=0x7f9688005840 comp rx=0 tx=0).stop 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 shutdown_connections 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f969c1500a0 0x7f969c14e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f967c068380 0x7f967c06a840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f969c0c3990 0x7f969c155750 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 --2- 172.21.15.26:0/1371550645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9688004810 0x7f969c157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 >> 172.21.15.26:0/1371550645 conn(0x7f969c06dea0 msgr2=0x7f969c1508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 shutdown_connections 2024-04-21T08:57:49.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.702+0000 7f96a2455640 1 -- 172.21.15.26:0/1371550645 wait complete. 2024-04-21T08:57:49.721 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-21T08:57:49.124297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234576,"kb_used_data":1760,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740144,"statfs":{"total":773094113280,"available":772853907456,"internally_reserved":0,"allocated":1802240,"data_stored":1768584,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.892987"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478008+0000","last_change":"2024-04-21T08:57:44.312400+0000","last_active":"2024-04-21T08:57:45.478008+0000","last_peered":"2024-04-21T08:57:45.478008+0000","last_clean":"2024-04-21T08:57:45.478008+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T08:57:45.478008+0000","last_undegraded":"2024-04-21T08:57:45.478008+0000","last_fullsized":"2024-04-21T08:57:45.478008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302244+0000","last_change":"2024-04-21T08:57:44.307469+0000","last_active":"2024-04-21T08:57:45.302244+0000","last_peered":"2024-04-21T08:57:45.302244+0000","last_clean":"2024-04-21T08:57:45.302244+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T08:57:45.302244+0000","last_undegraded":"2024-04-21T08:57:45.302244+0000","last_fullsized":"2024-04-21T08:57:45.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301915+0000","last_change":"2024-04-21T08:57:44.283704+0000","last_active":"2024-04-21T08:57:45.301915+0000","last_peered":"2024-04-21T08:57:45.301915+0000","last_clean":"2024-04-21T08:57:45.301915+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T08:57:45.301915+0000","last_undegraded":"2024-04-21T08:57:45.301915+0000","last_fullsized":"2024-04-21T08:57:45.301915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:22:29.477559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474882+0000","last_change":"2024-04-21T08:57:44.297940+0000","last_active":"2024-04-21T08:57:45.474882+0000","last_peered":"2024-04-21T08:57:45.474882+0000","last_clean":"2024-04-21T08:57:45.474882+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T08:57:45.474882+0000","last_undegraded":"2024-04-21T08:57:45.474882+0000","last_fullsized":"2024-04-21T08:57:45.474882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477621+0000","last_change":"2024-04-21T08:57:44.319147+0000","last_active":"2024-04-21T08:57:45.477621+0000","last_peered":"2024-04-21T08:57:45.477621+0000","last_clean":"2024-04-21T08:57:45.477621+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T08:57:45.477621+0000","last_undegraded":"2024-04-21T08:57:45.477621+0000","last_fullsized":"2024-04-21T08:57:45.477621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475406+0000","last_change":"2024-04-21T08:57:44.292228+0000","last_active":"2024-04-21T08:57:45.475406+0000","last_peered":"2024-04-21T08:57:45.475406+0000","last_clean":"2024-04-21T08:57:45.475406+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T08:57:45.475406+0000","last_undegraded":"2024-04-21T08:57:45.475406+0000","last_fullsized":"2024-04-21T08:57:45.475406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476097+0000","last_change":"2024-04-21T08:57:44.307483+0000","last_active":"2024-04-21T08:57:45.476097+0000","last_peered":"2024-04-21T08:57:45.476097+0000","last_clean":"2024-04-21T08:57:45.476097+0000","last_became_active":"2024-04-21T08:57:44.307147+0000","last_became_peered":"2024-04-21T08:57:44.307147+0000","last_unstale":"2024-04-21T08:57:45.476097+0000","last_undegraded":"2024-04-21T08:57:45.476097+0000","last_fullsized":"2024-04-21T08:57:45.476097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301538+0000","last_change":"2024-04-21T08:57:44.316305+0000","last_active":"2024-04-21T08:57:45.301538+0000","last_peered":"2024-04-21T08:57:45.301538+0000","last_clean":"2024-04-21T08:57:45.301538+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T08:57:45.301538+0000","last_undegraded":"2024-04-21T08:57:45.301538+0000","last_fullsized":"2024-04-21T08:57:45.301538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:02.718251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296716+0000","last_change":"2024-04-21T08:57:44.306928+0000","last_active":"2024-04-21T08:57:45.296716+0000","last_peered":"2024-04-21T08:57:45.296716+0000","last_clean":"2024-04-21T08:57:45.296716+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T08:57:45.296716+0000","last_undegraded":"2024-04-21T08:57:45.296716+0000","last_fullsized":"2024-04-21T08:57:45.296716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:47.382588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477106+0000","last_change":"2024-04-21T08:57:44.307925+0000","last_active":"2024-04-21T08:57:45.477106+0000","last_peered":"2024-04-21T08:57:45.477106+0000","last_clean":"2024-04-21T08:57:45.477106+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T08:57:45.477106+0000","last_undegraded":"2024-04-21T08:57:45.477106+0000","last_fullsized":"2024-04-21T08:57:45.477106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475344+0000","last_change":"2024-04-21T08:57:44.312289+0000","last_active":"2024-04-21T08:57:45.475344+0000","last_peered":"2024-04-21T08:57:45.475344+0000","last_clean":"2024-04-21T08:57:45.475344+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T08:57:45.475344+0000","last_undegraded":"2024-04-21T08:57:45.475344+0000","last_fullsized":"2024-04-21T08:57:45.475344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477952+0000","last_change":"2024-04-21T08:57:44.315406+0000","last_active":"2024-04-21T08:57:45.477952+0000","last_peered":"2024-04-21T08:57:45.477952+0000","last_clean":"2024-04-21T08:57:45.477952+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T08:57:45.477952+0000","last_undegraded":"2024-04-21T08:57:45.477952+0000","last_fullsized":"2024-04-21T08:57:45.477952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475316+0000","last_change":"2024-04-21T08:57:44.321357+0000","last_active":"2024-04-21T08:57:45.475316+0000","last_peered":"2024-04-21T08:57:45.475316+0000","last_clean":"2024-04-21T08:57:45.475316+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T08:57:45.475316+0000","last_undegraded":"2024-04-21T08:57:45.475316+0000","last_fullsized":"2024-04-21T08:57:45.475316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:01:59.921966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475445+0000","last_change":"2024-04-21T08:57:44.315428+0000","last_active":"2024-04-21T08:57:45.475445+0000","last_peered":"2024-04-21T08:57:45.475445+0000","last_clean":"2024-04-21T08:57:45.475445+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T08:57:45.475445+0000","last_undegraded":"2024-04-21T08:57:45.475445+0000","last_fullsized":"2024-04-21T08:57:45.475445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301076+0000","last_change":"2024-04-21T08:57:44.285663+0000","last_active":"2024-04-21T08:57:45.301076+0000","last_peered":"2024-04-21T08:57:45.301076+0000","last_clean":"2024-04-21T08:57:45.301076+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T08:57:45.301076+0000","last_undegraded":"2024-04-21T08:57:45.301076+0000","last_fullsized":"2024-04-21T08:57:45.301076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:54:18.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474994+0000","last_change":"2024-04-21T08:57:44.288842+0000","last_active":"2024-04-21T08:57:45.474994+0000","last_peered":"2024-04-21T08:57:45.474994+0000","last_clean":"2024-04-21T08:57:45.474994+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T08:57:45.474994+0000","last_undegraded":"2024-04-21T08:57:45.474994+0000","last_fullsized":"2024-04-21T08:57:45.474994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479022+0000","last_change":"2024-04-21T08:57:44.320371+0000","last_active":"2024-04-21T08:57:45.479022+0000","last_peered":"2024-04-21T08:57:45.479022+0000","last_clean":"2024-04-21T08:57:45.479022+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T08:57:45.479022+0000","last_undegraded":"2024-04-21T08:57:45.479022+0000","last_fullsized":"2024-04-21T08:57:45.479022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:37:23.456724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474849+0000","last_change":"2024-04-21T08:57:44.302161+0000","last_active":"2024-04-21T08:57:45.474849+0000","last_peered":"2024-04-21T08:57:45.474849+0000","last_clean":"2024-04-21T08:57:45.474849+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T08:57:45.474849+0000","last_undegraded":"2024-04-21T08:57:45.474849+0000","last_fullsized":"2024-04-21T08:57:45.474849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478601+0000","last_change":"2024-04-21T08:57:44.289531+0000","last_active":"2024-04-21T08:57:45.478601+0000","last_peered":"2024-04-21T08:57:45.478601+0000","last_clean":"2024-04-21T08:57:45.478601+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T08:57:45.478601+0000","last_undegraded":"2024-04-21T08:57:45.478601+0000","last_fullsized":"2024-04-21T08:57:45.478601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:42:25.869615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477213+0000","last_change":"2024-04-21T08:57:44.315116+0000","last_active":"2024-04-21T08:57:45.477213+0000","last_peered":"2024-04-21T08:57:45.477213+0000","last_clean":"2024-04-21T08:57:45.477213+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T08:57:45.477213+0000","last_undegraded":"2024-04-21T08:57:45.477213+0000","last_fullsized":"2024-04-21T08:57:45.477213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300338+0000","last_change":"2024-04-21T08:57:44.299295+0000","last_active":"2024-04-21T08:57:45.300338+0000","last_peered":"2024-04-21T08:57:45.300338+0000","last_clean":"2024-04-21T08:57:45.300338+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T08:57:45.300338+0000","last_undegraded":"2024-04-21T08:57:45.300338+0000","last_fullsized":"2024-04-21T08:57:45.300338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:32:23.460346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296074+0000","last_change":"2024-04-21T08:57:44.293141+0000","last_active":"2024-04-21T08:57:45.296074+0000","last_peered":"2024-04-21T08:57:45.296074+0000","last_clean":"2024-04-21T08:57:45.296074+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T08:57:45.296074+0000","last_undegraded":"2024-04-21T08:57:45.296074+0000","last_fullsized":"2024-04-21T08:57:45.296074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301628+0000","last_change":"2024-04-21T08:57:44.291347+0000","last_active":"2024-04-21T08:57:45.301628+0000","last_peered":"2024-04-21T08:57:45.301628+0000","last_clean":"2024-04-21T08:57:45.301628+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T08:57:45.301628+0000","last_undegraded":"2024-04-21T08:57:45.301628+0000","last_fullsized":"2024-04-21T08:57:45.301628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:29.349924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475426+0000","last_change":"2024-04-21T08:57:44.283481+0000","last_active":"2024-04-21T08:57:45.475426+0000","last_peered":"2024-04-21T08:57:45.475426+0000","last_clean":"2024-04-21T08:57:45.475426+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T08:57:45.475426+0000","last_undegraded":"2024-04-21T08:57:45.475426+0000","last_fullsized":"2024-04-21T08:57:45.475426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302199+0000","last_change":"2024-04-21T08:57:44.304218+0000","last_active":"2024-04-21T08:57:45.302199+0000","last_peered":"2024-04-21T08:57:45.302199+0000","last_clean":"2024-04-21T08:57:45.302199+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T08:57:45.302199+0000","last_undegraded":"2024-04-21T08:57:45.302199+0000","last_fullsized":"2024-04-21T08:57:45.302199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476814+0000","last_change":"2024-04-21T08:57:44.305569+0000","last_active":"2024-04-21T08:57:45.476814+0000","last_peered":"2024-04-21T08:57:45.476814+0000","last_clean":"2024-04-21T08:57:45.476814+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T08:57:45.476814+0000","last_undegraded":"2024-04-21T08:57:45.476814+0000","last_fullsized":"2024-04-21T08:57:45.476814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476147+0000","last_change":"2024-04-21T08:57:44.314872+0000","last_active":"2024-04-21T08:57:45.476147+0000","last_peered":"2024-04-21T08:57:45.476147+0000","last_clean":"2024-04-21T08:57:45.476147+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T08:57:45.476147+0000","last_undegraded":"2024-04-21T08:57:45.476147+0000","last_fullsized":"2024-04-21T08:57:45.476147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475471+0000","last_change":"2024-04-21T08:57:44.320786+0000","last_active":"2024-04-21T08:57:45.475471+0000","last_peered":"2024-04-21T08:57:45.475471+0000","last_clean":"2024-04-21T08:57:45.475471+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T08:57:45.475471+0000","last_undegraded":"2024-04-21T08:57:45.475471+0000","last_fullsized":"2024-04-21T08:57:45.475471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301360+0000","last_change":"2024-04-21T08:57:44.292576+0000","last_active":"2024-04-21T08:57:45.301360+0000","last_peered":"2024-04-21T08:57:45.301360+0000","last_clean":"2024-04-21T08:57:45.301360+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T08:57:45.301360+0000","last_undegraded":"2024-04-21T08:57:45.301360+0000","last_fullsized":"2024-04-21T08:57:45.301360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:41:15.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476800+0000","last_change":"2024-04-21T08:57:44.301159+0000","last_active":"2024-04-21T08:57:45.476800+0000","last_peered":"2024-04-21T08:57:45.476800+0000","last_clean":"2024-04-21T08:57:45.476800+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T08:57:45.476800+0000","last_undegraded":"2024-04-21T08:57:45.476800+0000","last_fullsized":"2024-04-21T08:57:45.476800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473997+0000","last_change":"2024-04-21T08:57:44.295923+0000","last_active":"2024-04-21T08:57:45.473997+0000","last_peered":"2024-04-21T08:57:45.473997+0000","last_clean":"2024-04-21T08:57:45.473997+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T08:57:45.473997+0000","last_undegraded":"2024-04-21T08:57:45.473997+0000","last_fullsized":"2024-04-21T08:57:45.473997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474254+0000","last_change":"2024-04-21T08:57:44.317457+0000","last_active":"2024-04-21T08:57:45.474254+0000","last_peered":"2024-04-21T08:57:45.474254+0000","last_clean":"2024-04-21T08:57:45.474254+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T08:57:45.474254+0000","last_undegraded":"2024-04-21T08:57:45.474254+0000","last_fullsized":"2024-04-21T08:57:45.474254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:17.843858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296164+0000","last_change":"2024-04-21T08:57:44.293278+0000","last_active":"2024-04-21T08:57:45.296164+0000","last_peered":"2024-04-21T08:57:45.296164+0000","last_clean":"2024-04-21T08:57:45.296164+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T08:57:45.296164+0000","last_undegraded":"2024-04-21T08:57:45.296164+0000","last_fullsized":"2024-04-21T08:57:45.296164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301713+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T08:57:45.301713+0000","last_peered":"2024-04-21T08:57:45.301713+0000","last_clean":"2024-04-21T08:57:45.301713+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T08:57:45.301713+0000","last_undegraded":"2024-04-21T08:57:45.301713+0000","last_fullsized":"2024-04-21T08:57:45.301713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300238+0000","last_change":"2024-04-21T08:57:44.308011+0000","last_active":"2024-04-21T08:57:45.300238+0000","last_peered":"2024-04-21T08:57:45.300238+0000","last_clean":"2024-04-21T08:57:45.300238+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T08:57:45.300238+0000","last_undegraded":"2024-04-21T08:57:45.300238+0000","last_fullsized":"2024-04-21T08:57:45.300238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:45.396672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478165+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T08:57:45.478165+0000","last_peered":"2024-04-21T08:57:45.478165+0000","last_clean":"2024-04-21T08:57:45.478165+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T08:57:45.478165+0000","last_undegraded":"2024-04-21T08:57:45.478165+0000","last_fullsized":"2024-04-21T08:57:45.478165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475213+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T08:57:45.475213+0000","last_peered":"2024-04-21T08:57:45.475213+0000","last_clean":"2024-04-21T08:57:45.475213+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T08:57:45.475213+0000","last_undegraded":"2024-04-21T08:57:45.475213+0000","last_fullsized":"2024-04-21T08:57:45.475213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302334+0000","last_change":"2024-04-21T08:57:44.307616+0000","last_active":"2024-04-21T08:57:45.302334+0000","last_peered":"2024-04-21T08:57:45.302334+0000","last_clean":"2024-04-21T08:57:45.302334+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T08:57:45.302334+0000","last_undegraded":"2024-04-21T08:57:45.302334+0000","last_fullsized":"2024-04-21T08:57:45.302334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475348+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T08:57:45.475348+0000","last_peered":"2024-04-21T08:57:45.475348+0000","last_clean":"2024-04-21T08:57:45.475348+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T08:57:45.475348+0000","last_undegraded":"2024-04-21T08:57:45.475348+0000","last_fullsized":"2024-04-21T08:57:45.475348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300102+0000","last_change":"2024-04-21T08:57:44.285516+0000","last_active":"2024-04-21T08:57:45.300102+0000","last_peered":"2024-04-21T08:57:45.300102+0000","last_clean":"2024-04-21T08:57:45.300102+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T08:57:45.300102+0000","last_undegraded":"2024-04-21T08:57:45.300102+0000","last_fullsized":"2024-04-21T08:57:45.300102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296625+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T08:57:45.296625+0000","last_peered":"2024-04-21T08:57:45.296625+0000","last_clean":"2024-04-21T08:57:45.296625+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T08:57:45.296625+0000","last_undegraded":"2024-04-21T08:57:45.296625+0000","last_fullsized":"2024-04-21T08:57:45.296625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477228+0000","last_change":"2024-04-21T08:57:44.305837+0000","last_active":"2024-04-21T08:57:45.477228+0000","last_peered":"2024-04-21T08:57:45.477228+0000","last_clean":"2024-04-21T08:57:45.477228+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T08:57:45.477228+0000","last_undegraded":"2024-04-21T08:57:45.477228+0000","last_fullsized":"2024-04-21T08:57:45.477228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477323+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T08:57:45.477323+0000","last_peered":"2024-04-21T08:57:45.477323+0000","last_clean":"2024-04-21T08:57:45.477323+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T08:57:45.477323+0000","last_undegraded":"2024-04-21T08:57:45.477323+0000","last_fullsized":"2024-04-21T08:57:45.477323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302616+0000","last_change":"2024-04-21T08:57:44.305156+0000","last_active":"2024-04-21T08:57:45.302616+0000","last_peered":"2024-04-21T08:57:45.302616+0000","last_clean":"2024-04-21T08:57:45.302616+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T08:57:45.302616+0000","last_undegraded":"2024-04-21T08:57:45.302616+0000","last_fullsized":"2024-04-21T08:57:45.302616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474495+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T08:57:45.474495+0000","last_peered":"2024-04-21T08:57:45.474495+0000","last_clean":"2024-04-21T08:57:45.474495+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T08:57:45.474495+0000","last_undegraded":"2024-04-21T08:57:45.474495+0000","last_fullsized":"2024-04-21T08:57:45.474495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476386+0000","last_change":"2024-04-21T08:57:44.296804+0000","last_active":"2024-04-21T08:57:45.476386+0000","last_peered":"2024-04-21T08:57:45.476386+0000","last_clean":"2024-04-21T08:57:45.476386+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T08:57:45.476386+0000","last_undegraded":"2024-04-21T08:57:45.476386+0000","last_fullsized":"2024-04-21T08:57:45.476386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475031+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T08:57:45.475031+0000","last_peered":"2024-04-21T08:57:45.475031+0000","last_clean":"2024-04-21T08:57:45.475031+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T08:57:45.475031+0000","last_undegraded":"2024-04-21T08:57:45.475031+0000","last_fullsized":"2024-04-21T08:57:45.475031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475742+0000","last_change":"2024-04-21T08:57:44.323678+0000","last_active":"2024-04-21T08:57:45.475742+0000","last_peered":"2024-04-21T08:57:45.475742+0000","last_clean":"2024-04-21T08:57:45.475742+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T08:57:45.475742+0000","last_undegraded":"2024-04-21T08:57:45.475742+0000","last_fullsized":"2024-04-21T08:57:45.475742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474367+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T08:57:45.474367+0000","last_peered":"2024-04-21T08:57:45.474367+0000","last_clean":"2024-04-21T08:57:45.474367+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T08:57:45.474367+0000","last_undegraded":"2024-04-21T08:57:45.474367+0000","last_fullsized":"2024-04-21T08:57:45.474367+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475320+0000","last_change":"2024-04-21T08:57:44.310092+0000","last_active":"2024-04-21T08:57:45.475320+0000","last_peered":"2024-04-21T08:57:45.475320+0000","last_clean":"2024-04-21T08:57:45.475320+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T08:57:45.475320+0000","last_undegraded":"2024-04-21T08:57:45.475320+0000","last_fullsized":"2024-04-21T08:57:45.475320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:03.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478308+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T08:57:45.478308+0000","last_peered":"2024-04-21T08:57:45.478308+0000","last_clean":"2024-04-21T08:57:45.478308+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T08:57:45.478308+0000","last_undegraded":"2024-04-21T08:57:45.478308+0000","last_fullsized":"2024-04-21T08:57:45.478308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477225+0000","last_change":"2024-04-21T08:57:44.320598+0000","last_active":"2024-04-21T08:57:45.477225+0000","last_peered":"2024-04-21T08:57:45.477225+0000","last_clean":"2024-04-21T08:57:45.477225+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T08:57:45.477225+0000","last_undegraded":"2024-04-21T08:57:45.477225+0000","last_fullsized":"2024-04-21T08:57:45.477225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:51.743927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476234+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T08:57:45.476234+0000","last_peered":"2024-04-21T08:57:45.476234+0000","last_clean":"2024-04-21T08:57:45.476234+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T08:57:45.476234+0000","last_undegraded":"2024-04-21T08:57:45.476234+0000","last_fullsized":"2024-04-21T08:57:45.476234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295791+0000","last_change":"2024-04-21T08:57:44.292658+0000","last_active":"2024-04-21T08:57:45.295791+0000","last_peered":"2024-04-21T08:57:45.295791+0000","last_clean":"2024-04-21T08:57:45.295791+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T08:57:45.295791+0000","last_undegraded":"2024-04-21T08:57:45.295791+0000","last_fullsized":"2024-04-21T08:57:45.295791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300452+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T08:57:45.300452+0000","last_peered":"2024-04-21T08:57:45.300452+0000","last_clean":"2024-04-21T08:57:45.300452+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T08:57:45.300452+0000","last_undegraded":"2024-04-21T08:57:45.300452+0000","last_fullsized":"2024-04-21T08:57:45.300452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475925+0000","last_change":"2024-04-21T08:57:44.289358+0000","last_active":"2024-04-21T08:57:45.475925+0000","last_peered":"2024-04-21T08:57:45.475925+0000","last_clean":"2024-04-21T08:57:45.475925+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T08:57:45.475925+0000","last_undegraded":"2024-04-21T08:57:45.475925+0000","last_fullsized":"2024-04-21T08:57:45.475925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478105+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T08:57:45.478105+0000","last_peered":"2024-04-21T08:57:45.478105+0000","last_clean":"2024-04-21T08:57:45.478105+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T08:57:45.478105+0000","last_undegraded":"2024-04-21T08:57:45.478105+0000","last_fullsized":"2024-04-21T08:57:45.478105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477620+0000","last_change":"2024-04-21T08:57:44.321062+0000","last_active":"2024-04-21T08:57:45.477620+0000","last_peered":"2024-04-21T08:57:45.477620+0000","last_clean":"2024-04-21T08:57:45.477620+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T08:57:45.477620+0000","last_undegraded":"2024-04-21T08:57:45.477620+0000","last_fullsized":"2024-04-21T08:57:45.477620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300838+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T08:57:45.300838+0000","last_peered":"2024-04-21T08:57:45.300838+0000","last_clean":"2024-04-21T08:57:45.300838+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T08:57:45.300838+0000","last_undegraded":"2024-04-21T08:57:45.300838+0000","last_fullsized":"2024-04-21T08:57:45.300838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477974+0000","last_change":"2024-04-21T08:57:44.315764+0000","last_active":"2024-04-21T08:57:45.477974+0000","last_peered":"2024-04-21T08:57:45.477974+0000","last_clean":"2024-04-21T08:57:45.477974+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T08:57:45.477974+0000","last_undegraded":"2024-04-21T08:57:45.477974+0000","last_fullsized":"2024-04-21T08:57:45.477974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302175+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T08:57:45.302175+0000","last_peered":"2024-04-21T08:57:45.302175+0000","last_clean":"2024-04-21T08:57:45.302175+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T08:57:45.302175+0000","last_undegraded":"2024-04-21T08:57:45.302175+0000","last_fullsized":"2024-04-21T08:57:45.302175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477623+0000","last_change":"2024-04-21T08:57:44.315316+0000","last_active":"2024-04-21T08:57:45.477623+0000","last_peered":"2024-04-21T08:57:45.477623+0000","last_clean":"2024-04-21T08:57:45.477623+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T08:57:45.477623+0000","last_undegraded":"2024-04-21T08:57:45.477623+0000","last_fullsized":"2024-04-21T08:57:45.477623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475756+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T08:57:45.475756+0000","last_peered":"2024-04-21T08:57:45.475756+0000","last_clean":"2024-04-21T08:57:45.475756+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T08:57:45.475756+0000","last_undegraded":"2024-04-21T08:57:45.475756+0000","last_fullsized":"2024-04-21T08:57:45.475756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478318+0000","last_change":"2024-04-21T08:57:44.298472+0000","last_active":"2024-04-21T08:57:45.478318+0000","last_peered":"2024-04-21T08:57:45.478318+0000","last_clean":"2024-04-21T08:57:45.478318+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T08:57:45.478318+0000","last_undegraded":"2024-04-21T08:57:45.478318+0000","last_fullsized":"2024-04-21T08:57:45.478318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:14:06.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295542+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T08:57:45.295542+0000","last_peered":"2024-04-21T08:57:45.295542+0000","last_clean":"2024-04-21T08:57:45.295542+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T08:57:45.295542+0000","last_undegraded":"2024-04-21T08:57:45.295542+0000","last_fullsized":"2024-04-21T08:57:45.295542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477601+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T08:57:45.477601+0000","last_peered":"2024-04-21T08:57:45.477601+0000","last_clean":"2024-04-21T08:57:45.477601+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T08:57:45.477601+0000","last_undegraded":"2024-04-21T08:57:45.477601+0000","last_fullsized":"2024-04-21T08:57:45.477601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300093+0000","last_change":"2024-04-21T08:57:44.289877+0000","last_active":"2024-04-21T08:57:45.300093+0000","last_peered":"2024-04-21T08:57:45.300093+0000","last_clean":"2024-04-21T08:57:45.300093+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T08:57:45.300093+0000","last_undegraded":"2024-04-21T08:57:45.300093+0000","last_fullsized":"2024-04-21T08:57:45.300093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475561+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T08:57:45.475561+0000","last_peered":"2024-04-21T08:57:45.475561+0000","last_clean":"2024-04-21T08:57:45.475561+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T08:57:45.475561+0000","last_undegraded":"2024-04-21T08:57:45.475561+0000","last_fullsized":"2024-04-21T08:57:45.475561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474956+0000","last_change":"2024-04-21T08:57:44.309539+0000","last_active":"2024-04-21T08:57:45.474956+0000","last_peered":"2024-04-21T08:57:45.474956+0000","last_clean":"2024-04-21T08:57:45.474956+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T08:57:45.474956+0000","last_undegraded":"2024-04-21T08:57:45.474956+0000","last_fullsized":"2024-04-21T08:57:45.474956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:47:34.419511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473930+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T08:57:45.473930+0000","last_peered":"2024-04-21T08:57:45.473930+0000","last_clean":"2024-04-21T08:57:45.473930+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T08:57:45.473930+0000","last_undegraded":"2024-04-21T08:57:45.473930+0000","last_fullsized":"2024-04-21T08:57:45.473930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301947+0000","last_change":"2024-04-21T08:57:44.298533+0000","last_active":"2024-04-21T08:57:45.301947+0000","last_peered":"2024-04-21T08:57:45.301947+0000","last_clean":"2024-04-21T08:57:45.301947+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T08:57:45.301947+0000","last_undegraded":"2024-04-21T08:57:45.301947+0000","last_fullsized":"2024-04-21T08:57:45.301947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478433+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T08:57:45.478433+0000","last_peered":"2024-04-21T08:57:45.478433+0000","last_clean":"2024-04-21T08:57:45.478433+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T08:57:45.478433+0000","last_undegraded":"2024-04-21T08:57:45.478433+0000","last_fullsized":"2024-04-21T08:57:45.478433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477998+0000","last_change":"2024-04-21T08:57:44.315633+0000","last_active":"2024-04-21T08:57:45.477998+0000","last_peered":"2024-04-21T08:57:45.477998+0000","last_clean":"2024-04-21T08:57:45.477998+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T08:57:45.477998+0000","last_undegraded":"2024-04-21T08:57:45.477998+0000","last_fullsized":"2024-04-21T08:57:45.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301760+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T08:57:45.301760+0000","last_peered":"2024-04-21T08:57:45.301760+0000","last_clean":"2024-04-21T08:57:45.301760+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T08:57:45.301760+0000","last_undegraded":"2024-04-21T08:57:45.301760+0000","last_fullsized":"2024-04-21T08:57:45.301760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475775+0000","last_change":"2024-04-21T08:57:44.318478+0000","last_active":"2024-04-21T08:57:45.475775+0000","last_peered":"2024-04-21T08:57:45.475775+0000","last_clean":"2024-04-21T08:57:45.475775+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T08:57:45.475775+0000","last_undegraded":"2024-04-21T08:57:45.475775+0000","last_fullsized":"2024-04-21T08:57:45.475775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478561+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T08:57:45.478561+0000","last_peered":"2024-04-21T08:57:45.478561+0000","last_clean":"2024-04-21T08:57:45.478561+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T08:57:45.478561+0000","last_undegraded":"2024-04-21T08:57:45.478561+0000","last_fullsized":"2024-04-21T08:57:45.478561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475343+0000","last_change":"2024-04-21T08:57:44.305172+0000","last_active":"2024-04-21T08:57:45.475343+0000","last_peered":"2024-04-21T08:57:45.475343+0000","last_clean":"2024-04-21T08:57:45.475343+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T08:57:45.475343+0000","last_undegraded":"2024-04-21T08:57:45.475343+0000","last_fullsized":"2024-04-21T08:57:45.475343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:13:46.282333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301089+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T08:57:45.301089+0000","last_peered":"2024-04-21T08:57:45.301089+0000","last_clean":"2024-04-21T08:57:45.301089+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T08:57:45.301089+0000","last_undegraded":"2024-04-21T08:57:45.301089+0000","last_fullsized":"2024-04-21T08:57:45.301089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300739+0000","last_change":"2024-04-21T08:57:44.311283+0000","last_active":"2024-04-21T08:57:45.300739+0000","last_peered":"2024-04-21T08:57:45.300739+0000","last_clean":"2024-04-21T08:57:45.300739+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T08:57:45.300739+0000","last_undegraded":"2024-04-21T08:57:45.300739+0000","last_fullsized":"2024-04-21T08:57:45.300739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:06:14.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479036+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T08:57:45.479036+0000","last_peered":"2024-04-21T08:57:45.479036+0000","last_clean":"2024-04-21T08:57:45.479036+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T08:57:45.479036+0000","last_undegraded":"2024-04-21T08:57:45.479036+0000","last_fullsized":"2024-04-21T08:57:45.479036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300568+0000","last_change":"2024-04-21T08:57:44.293449+0000","last_active":"2024-04-21T08:57:45.300568+0000","last_peered":"2024-04-21T08:57:45.300568+0000","last_clean":"2024-04-21T08:57:45.300568+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T08:57:45.300568+0000","last_undegraded":"2024-04-21T08:57:45.300568+0000","last_fullsized":"2024-04-21T08:57:45.300568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:13:04.768707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474913+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T08:57:45.474913+0000","last_peered":"2024-04-21T08:57:45.474913+0000","last_clean":"2024-04-21T08:57:45.474913+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T08:57:45.474913+0000","last_undegraded":"2024-04-21T08:57:45.474913+0000","last_fullsized":"2024-04-21T08:57:45.474913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476103+0000","last_change":"2024-04-21T08:57:44.294831+0000","last_active":"2024-04-21T08:57:45.476103+0000","last_peered":"2024-04-21T08:57:45.476103+0000","last_clean":"2024-04-21T08:57:45.476103+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T08:57:45.476103+0000","last_undegraded":"2024-04-21T08:57:45.476103+0000","last_fullsized":"2024-04-21T08:57:45.476103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300649+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T08:57:45.300649+0000","last_peered":"2024-04-21T08:57:45.300649+0000","last_clean":"2024-04-21T08:57:45.300649+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T08:57:45.300649+0000","last_undegraded":"2024-04-21T08:57:45.300649+0000","last_fullsized":"2024-04-21T08:57:45.300649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.299620+0000","last_change":"2024-04-21T08:57:44.299090+0000","last_active":"2024-04-21T08:57:45.299620+0000","last_peered":"2024-04-21T08:57:45.299620+0000","last_clean":"2024-04-21T08:57:45.299620+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T08:57:45.299620+0000","last_undegraded":"2024-04-21T08:57:45.299620+0000","last_fullsized":"2024-04-21T08:57:45.299620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475613+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T08:57:45.475613+0000","last_peered":"2024-04-21T08:57:45.475613+0000","last_clean":"2024-04-21T08:57:45.475613+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T08:57:45.475613+0000","last_undegraded":"2024-04-21T08:57:45.475613+0000","last_fullsized":"2024-04-21T08:57:45.475613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474385+0000","last_change":"2024-04-21T08:57:44.317697+0000","last_active":"2024-04-21T08:57:45.474385+0000","last_peered":"2024-04-21T08:57:45.474385+0000","last_clean":"2024-04-21T08:57:45.474385+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T08:57:45.474385+0000","last_undegraded":"2024-04-21T08:57:45.474385+0000","last_fullsized":"2024-04-21T08:57:45.474385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477353+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T08:57:45.477353+0000","last_peered":"2024-04-21T08:57:45.477353+0000","last_clean":"2024-04-21T08:57:45.477353+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T08:57:45.477353+0000","last_undegraded":"2024-04-21T08:57:45.477353+0000","last_fullsized":"2024-04-21T08:57:45.477353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478072+0000","last_change":"2024-04-21T08:57:44.300498+0000","last_active":"2024-04-21T08:57:45.478072+0000","last_peered":"2024-04-21T08:57:45.478072+0000","last_clean":"2024-04-21T08:57:45.478072+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T08:57:45.478072+0000","last_undegraded":"2024-04-21T08:57:45.478072+0000","last_fullsized":"2024-04-21T08:57:45.478072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:36:51.242004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478121+0000","last_change":"2024-04-21T08:57:44.321085+0000","last_active":"2024-04-21T08:57:45.478121+0000","last_peered":"2024-04-21T08:57:45.478121+0000","last_clean":"2024-04-21T08:57:45.478121+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T08:57:45.478121+0000","last_undegraded":"2024-04-21T08:57:45.478121+0000","last_fullsized":"2024-04-21T08:57:45.478121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:49.754472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477804+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T08:57:45.477804+0000","last_peered":"2024-04-21T08:57:45.477804+0000","last_clean":"2024-04-21T08:57:45.477804+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T08:57:45.477804+0000","last_undegraded":"2024-04-21T08:57:45.477804+0000","last_fullsized":"2024-04-21T08:57:45.477804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296663+0000","last_change":"2024-04-21T08:57:44.315810+0000","last_active":"2024-04-21T08:57:45.296663+0000","last_peered":"2024-04-21T08:57:45.296663+0000","last_clean":"2024-04-21T08:57:45.296663+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T08:57:45.296663+0000","last_undegraded":"2024-04-21T08:57:45.296663+0000","last_fullsized":"2024-04-21T08:57:45.296663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475884+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T08:57:45.475884+0000","last_peered":"2024-04-21T08:57:45.475884+0000","last_clean":"2024-04-21T08:57:45.475884+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T08:57:45.475884+0000","last_undegraded":"2024-04-21T08:57:45.475884+0000","last_fullsized":"2024-04-21T08:57:45.475884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302388+0000","last_change":"2024-04-21T08:57:44.303912+0000","last_active":"2024-04-21T08:57:45.302388+0000","last_peered":"2024-04-21T08:57:45.302388+0000","last_clean":"2024-04-21T08:57:45.302388+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T08:57:45.302388+0000","last_undegraded":"2024-04-21T08:57:45.302388+0000","last_fullsized":"2024-04-21T08:57:45.302388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302471+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T08:57:45.302471+0000","last_peered":"2024-04-21T08:57:45.302471+0000","last_clean":"2024-04-21T08:57:45.302471+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T08:57:45.302471+0000","last_undegraded":"2024-04-21T08:57:45.302471+0000","last_fullsized":"2024-04-21T08:57:45.302471+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302272+0000","last_change":"2024-04-21T08:57:44.301951+0000","last_active":"2024-04-21T08:57:45.302272+0000","last_peered":"2024-04-21T08:57:45.302272+0000","last_clean":"2024-04-21T08:57:45.302272+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T08:57:45.302272+0000","last_undegraded":"2024-04-21T08:57:45.302272+0000","last_fullsized":"2024-04-21T08:57:45.302272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300925+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T08:57:45.300925+0000","last_peered":"2024-04-21T08:57:45.300925+0000","last_clean":"2024-04-21T08:57:45.300925+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T08:57:45.300925+0000","last_undegraded":"2024-04-21T08:57:45.300925+0000","last_fullsized":"2024-04-21T08:57:45.300925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509444,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":274432,"data_stored":663849,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542147,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":663849,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T08:57:49.725 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-21T08:57:49.725 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-21T08:57:49.725 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-21T08:57:49.726 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-21T08:57:49.726 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-21T08:57:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.886+0000 7f59c4d93640 1 Processor -- start 2024-04-21T08:57:49.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.886+0000 7f59c4d93640 1 -- start start 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59c4d93640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 0x7f59c01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59c4d93640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c015be10 con 0x7f59c0159600 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59c4d93640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c0159a30 con 0x7f59c015b320 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59c4d93640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f59c00c4c20 con 0x7f59c00c5e30 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59c0159600 0x7f59c0157b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42306/0 (socket says 172.21.15.26:42306) 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 -- 172.21.15.26:0/2177186825 learned_addr learned my addr 172.21.15.26:0/2177186825 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bdd9b640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 0x7f59c01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1881620694 0 0) 0x7f59c015be10 con 0x7f59c0159600 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a8003530 con 0x7f59c0159600 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1648738347 0 0) 0x7f59a8003530 con 0x7f59c0159600 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 msgr2=0x7f59c01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 0x7f59c01590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 >> v1:172.21.15.169:6789/0 conn(0x7f59c015b320 legacy=0x7f59c015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c00c4f00 con 0x7f59c0159600 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f59b8001a00 con 0x7f59c0159600 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 >> v1:172.21.15.26:6789/0 conn(0x7f59c0159600 legacy=0x7f59c0157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a80039f0 0x7f59a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 0x7f59a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59a8004d50 0x7f59a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00c4c20 con 0x7f59a8004d50 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59a800bb40 con 0x7f59a80039f0 2024-04-21T08:57:49.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f59a800bd40 con 0x7f59c00c5e30 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59a8004d50 0x7f59a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59be59c640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a80039f0 0x7f59a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bdd9b640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 0x7f59a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 -- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 msgr2=0x7f59a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 0x7f59a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 -- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a80039f0 msgr2=0x7f59a8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a80039f0 0x7f59a8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bed9d640 1 -- 172.21.15.26:0/2177186825 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a8003530 con 0x7f59a8004d50 2024-04-21T08:57:49.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.890+0000 7f59bdd9b640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c00c5e30 0x7f59a8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:49.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59a8004d50 0x7f59a80051d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59b8002240 tx=0x7f59b801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682fb7e508e70a4f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b800a4a0 con 0x7f59a8004d50 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b80ad650 con 0x7f59a8004d50 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bd59a640 1 -- 172.21.15.26:0/2177186825 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80ada40 con 0x7f59a8004d50 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- 172.21.15.26:0/2177186825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59a8004d50 msgr2=0x7f59a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 --2- 172.21.15.26:0/2177186825 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59a8004d50 0x7f59a80051d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f59b8002240 tx=0x7f59b801d360 comp rx=0 tx=0).stop 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 -- 172.21.15.26:0/2177186825 reap_dead start 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- 172.21.15.26:0/2177186825 shutdown_connections 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- 172.21.15.26:0/2177186825 >> 172.21.15.26:0/2177186825 conn(0x7f59c00c8960 msgr2=0x7f59c00c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- 172.21.15.26:0/2177186825 shutdown_connections 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- 172.21.15.26:0/2177186825 wait complete. 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 Processor -- start 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- start start 2024-04-21T08:57:49.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8004d50 0x7f59c01494e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c0071ec0 0x7f59c0150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c014b260 0x7f59c014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00c57a0 con 0x7f59c014b260 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00c54c0 con 0x7f59a8004d50 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59c4d93640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f59c00bfa30 con 0x7f59c0071ec0 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c014b260 0x7f59c014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c014b260 0x7f59c014b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54008/0 (socket says 172.21.15.26:54008) 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 -- 172.21.15.26:0/1823803081 learned_addr learned my addr 172.21.15.26:0/1823803081 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bdd9b640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c0071ec0 0x7f59c0150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59be59c640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8004d50 0x7f59c01494e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 -- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c0071ec0 msgr2=0x7f59c0150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c0071ec0 0x7f59c0150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 -- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8004d50 msgr2=0x7f59c01494e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8004d50 0x7f59c01494e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 -- 172.21.15.26:0/1823803081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c0149f30 con 0x7f59c014b260 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59bed9d640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c014b260 0x7f59c014b6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59b801cdd0 tx=0x7f59a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59aeffd640 1 -- 172.21.15.26:0/1823803081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80be070 con 0x7f59c014b260 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.894+0000 7f59aeffd640 1 -- 172.21.15.26:0/1823803081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b80b3040 con 0x7f59c014b260 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c014a210 con 0x7f59c014b260 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59aeffd640 1 -- 172.21.15.26:0/1823803081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b800a480 con 0x7f59c014b260 2024-04-21T08:57:49.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c014a7d0 con 0x7f59c014b260 2024-04-21T08:57:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c0075ef0 con 0x7f59c014b260 2024-04-21T08:57:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59aeffd640 1 -- 172.21.15.26:0/1823803081 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59b80c1070 con 0x7f59c014b260 2024-04-21T08:57:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59aeffd640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f59a0068380 0x7f59a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59aeffd640 1 -- 172.21.15.26:0/1823803081 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f59b8121330 con 0x7f59c014b260 2024-04-21T08:57:49.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59be59c640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f59a0068380 0x7f59a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:49.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.898+0000 7f59be59c640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f59a0068380 0x7f59a006a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59b0007fd0 tx=0x7f59b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:49.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:49.902+0000 7f59aeffd640 1 -- 172.21.15.26:0/1823803081 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59b8017070 con 0x7f59c014b260 2024-04-21T08:57:50.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.106+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f59c01e34b0 con 0x7f59c014b260 2024-04-21T08:57:50.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.110+0000 7f59aeffd640 1 -- 172.21.15.26:0/1823803081 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168092 (secure 0 0 0) 0x7f59b80f18f0 con 0x7f59c014b260 2024-04-21T08:57:50.115 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f59a0068380 msgr2=0x7f59a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f59a0068380 0x7f59a006a840 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f59b0007fd0 tx=0x7f59b0009040 comp rx=0 tx=0).stop 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c014b260 msgr2=0x7f59c014b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c014b260 0x7f59c014b6e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f59b801cdd0 tx=0x7f59a8005840 comp rx=0 tx=0).stop 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 shutdown_connections 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f59a0068380 0x7f59a006a840 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59c014b260 0x7f59c014b6e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f59c0071ec0 0x7f59c0150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 --2- 172.21.15.26:0/1823803081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f59a8004d50 0x7f59c01494e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 >> 172.21.15.26:0/1823803081 conn(0x7f59c00c8960 msgr2=0x7f59c015a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 shutdown_connections 2024-04-21T08:57:50.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.114+0000 7f59c4d93640 1 -- 172.21.15.26:0/1823803081 wait complete. 2024-04-21T08:57:50.133 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":1629244554},{"type":"v1","addr":"172.21.15.169:6833","nonce":1629244554}]},"active_addr":"172.21.15.169:6833/1629244554","active_change":"2024-04-21T08:57:31.110995+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":2673431469}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1264706091}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":1414992256}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.169:0","nonce":2464357671}]}]} 2024-04-21T08:57:50.137 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-21T08:57:50.137 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-21T08:57:50.137 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:50.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.250+0000 7f41c55f7640 1 Processor -- start 2024-04-21T08:57:50.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.250+0000 7f41c55f7640 1 -- start start 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41c55f7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f41c01597d0 0x7f41c0162670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41c55f7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c015be10 con 0x7f41c00c5e30 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41c55f7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41c00c4c20 con 0x7f41c015b320 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41c55f7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f41c00c4f00 con 0x7f41c01597d0 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41be7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f41c00c5e30 0x7f41c01590c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42322/0 (socket says 172.21.15.26:42322) 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41be7fc640 1 -- 172.21.15.26:0/1940980805 learned_addr learned my addr 172.21.15.26:0/1940980805 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bf7fe640 1 --2- 172.21.15.26:0/1940980805 >> v2:172.21.15.169:3300/0 conn(0x7f41c01597d0 0x7f41c0162670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923493901 0 0) 0x7f41c015be10 con 0x7f41c00c5e30 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41ac005740 con 0x7f41c00c5e30 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 756960545 0 0) 0x7f41ac005740 con 0x7f41c00c5e30 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 >> v2:172.21.15.169:3300/0 conn(0x7f41c01597d0 msgr2=0x7f41c0162670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 --2- 172.21.15.26:0/1940980805 >> v2:172.21.15.169:3300/0 conn(0x7f41c01597d0 0x7f41c0162670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 >> v1:172.21.15.169:6789/0 conn(0x7f41c015b320 legacy=0x7f41c015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c00c51e0 con 0x7f41c00c5e30 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f41a8001a00 con 0x7f41c00c5e30 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 >> v1:172.21.15.26:6789/0 conn(0x7f41c00c5e30 legacy=0x7f41c01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41ac005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41ac006a20 0x7f41ac006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac0073e0 0x7f41ac00dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00c4f00 con 0x7f41ac005bd0 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41ac00e290 con 0x7f41ac0073e0 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41ac00e490 con 0x7f41ac006a20 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41beffd640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41ac005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41be7fc640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41ac006a20 0x7f41ac006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bf7fe640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac0073e0 0x7f41ac00dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41beffd640 1 -- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41ac006a20 msgr2=0x7f41ac006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41beffd640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41ac006a20 0x7f41ac006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41beffd640 1 -- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac0073e0 msgr2=0x7f41ac00dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41beffd640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac0073e0 0x7f41ac00dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41beffd640 1 -- 172.21.15.26:0/1940980805 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ac005740 con 0x7f41ac005bd0 2024-04-21T08:57:50.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bf7fe640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41ac0073e0 0x7f41ac00dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:50.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.254+0000 7f41bf7fe640 1 -- 172.21.15.26:0/1940980805 reap_dead start 2024-04-21T08:57:50.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41ac005ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41b0001780 tx=0x7f41b001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed32ff05a954479 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00013a0 con 0x7f41ac005bd0 2024-04-21T08:57:50.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00052f0 con 0x7f41ac005bd0 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41bdffb640 1 -- 172.21.15.26:0/1940980805 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0003840 con 0x7f41ac005bd0 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- 172.21.15.26:0/1940980805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 msgr2=0x7f41ac005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41ac005ff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f41b0001780 tx=0x7f41b001c400 comp rx=0 tx=0).stop 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- 172.21.15.26:0/1940980805 shutdown_connections 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 --2- 172.21.15.26:0/1940980805 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41ac005ff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- 172.21.15.26:0/1940980805 >> 172.21.15.26:0/1940980805 conn(0x7f41c00c8960 msgr2=0x7f41c00c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- 172.21.15.26:0/1940980805 shutdown_connections 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- 172.21.15.26:0/1940980805 wait complete. 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 Processor -- start 2024-04-21T08:57:50.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- start start 2024-04-21T08:57:50.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41c01ece20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c01505a0 0x7f41c00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c014fab0 0x7f41c014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00bfa30 con 0x7f41ac005bd0 2024-04-21T08:57:50.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41c00c57a0 con 0x7f41c01505a0 2024-04-21T08:57:50.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41c00c9710 con 0x7f41c014fab0 2024-04-21T08:57:50.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41c01ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41c01ece20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54028/0 (socket says 172.21.15.26:54028) 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 -- 172.21.15.26:0/4204612888 learned_addr learned my addr 172.21.15.26:0/4204612888 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41be7fc640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c01505a0 0x7f41c00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41bf7fe640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c014fab0 0x7f41c014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 -- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c014fab0 msgr2=0x7f41c014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c014fab0 0x7f41c014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 -- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c01505a0 msgr2=0x7f41c00cb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c01505a0 0x7f41c00cb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 -- 172.21.15.26:0/4204612888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41c01ed360 con 0x7f41ac005bd0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41beffd640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41c01ece20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41b001c230 tx=0x7f41ac007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41b77fe640 1 -- 172.21.15.26:0/4204612888 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00013a0 con 0x7f41ac005bd0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41b77fe640 1 -- 172.21.15.26:0/4204612888 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00ba070 con 0x7f41ac005bd0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41c00bfc20 con 0x7f41ac005bd0 2024-04-21T08:57:50.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41b77fe640 1 -- 172.21.15.26:0/4204612888 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0007a40 con 0x7f41ac005bd0 2024-04-21T08:57:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.258+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41c0150de0 con 0x7f41ac005bd0 2024-04-21T08:57:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.262+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41c0075ef0 con 0x7f41ac005bd0 2024-04-21T08:57:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.262+0000 7f41b77fe640 1 -- 172.21.15.26:0/4204612888 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41b00052f0 con 0x7f41ac005bd0 2024-04-21T08:57:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.262+0000 7f41b77fe640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f41a0068380 0x7f41a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.262+0000 7f41b77fe640 1 -- 172.21.15.26:0/4204612888 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f41b0121030 con 0x7f41ac005bd0 2024-04-21T08:57:50.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.262+0000 7f41be7fc640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f41a0068380 0x7f41a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.262+0000 7f41be7fc640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f41a0068380 0x7f41a006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41c01585b0 tx=0x7f41a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.266+0000 7f41b77fe640 1 -- 172.21.15.26:0/4204612888 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41b0016110 con 0x7f41ac005bd0 2024-04-21T08:57:50.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.430+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f41c006e0d0 con 0x7f41ac005bd0 2024-04-21T08:57:50.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.434+0000 7f41b77fe640 1 -- 172.21.15.26:0/4204612888 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7f41b00f15f0 con 0x7f41ac005bd0 2024-04-21T08:57:50.436 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:50.437 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:50.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f41a0068380 msgr2=0x7f41a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f41a0068380 0x7f41a006a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41c01585b0 tx=0x7f41a8009040 comp rx=0 tx=0).stop 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 msgr2=0x7f41c01ece20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41c01ece20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41b001c230 tx=0x7f41ac007a50 comp rx=0 tx=0).stop 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 shutdown_connections 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41c014fab0 0x7f41c014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41c01505a0 0x7f41c00cb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f41a0068380 0x7f41a006a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 --2- 172.21.15.26:0/4204612888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41ac005bd0 0x7f41c01ece20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 >> 172.21.15.26:0/4204612888 conn(0x7f41c00c8960 msgr2=0x7f41c014c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 shutdown_connections 2024-04-21T08:57:50.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.438+0000 7f41c55f7640 1 -- 172.21.15.26:0/4204612888 wait complete. 2024-04-21T08:57:50.456 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-21T08:57:50.456 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:50.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.578+0000 7fd402272640 1 Processor -- start 2024-04-21T08:57:50.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.578+0000 7fd402272640 1 -- start start 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd402272640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3fc0c52b0 0x7fd3fc0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd402272640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3fc0c6050 con 0x7fd3fc0c5690 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd402272640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3fc0c3470 con 0x7fd3fc073b50 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd402272640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd3fc0c5e00 con 0x7fd3fc0c52b0 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3fc0c52b0 0x7fd3fc0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd40080f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd3fc0c5690 0x7fd3fc06ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42332/0 (socket says 172.21.15.26:42332) 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd3fc0c52b0 0x7fd3fc0c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54032/0 (socket says 172.21.15.26:54032) 2024-04-21T08:57:50.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd40080f640 1 -- 172.21.15.26:0/666270707 learned_addr learned my addr 172.21.15.26:0/666270707 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fbfff640 1 -- 172.21.15.26:0/666270707 >> v1:172.21.15.169:6789/0 conn(0x7fd3fc073b50 legacy=0x7fd3fc1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fbfff640 1 -- 172.21.15.26:0/666270707 >> v1:172.21.15.26:6789/0 conn(0x7fd3fc0c5690 legacy=0x7fd3fc06ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fbfff640 1 -- 172.21.15.26:0/666270707 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc0c3750 con 0x7fd3fc0c52b0 2024-04-21T08:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fbfff640 1 --2- 172.21.15.26:0/666270707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c52b0 0x7fd3fc0c9450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0097c0 tx=0x7fd3ec01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1808d84d7975ed5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fb7fe640 1 -- 172.21.15.26:0/666270707 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0b0070 con 0x7fd3fc0c52b0 2024-04-21T08:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fb7fe640 1 -- 172.21.15.26:0/666270707 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3ec0ab600 con 0x7fd3fc0c52b0 2024-04-21T08:57:50.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.582+0000 7fd3fb7fe640 1 -- 172.21.15.26:0/666270707 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec0ab9d0 con 0x7fd3fc0c52b0 2024-04-21T08:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- 172.21.15.26:0/666270707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c52b0 msgr2=0x7fd3fc0c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 --2- 172.21.15.26:0/666270707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c52b0 0x7fd3fc0c9450 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0097c0 tx=0x7fd3ec01c340 comp rx=0 tx=0).stop 2024-04-21T08:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- 172.21.15.26:0/666270707 shutdown_connections 2024-04-21T08:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 --2- 172.21.15.26:0/666270707 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c52b0 0x7fd3fc0c9450 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- 172.21.15.26:0/666270707 >> 172.21.15.26:0/666270707 conn(0x7fd3fc0c8960 msgr2=0x7fd3fc0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- 172.21.15.26:0/666270707 shutdown_connections 2024-04-21T08:57:50.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- 172.21.15.26:0/666270707 wait complete. 2024-04-21T08:57:50.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 Processor -- start 2024-04-21T08:57:50.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- start start 2024-04-21T08:57:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3fc073b50 0x7fd3fc0c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3fc0c52b0 0x7fd3fc157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c5690 0x7fd3fc1f7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc166f10 con 0x7fd3fc0c5690 2024-04-21T08:57:50.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd3fc0c6330 con 0x7fd3fc073b50 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd3fc167090 con 0x7fd3fc0c52b0 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c5690 0x7fd3fc1f7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c5690 0x7fd3fc1f7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54042/0 (socket says 172.21.15.26:54042) 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 -- 172.21.15.26:0/4123574569 learned_addr learned my addr 172.21.15.26:0/4123574569 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd3fbfff640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3fc073b50 0x7fd3fc0c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd3f37fe640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3fc0c52b0 0x7fd3fc157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 -- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3fc0c52b0 msgr2=0x7fd3fc157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3fc0c52b0 0x7fd3fc157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 -- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3fc073b50 msgr2=0x7fd3fc0c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3fc073b50 0x7fd3fc0c6530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 -- 172.21.15.26:0/4123574569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3fc0732a0 con 0x7fd3fc0c5690 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd40080f640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c5690 0x7fd3fc1f7350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400cab0 tx=0x7fd3f400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd3f97fa640 1 -- 172.21.15.26:0/4123574569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4017070 con 0x7fd3fc0c5690 2024-04-21T08:57:50.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd3f97fa640 1 -- 172.21.15.26:0/4123574569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f400ac30 con 0x7fd3fc0c5690 2024-04-21T08:57:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3fc14c9b0 con 0x7fd3fc0c5690 2024-04-21T08:57:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd3f97fa640 1 -- 172.21.15.26:0/4123574569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f4012400 con 0x7fd3fc0c5690 2024-04-21T08:57:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.586+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3fc14cf70 con 0x7fd3fc0c5690 2024-04-21T08:57:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.590+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3fc075ef0 con 0x7fd3fc0c5690 2024-04-21T08:57:50.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.590+0000 7fd3f97fa640 1 -- 172.21.15.26:0/4123574569 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd3f401a070 con 0x7fd3fc0c5690 2024-04-21T08:57:50.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.590+0000 7fd3f97fa640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3dc0683b0 0x7fd3dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.590+0000 7fd3f97fa640 1 -- 172.21.15.26:0/4123574569 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd3f40865a0 con 0x7fd3fc0c5690 2024-04-21T08:57:50.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.590+0000 7fd3fbfff640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3dc0683b0 0x7fd3dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.590+0000 7fd3fbfff640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3dc0683b0 0x7fd3dc06a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0ad000 tx=0x7fd3ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.594+0000 7fd3f97fa640 1 -- 172.21.15.26:0/4123574569 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd3f4056510 con 0x7fd3fc0c5690 2024-04-21T08:57:50.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.758+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3fc0c93d0 con 0x7fd3fc0c5690 2024-04-21T08:57:50.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd3f97fa640 1 -- 172.21.15.26:0/4123574569 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7fd3f405a810 con 0x7fd3fc0c5690 2024-04-21T08:57:50.763 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:50.763 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3dc0683b0 msgr2=0x7fd3dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3dc0683b0 0x7fd3dc06a870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0ad000 tx=0x7fd3ec008040 comp rx=0 tx=0).stop 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c5690 msgr2=0x7fd3fc1f7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c5690 0x7fd3fc1f7350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd3f400cab0 tx=0x7fd3f400cf70 comp rx=0 tx=0).stop 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 shutdown_connections 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3dc0683b0 0x7fd3dc06a870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd3fc0c5690 0x7fd3fc1f7350 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd3fc0c52b0 0x7fd3fc157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 --2- 172.21.15.26:0/4123574569 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd3fc073b50 0x7fd3fc0c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 >> 172.21.15.26:0/4123574569 conn(0x7fd3fc0c8960 msgr2=0x7fd3fc1528c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 shutdown_connections 2024-04-21T08:57:50.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.762+0000 7fd402272640 1 -- 172.21.15.26:0/4123574569 wait complete. 2024-04-21T08:57:50.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-21T08:57:50.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-21T08:57:50.782 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-21T08:57:50.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-21T08:57:50.783 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-21T08:57:50.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-21T08:57:50.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-21T08:57:50.784 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-21T08:57:50.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7e185d640 1 Processor -- start 2024-04-21T08:57:50.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf1c85a640 1 Processor -- start 2024-04-21T08:57:50.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7e185d640 1 -- start start 2024-04-21T08:57:50.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf1c85a640 1 -- start start 2024-04-21T08:57:50.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffe54a640 1 Processor -- start 2024-04-21T08:57:50.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f3a5bfff640 1 Processor -- start 2024-04-21T08:57:50.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f3a5bfff640 1 -- start start 2024-04-21T08:57:50.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7e185d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa7dc1527b0 0x7fa7dc0c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f1d42acc640 1 Processor -- start 2024-04-21T08:57:50.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7e185d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7dc152b90 con 0x7fa7dc06ce70 2024-04-21T08:57:50.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7e185d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7dc0c7040 con 0x7fa7dc0c67b0 2024-04-21T08:57:50.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7e185d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa7dc1587e0 con 0x7fa7dc1527b0 2024-04-21T08:57:50.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf1c85a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf100471e0 0x7fbf1004bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf1c85a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbf10007c90 0x7fbf10047750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf1c85a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf10008120 con 0x7fbf100dd630 2024-04-21T08:57:50.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf1c85a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbf100464b0 con 0x7fbf10007c90 2024-04-21T08:57:50.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf1c85a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbf10046790 con 0x7fbf100471e0 2024-04-21T08:57:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f3a5bfff640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3a5404c6a0 0x7f3a54045230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a54045770 0x7f3a540e3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f3a5bfff640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a54045c00 con 0x7f3a540dd4c0 2024-04-21T08:57:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f3a5bfff640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3a540dd8a0 con 0x7f3a5404c6a0 2024-04-21T08:57:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f3a5bfff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a54006670 con 0x7f3a54045770 2024-04-21T08:57:50.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fd4153bd640 1 Processor -- start 2024-04-21T08:57:50.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf177fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbf100dd630 0x7fbf100e7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42342/0 (socket says 172.21.15.26:42342) 2024-04-21T08:57:50.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf177fe640 1 -- 172.21.15.26:0/1340340328 learned_addr learned my addr 172.21.15.26:0/1340340328 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:50.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7f1d42acc640 1 -- start start 2024-04-21T08:57:50.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7dbfff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fa7dc0c67b0 0x7fa7dc06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:38308/0 (socket says 172.21.15.26:38308) 2024-04-21T08:57:50.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fa7dbfff640 1 -- 172.21.15.26:0/1501300593 learned_addr learned my addr 172.21.15.26:0/1501300593 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:50.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffe54a640 1 -- start start 2024-04-21T08:57:50.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffe54a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feff00347a0 0x7feff00dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffe54a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff004b990 con 0x7feff00db270 2024-04-21T08:57:50.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffe54a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff004bc70 con 0x7feff00d5000 2024-04-21T08:57:50.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffe54a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7feff0006a50 con 0x7feff00347a0 2024-04-21T08:57:50.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf16ffd640 1 --2- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf100471e0 0x7fbf1004bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fbf17fff640 1 --2- 172.21.15.26:0/1340340328 >> v2:172.21.15.169:3300/0 conn(0x7fbf10007c90 0x7fbf10047750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffd548640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7feff00d5000 0x7feff004c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:38322/0 (socket says 172.21.15.26:38322) 2024-04-21T08:57:50.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffd548640 1 -- 172.21.15.26:0/4240545333 learned_addr learned my addr 172.21.15.26:0/4240545333 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:50.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7feffcd47640 1 --2- 172.21.15.26:0/4240545333 >> v2:172.21.15.26:3300/0 conn(0x7feff00347a0 0x7feff00dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5a7fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3a5404c6a0 0x7f3a54045230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2698246686 0 0) 0x7fa7dc0c7040 con 0x7fa7dc0c67b0 2024-04-21T08:57:50.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7cc003530 con 0x7fa7dc0c67b0 2024-04-21T08:57:50.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d42acc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c159210 0x7f1d3c071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d42acc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d3c0c8420 0x7f1d3c072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5a7fc640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3a5404c6a0 0x7f3a54045230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51522/0 (socket says 172.21.15.26:51522) 2024-04-21T08:57:50.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/2809247868 learned_addr learned my addr 172.21.15.26:0/2809247868 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:50.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d42acc640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3c071530 con 0x7f1d3c0cca10 2024-04-21T08:57:50.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d42acc640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c06cb00 con 0x7f1d3c0c8420 2024-04-21T08:57:50.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d42acc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3c071b40 con 0x7f1d3c159210 2024-04-21T08:57:50.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf167fc640 1 -- 172.21.15.26:0/1340340328 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2978766879 0 0) 0x7fbf10008120 con 0x7fbf100dd630 2024-04-21T08:57:50.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf167fc640 1 -- 172.21.15.26:0/1340340328 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf08003530 con 0x7fbf100dd630 2024-04-21T08:57:50.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fefeffff640 1 -- 172.21.15.26:0/4240545333 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841651834 0 0) 0x7feff004bc70 con 0x7feff00d5000 2024-04-21T08:57:50.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fefeffff640 1 -- 172.21.15.26:0/4240545333 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefe4005740 con 0x7feff00d5000 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 818261310 0 0) 0x7fa7cc003530 con 0x7fa7dc0c67b0 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 >> v2:172.21.15.169:3300/0 conn(0x7fa7dc1527b0 msgr2=0x7fa7dc0c7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 --2- 172.21.15.26:0/1501300593 >> v2:172.21.15.169:3300/0 conn(0x7fa7dc1527b0 0x7fa7dc0c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 >> v1:172.21.15.26:6789/0 conn(0x7fa7dc06ce70 legacy=0x7fa7dc06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc158ac0 con 0x7fa7dc0c67b0 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fa7c8001680 con 0x7fa7dc0c67b0 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 >> v1:172.21.15.169:6789/0 conn(0x7fa7dc0c67b0 legacy=0x7fa7dc06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7cc004810 0x7fa7cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7cc0051d0 0x7fa7cc0145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc1587e0 con 0x7fa7cc0051d0 2024-04-21T08:57:50.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc014b10 con 0x7fa7cc0039c0 2024-04-21T08:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa7cc014c90 con 0x7fa7cc004810 2024-04-21T08:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d40868640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c159210 0x7f1d3c071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d40868640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c159210 0x7f1d3c071fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:50930/0 (socket says 172.21.15.26:50930) 2024-04-21T08:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d40868640 1 -- 172.21.15.26:0/3964145604 learned_addr learned my addr 172.21.15.26:0/3964145604 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:50.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5b7fe640 1 --2- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a54045770 0x7f3a540e3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7feffcd47640 1 -- 172.21.15.26:0/4240545333 >> v1:172.21.15.169:6789/0 conn(0x7feff00d5000 legacy=0x7feff004c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7feffcd47640 1 -- 172.21.15.26:0/4240545333 >> v1:172.21.15.26:6789/0 conn(0x7feff00db270 legacy=0x7feff00e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7feffcd47640 1 -- 172.21.15.26:0/4240545333 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff0006d30 con 0x7feff00347a0 2024-04-21T08:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a54045770 msgr2=0x7f3a540e3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5a7fc640 1 --2- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a54045770 0x7f3a540e3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/2809247868 >> v1:172.21.15.169:6789/0 conn(0x7f3a540dd4c0 legacy=0x7f3a54005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3a5a7fc640 1 -- 172.21.15.26:0/2809247868 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a54006950 con 0x7f3a5404c6a0 2024-04-21T08:57:50.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.962+0000 7fd4153bd640 1 -- start start 2024-04-21T08:57:50.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd4153bd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd4100c32d0 0x7fd4100c7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd4153bd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4100c3720 con 0x7fd4101591f0 2024-04-21T08:57:50.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd4153bd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4101623b0 con 0x7fd410072620 2024-04-21T08:57:50.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd4153bd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd4100c7e70 con 0x7fd4100c32d0 2024-04-21T08:57:50.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7dbfff640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7cc004810 0x7fa7cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7e085b640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd414bbc640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fd410072620 0x7fd410072a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:38342/0 (socket says 172.21.15.26:38342) 2024-04-21T08:57:50.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd414bbc640 1 -- 172.21.15.26:0/2475505723 learned_addr learned my addr 172.21.15.26:0/2475505723 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d40868640 1 -- 172.21.15.26:0/3964145604 >> v2:172.21.15.26:3300/0 conn(0x7f1d3c0c8420 msgr2=0x7f1d3c072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d40868640 1 --2- 172.21.15.26:0/3964145604 >> v2:172.21.15.26:3300/0 conn(0x7f1d3c0c8420 0x7f1d3c072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d40868640 1 -- 172.21.15.26:0/3964145604 >> v1:172.21.15.169:6789/0 conn(0x7f1d3c0cca10 legacy=0x7f1d3c162600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf17fff640 1 -- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf100471e0 msgr2=0x7fbf1004bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf17fff640 1 --2- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf100471e0 0x7fbf1004bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf17fff640 1 -- 172.21.15.26:0/1340340328 >> v1:172.21.15.26:6789/0 conn(0x7fbf100dd630 legacy=0x7fbf100e7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf17fff640 1 -- 172.21.15.26:0/1340340328 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf10006ed0 con 0x7fbf10007c90 2024-04-21T08:57:50.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f1d40868640 1 -- 172.21.15.26:0/3964145604 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0c68e0 con 0x7f1d3c159210 2024-04-21T08:57:50.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40f7fe640 1 --2- 172.21.15.26:0/2475505723 >> v2:172.21.15.26:3300/0 conn(0x7fd4100c32d0 0x7fd4100c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7e085b640 1 -- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7cc004810 msgr2=0x7fa7cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7e085b640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7cc004810 0x7fa7cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7e085b640 1 -- 172.21.15.26:0/1501300593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7cc0051d0 msgr2=0x7fa7cc0145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:50.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7e085b640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7cc0051d0 0x7fa7cc0145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7e085b640 1 -- 172.21.15.26:0/1501300593 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc158ac0 con 0x7fa7cc0039c0 2024-04-21T08:57:50.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fa7e105c640 1 -- 172.21.15.26:0/1501300593 reap_dead start 2024-04-21T08:57:50.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa359e640 1 Processor -- start 2024-04-21T08:57:50.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40effd640 1 -- 172.21.15.26:0/2475505723 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932668430 0 0) 0x7fd4101623b0 con 0x7fd410072620 2024-04-21T08:57:50.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40effd640 1 -- 172.21.15.26:0/2475505723 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd404003530 con 0x7fd410072620 2024-04-21T08:57:50.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40effd640 1 -- 172.21.15.26:0/2475505723 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793784526 0 0) 0x7fd400001120 con 0x7fd4101591f0 2024-04-21T08:57:50.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40effd640 1 -- 172.21.15.26:0/2475505723 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4101623b0 con 0x7fd4101591f0 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf17fff640 1 --2- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10007c90 0x7fbf10047750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf1802db60 tx=0x7fbf1809ada0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91f4ea9684d93443 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7feffcd47640 1 --2- 172.21.15.26:0/4240545333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00347a0 0x7feff00dad30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fefe80097c0 tx=0x7fefe801edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd0c5034b29dc18d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa359e640 1 -- start start 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c04cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa359e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a9c04d010 0x7f3a9c0e9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa359e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9c04d4a0 con 0x7f3a9c0d93b0 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa359e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3a9c04c360 con 0x7f3a9c04d010 2024-04-21T08:57:50.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa359e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c0dfcb0 con 0x7f3a9c00ee60 2024-04-21T08:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa8d94640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a9c04d010 0x7f3a9c0e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa8d94640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a9c04d010 0x7f3a9c0e9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54092/0 (socket says 172.21.15.26:54092) 2024-04-21T08:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7f3aa8d94640 1 -- 172.21.15.26:0/3535709956 learned_addr learned my addr 172.21.15.26:0/3535709956 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40f7fe640 1 -- 172.21.15.26:0/2475505723 >> v1:172.21.15.169:6789/0 conn(0x7fd410072620 legacy=0x7fd410072a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40f7fe640 1 -- 172.21.15.26:0/2475505723 >> v1:172.21.15.26:6789/0 conn(0x7fd4101591f0 legacy=0x7fd4100c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fd40f7fe640 1 -- 172.21.15.26:0/2475505723 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd410162690 con 0x7fd4100c32d0 2024-04-21T08:57:50.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.966+0000 7fbf167fc640 1 -- 172.21.15.26:0/1340340328 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf181249a0 con 0x7fbf10007c90 2024-04-21T08:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa8d94640 1 -- 172.21.15.26:0/3535709956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 msgr2=0x7f3a9c04cad0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-21T08:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa8d94640 1 --2- 172.21.15.26:0/3535709956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c04cad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa8d94640 1 -- 172.21.15.26:0/3535709956 >> v1:172.21.15.26:6789/0 conn(0x7f3a9c0d93b0 legacy=0x7f3a9c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa8d94640 1 -- 172.21.15.26:0/3535709956 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c0df9e0 con 0x7f3a9c04d010 2024-04-21T08:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf167fc640 1 -- 172.21.15.26:0/1340340328 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf18124b40 con 0x7fbf10007c90 2024-04-21T08:57:50.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf167fc640 1 -- 172.21.15.26:0/1340340328 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1812c440 con 0x7fbf10007c90 2024-04-21T08:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5a7fc640 1 --2- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404c6a0 0x7f3a54045230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c07bb20 tx=0x7f3a5c09ae80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50b5d1f25eff20fc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 -- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10007c90 msgr2=0x7fbf10047750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 --2- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10007c90 0x7fbf10047750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbf1802db60 tx=0x7fbf1809ada0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d40868640 1 --2- 172.21.15.26:0/3964145604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c159210 0x7f1d3c071fd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009870 tx=0x7f1d2801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5daa68cd46e4da94 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fefeffff640 1 -- 172.21.15.26:0/4240545333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe80b5070 con 0x7feff00347a0 2024-04-21T08:57:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fefeffff640 1 -- 172.21.15.26:0/4240545333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefe80a8bc0 con 0x7feff00347a0 2024-04-21T08:57:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 -- 172.21.15.26:0/1340340328 shutdown_connections 2024-04-21T08:57:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 --2- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf10007c90 0x7fbf10047750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 --2- 172.21.15.26:0/1340340328 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf100471e0 0x7fbf1004bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fefeffff640 1 -- 172.21.15.26:0/4240545333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe80b0440 con 0x7feff00347a0 2024-04-21T08:57:50.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 -- 172.21.15.26:0/4240545333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00347a0 msgr2=0x7feff00dad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 --2- 172.21.15.26:0/4240545333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00347a0 0x7feff00dad30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fefe80097c0 tx=0x7fefe801edd0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 -- 172.21.15.26:0/1340340328 >> 172.21.15.26:0/1340340328 conn(0x7fbf1004dd40 msgr2=0x7fbf1004e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 -- 172.21.15.26:0/1340340328 shutdown_connections 2024-04-21T08:57:50.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e085b640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7cc003dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009890 tx=0x7fa7d001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9185a732f533ce8e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d00b0070 con 0x7fa7cc0039c0 2024-04-21T08:57:50.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d00ab620 con 0x7fa7cc0039c0 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7db7fe640 1 -- 172.21.15.26:0/1501300593 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d0009460 con 0x7fa7cc0039c0 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d3b7fe640 1 -- 172.21.15.26:0/3964145604 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280b0070 con 0x7f1d3c159210 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d3b7fe640 1 -- 172.21.15.26:0/3964145604 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d280ab600 con 0x7f1d3c159210 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d3b7fe640 1 -- 172.21.15.26:0/3964145604 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d280ab9d0 con 0x7f1d3c159210 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 -- 172.21.15.26:0/3964145604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c159210 msgr2=0x7f1d3c071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 --2- 172.21.15.26:0/3964145604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c159210 0x7f1d3c071fd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009870 tx=0x7f1d2801c4d0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 -- 172.21.15.26:0/3964145604 shutdown_connections 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 --2- 172.21.15.26:0/3964145604 >> v2:172.21.15.26:3300/0 conn(0x7f1d3c0c8420 0x7f1d3c072510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 --2- 172.21.15.26:0/3964145604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c159210 0x7f1d3c071fd0 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009870 tx=0x7f1d2801c4d0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 -- 172.21.15.26:0/3964145604 >> 172.21.15.26:0/3964145604 conn(0x7f1d3c0cbef0 msgr2=0x7f1d3c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 -- 172.21.15.26:0/3964145604 shutdown_connections 2024-04-21T08:57:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd40f7fe640 1 --2- 172.21.15.26:0/2475505723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4100c32d0 0x7fd4100c7930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80097c0 tx=0x7fd3f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8976ef9f1901f982 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd40effd640 1 -- 172.21.15.26:0/2475505723 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80b0070 con 0x7fd4100c32d0 2024-04-21T08:57:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd40effd640 1 -- 172.21.15.26:0/2475505723 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3f80ab600 con 0x7fd4100c32d0 2024-04-21T08:57:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd40effd640 1 -- 172.21.15.26:0/2475505723 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80a4e60 con 0x7fd4100c32d0 2024-04-21T08:57:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 -- 172.21.15.26:0/1340340328 wait complete. 2024-04-21T08:57:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 Processor -- start 2024-04-21T08:57:50.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fbf1c85a640 1 -- start start 2024-04-21T08:57:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 -- 172.21.15.26:0/4240545333 shutdown_connections 2024-04-21T08:57:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 --2- 172.21.15.26:0/4240545333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00347a0 0x7feff00dad30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 -- 172.21.15.26:0/4240545333 >> 172.21.15.26:0/4240545333 conn(0x7feff0050190 msgr2=0x7feff00505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 -- 172.21.15.26:0/4240545333 shutdown_connections 2024-04-21T08:57:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 -- 172.21.15.26:0/4240545333 wait complete. 2024-04-21T08:57:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 Processor -- start 2024-04-21T08:57:50.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e185d640 1 -- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 msgr2=0x7fa7cc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e185d640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7cc003dc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7d0009890 tx=0x7fa7d001c3c0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e185d640 1 -- 172.21.15.26:0/1501300593 shutdown_connections 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e185d640 1 --2- 172.21.15.26:0/1501300593 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7cc003dc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e185d640 1 -- 172.21.15.26:0/1501300593 >> 172.21.15.26:0/1501300593 conn(0x7fa7dc0c8a80 msgr2=0x7fa7dc0c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e185d640 1 -- 172.21.15.26:0/1501300593 shutdown_connections 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa8d94640 1 --2- 172.21.15.26:0/3535709956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c04d010 0x7f3a9c0e9840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3aa406ae90 tx=0x7f3aa40985d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff01d086a43f33bc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa159a640 1 -- 172.21.15.26:0/3535709956 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4127640 con 0x7f3a9c04d010 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa159a640 1 -- 172.21.15.26:0/3535709956 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa41277e0 con 0x7f3a9c04d010 2024-04-21T08:57:50.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3aa159a640 1 -- 172.21.15.26:0/3535709956 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4127c30 con 0x7f3a9c04d010 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a59ffb640 1 -- 172.21.15.26:0/2809247868 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c063220 con 0x7f3a5404c6a0 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a59ffb640 1 -- 172.21.15.26:0/2809247868 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c124960 con 0x7f3a5404c6a0 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 -- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404c6a0 msgr2=0x7f3a54045230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a59ffb640 1 -- 172.21.15.26:0/2809247868 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c063220 con 0x7f3a5404c6a0 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 --2- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404c6a0 0x7f3a54045230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c07bb20 tx=0x7f3a5c09ae80 comp rx=0 tx=0).stop 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 -- 172.21.15.26:0/2809247868 shutdown_connections 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 --2- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a54045770 0x7f3a540e3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 --2- 172.21.15.26:0/2809247868 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404c6a0 0x7f3a54045230 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c07bb20 tx=0x7f3a5c09ae80 comp rx=0 tx=0).stop 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 -- 172.21.15.26:0/2809247868 >> 172.21.15.26:0/2809247868 conn(0x7f3a54050190 msgr2=0x7f3a540505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 -- 172.21.15.26:0/2809247868 shutdown_connections 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f1d42acc640 1 -- 172.21.15.26:0/3964145604 wait complete. 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 Processor -- start 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd4153bd640 1 -- 172.21.15.26:0/2475505723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4100c32d0 msgr2=0x7fd4100c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd4153bd640 1 --2- 172.21.15.26:0/2475505723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4100c32d0 0x7fd4100c7930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80097c0 tx=0x7fd3f801c3d0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd4153bd640 1 -- 172.21.15.26:0/2475505723 shutdown_connections 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd4153bd640 1 --2- 172.21.15.26:0/2475505723 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4100c32d0 0x7fd4100c7930 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80097c0 tx=0x7fd3f801c3d0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fd4153bd640 1 -- 172.21.15.26:0/2475505723 >> 172.21.15.26:0/2475505723 conn(0x7fd41006fde0 msgr2=0x7fd4100701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fd4153bd640 1 -- 172.21.15.26:0/2475505723 shutdown_connections 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf10007c90 0x7fbf1004fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf100471e0 0x7fbf10179670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf100dd630 0x7fbf1004af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10007770 con 0x7fbf100dd630 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbf10007490 con 0x7fbf100471e0 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbf10048250 con 0x7fbf10007c90 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf10007c90 0x7fbf1004fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf10007c90 0x7fbf1004fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:50948/0 (socket says 172.21.15.26:50948) 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 -- 172.21.15.26:0/2314510575 learned_addr learned my addr 172.21.15.26:0/2314510575 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:50.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf16ffd640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf100471e0 0x7fbf10179670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 -- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf100471e0 msgr2=0x7fbf10179670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf100471e0 0x7fbf10179670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 -- 172.21.15.26:0/2314510575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf100dd630 msgr2=0x7fbf1004af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbf100dd630 0x7fbf1004af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7feffe54a640 1 -- start start 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffe54a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feff00347a0 0x7feff00cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffe54a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00d5000 0x7feff00cff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffe54a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feff00db270 0x7feff0175720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffe54a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feff00d53e0 con 0x7feff00d5000 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffe54a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feff0045130 con 0x7feff00347a0 2024-04-21T08:57:50.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffe54a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feff0034c10 con 0x7feff00db270 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffcd47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00d5000 0x7feff00cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffcd47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00d5000 0x7feff00cff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54110/0 (socket says 172.21.15.26:54110) 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffcd47640 1 -- 172.21.15.26:0/3439599182 learned_addr learned my addr 172.21.15.26:0/3439599182 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffd548640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feff00347a0 0x7feff00cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffdd49640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feff00db270 0x7feff0175720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7fa7e185d640 1 -- 172.21.15.26:0/1501300593 wait complete. 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 Processor -- start 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 -- start start 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7dc151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc0c40e0 0x7fa7dc14a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7dc0c34c0 0x7fa7dc0c3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc0c6c20 con 0x7fa7dc0c34c0 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc159080 con 0x7fa7cc0039c0 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e185d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa7dc0c6da0 con 0x7fa7dc0c40e0 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 -- 172.21.15.26:0/3535709956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c04d010 msgr2=0x7f3a9c0e9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 --2- 172.21.15.26:0/3535709956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c04d010 0x7f3a9c0e9840 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3aa406ae90 tx=0x7f3aa40985d0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 -- 172.21.15.26:0/3535709956 shutdown_connections 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 --2- 172.21.15.26:0/3535709956 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c04d010 0x7f3a9c0e9840 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 --2- 172.21.15.26:0/3535709956 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c04cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 -- 172.21.15.26:0/3535709956 >> 172.21.15.26:0/3535709956 conn(0x7f3a9c00e340 msgr2=0x7f3a9c00e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:50.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 -- 172.21.15.26:0/3535709956 shutdown_connections 2024-04-21T08:57:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 -- 172.21.15.26:0/3535709956 wait complete. 2024-04-21T08:57:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.970+0000 7f3a5bfff640 1 -- 172.21.15.26:0/2809247868 wait complete. 2024-04-21T08:57:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 Processor -- start 2024-04-21T08:57:50.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69fcea2640 1 Processor -- start 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 -- 172.21.15.26:0/2314510575 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf10052220 con 0x7fbf10007c90 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 -- start start 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3c0c8420 0x7f1d3c154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0cca10 0x7f1d3c154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0c56b0 0x7f1d3c1f86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c159770 con 0x7f1d3c0cca10 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c1595f0 con 0x7f1d3c0c8420 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d42acc640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3c16b9a0 con 0x7f1d3c0c56b0 2024-04-21T08:57:51.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0cca10 0x7f1d3c154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0cca10 0x7f1d3c154e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54122/0 (socket says 172.21.15.26:54122) 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 -- 172.21.15.26:0/1632023349 learned_addr learned my addr 172.21.15.26:0/1632023349 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d41069640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0c56b0 0x7f1d3c1f86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d40868640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3c0c8420 0x7f1d3c154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 -- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0c56b0 msgr2=0x7f1d3c1f86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0c56b0 0x7f1d3c1f86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 -- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3c0c8420 msgr2=0x7f1d3c154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d3c0c8420 0x7f1d3c154920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 -- 172.21.15.26:0/1632023349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0c5000 con 0x7f1d3c0cca10 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d41069640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0c56b0 0x7f1d3c1f86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:51.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fd4153bd640 1 -- 172.21.15.26:0/2475505723 wait complete. 2024-04-21T08:57:51.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf177fe640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf10007c90 0x7fbf1004fc50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c580 tx=0x7fbf0400ca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf04018070 con 0x7fbf10007c90 2024-04-21T08:57:51.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffdd49640 1 -- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feff00347a0 msgr2=0x7feff00cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffdd49640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feff00347a0 0x7feff00cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffdd49640 1 -- 172.21.15.26:0/3439599182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00d5000 msgr2=0x7feff00cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffdd49640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feff00d5000 0x7feff00cff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffdd49640 1 -- 172.21.15.26:0/3439599182 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff004f900 con 0x7feff00db270 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7feffdd49640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feff00db270 0x7feff0175720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feff806a970 tx=0x7feff8074690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7dbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc0c40e0 0x7fa7dc14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e105c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7dc0c34c0 0x7fa7dc0c3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7dbfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc0c40e0 0x7fa7dc14a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:50972/0 (socket says 172.21.15.26:50972) 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7dbfff640 1 -- 172.21.15.26:0/2145594118 learned_addr learned my addr 172.21.15.26:0/2145594118 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e085b640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7dc151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e105c640 1 -- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc0c40e0 msgr2=0x7fa7dc14a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e105c640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa7dc0c40e0 0x7fa7dc14a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e105c640 1 -- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 msgr2=0x7fa7dc151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e105c640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7dc151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e105c640 1 -- 172.21.15.26:0/2145594118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc0ca0e0 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e085b640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa7cc0039c0 0x7fa7dc151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fa7e105c640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7dc0c34c0 0x7fa7dc0c3940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0c3180 tx=0x7fa7d400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3aa359e640 1 Processor -- start 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 -- start start 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a54045770 0x7f3a540492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a540dd4c0 0x7f3a540e4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404f4a0 0x7f3a540d60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3a540071f0 con 0x7f3a54045770 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54006f10 con 0x7f3a5404f4a0 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5bfff640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a540074d0 con 0x7f3a540dd4c0 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a54045770 0x7f3a540492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a54045770 0x7f3a540492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54118/0 (socket says 172.21.15.26:54118) 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5affd640 1 -- 172.21.15.26:0/770058245 learned_addr learned my addr 172.21.15.26:0/770058245 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5b7fe640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404f4a0 0x7f3a540d60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5a7fc640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a540dd4c0 0x7f3a540e4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5b7fe640 1 -- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a540dd4c0 msgr2=0x7f3a540e4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69fcea2640 1 -- start start 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69fcea2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f8151720 0x7f69f80cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69fcea2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f69f8151b00 0x7f69f80cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69fcea2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69f80c2f10 con 0x7f69f80c2a60 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69fcea2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f69f80cb1f0 con 0x7f69f8151b00 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69fcea2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f69f80733c0 con 0x7f69f8151720 2024-04-21T08:57:51.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f8151720 0x7f69f80cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69f659c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f8151720 0x7f69f80cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:50996/0 (socket says 172.21.15.26:50996) 2024-04-21T08:57:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69f659c640 1 -- 172.21.15.26:0/1116371973 learned_addr learned my addr 172.21.15.26:0/1116371973 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f1d3bfff640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0cca10 0x7f1d3c154e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000b550 tx=0x7f1d3000ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 -- 172.21.15.26:0/2314510575 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf10179bb0 con 0x7fbf10007c90 2024-04-21T08:57:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5b7fe640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a540dd4c0 0x7f3a540e4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5b7fe640 1 -- 172.21.15.26:0/770058245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a54045770 msgr2=0x7f3a540492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5b7fe640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a54045770 0x7f3a540492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5b7fe640 1 -- 172.21.15.26:0/770058245 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a54049cc0 con 0x7f3a5404f4a0 2024-04-21T08:57:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5affd640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a54045770 0x7f3a540492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T08:57:51.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf1c85a640 1 -- 172.21.15.26:0/2314510575 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf1004f970 con 0x7fbf10007c90 2024-04-21T08:57:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f69f5d9b640 1 --2- 172.21.15.26:0/1116371973 >> v2:172.21.15.169:3300/0 conn(0x7f69f8151b00 0x7f69f80cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf04007560 con 0x7fbf10007c90 2024-04-21T08:57:51.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf04004a10 con 0x7fbf10007c90 2024-04-21T08:57:51.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.974+0000 7f3a5b7fe640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404f4a0 0x7f3a540d60f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000d510 tx=0x7f3a5000d9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30014070 con 0x7f1d3c0cca10 2024-04-21T08:57:51.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d30010890 con 0x7f1d3c0cca10 2024-04-21T08:57:51.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d30010c80 con 0x7f1d3c0cca10 2024-04-21T08:57:51.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f1d42acc640 1 -- 172.21.15.26:0/1632023349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c0c52a0 con 0x7f1d3c0cca10 2024-04-21T08:57:51.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f1d42acc640 1 -- 172.21.15.26:0/1632023349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c154120 con 0x7f1d3c0cca10 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 Processor -- start 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 -- start start 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd410072620 0x7fd410157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4101591f0 0x7fd4101578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd410151030 0x7fd41014f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd4100c9260 con 0x7fd4101591f0 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd410163210 con 0x7fd410151030 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd4153bd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd4100c93e0 con 0x7fd410072620 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff80694a0 con 0x7feff00db270 2024-04-21T08:57:51.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff8069680 con 0x7feff00db270 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8091410 con 0x7feff00db270 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff01854a0 con 0x7feff00db270 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feff0185a60 con 0x7feff00db270 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4007030 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7d40071f0 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40075e0 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fa7e185d640 1 -- 172.21.15.26:0/2145594118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7dc0cb560 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fa7e185d640 1 -- 172.21.15.26:0/2145594118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7dc14faa0 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fa7e185d640 1 -- 172.21.15.26:0/2145594118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7dc14f850 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500125f0 con 0x7f3a5404f4a0 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a50019070 con 0x7f3a5404f4a0 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a500129d0 con 0x7f3a5404f4a0 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a540d5370 con 0x7f3a5404f4a0 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a540d5610 con 0x7f3a5404f4a0 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd410151030 0x7fd41014f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd410151030 0x7fd41014f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51590/0 (socket says 172.21.15.26:51590) 2024-04-21T08:57:51.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 -- 172.21.15.26:0/2523701619 learned_addr learned my addr 172.21.15.26:0/2523701619 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a3c001040 con 0x7f3a5404f4a0 2024-04-21T08:57:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f1d42acc640 1 -- 172.21.15.26:0/1632023349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d1c001040 con 0x7f1d3c0cca10 2024-04-21T08:57:51.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd40ffff640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd410072620 0x7fd410157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fbf1c85a640 1 -- 172.21.15.26:0/2314510575 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbef8001040 con 0x7fbf10007c90 2024-04-21T08:57:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 -- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd410072620 msgr2=0x7fd410157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd410072620 0x7fd410157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 -- 172.21.15.26:0/2523701619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4101591f0 msgr2=0x7fd4101578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd4101591f0 0x7fd4101578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7fd414bbc640 1 -- 172.21.15.26:0/2523701619 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4101f7b10 con 0x7fd410151030 2024-04-21T08:57:51.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feff0185250 con 0x7feff00db270 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa359e640 1 -- start start 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c0e2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c04d010 0x7f3a9c17ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c0e2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa259c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c0e2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:51010/0 (socket says 172.21.15.26:51010) 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa259c640 1 -- 172.21.15.26:0/2581982949 learned_addr learned my addr 172.21.15.26:0/2581982949 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa359e640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0d93b0 0x7f3a9c04a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f69f559a640 1 -- 172.21.15.26:0/1116371973 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731157265 0 0) 0x7f69f80c2f10 con 0x7f69f80c2a60 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f69f559a640 1 -- 172.21.15.26:0/1116371973 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e0003530 con 0x7f69f80c2a60 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f69f659c640 1 -- 172.21.15.26:0/1116371973 >> v2:172.21.15.169:3300/0 conn(0x7f69f8151b00 msgr2=0x7f69f80cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f69f659c640 1 --2- 172.21.15.26:0/1116371973 >> v2:172.21.15.169:3300/0 conn(0x7f69f8151b00 0x7f69f80cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f69f659c640 1 -- 172.21.15.26:0/1116371973 >> v1:172.21.15.26:6789/0 conn(0x7f69f80c2a60 legacy=0x7f69f806fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f69f659c640 1 -- 172.21.15.26:0/1116371973 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f80c31d0 con 0x7f69f8151720 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa359e640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c050d50 con 0x7f3a9c04d010 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa359e640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c00f2a0 con 0x7f3a9c0d93b0 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa359e640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c050ed0 con 0x7f3a9c00ee60 2024-04-21T08:57:51.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa259c640 1 -- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0d93b0 msgr2=0x7f3a9c04a340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-21T08:57:51.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa259c640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0d93b0 0x7f3a9c04a340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa259c640 1 -- 172.21.15.26:0/2581982949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c04d010 msgr2=0x7f3a9c17ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f3aa259c640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c04d010 0x7f3a9c17ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3aa259c640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c0def60 con 0x7f3a9c00ee60 2024-04-21T08:57:51.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbf0401b070 con 0x7fbf10007c90 2024-04-21T08:57:51.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.978+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d30017070 con 0x7f1d3c0cca10 2024-04-21T08:57:51.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3aa259c640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c0e2ce0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400c2f0 tx=0x7f3a9400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d397fa640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1d20068400 0x7f1d2006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fd414bbc640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd410151030 0x7fd41014f6c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd408001570 tx=0x7fd40800cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a940052d0 con 0x7f3a9c00ee60 2024-04-21T08:57:51.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1d30086690 con 0x7f1d3c0cca10 2024-04-21T08:57:51.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d397fa640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:6806/2156201471,v1:172.21.15.26:6809/2156201471] conn(0x7f1d20070600 0x7f1d20072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 --> [v2:172.21.15.26:6806/2156201471,v1:172.21.15.26:6809/2156201471] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d200730d0 con 0x7f1d20070600 2024-04-21T08:57:51.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7d4007780 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3aa359e640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c17f730 con 0x7f3a9c00ee60 2024-04-21T08:57:51.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3aa359e640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c17fc90 con 0x7f3a9c00ee60 2024-04-21T08:57:51.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7d97fa640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa7c0068400 0x7fa7c006a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa7d4086680 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7d97fa640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6800/3582063879,v1:172.21.15.169:6801/3582063879] conn(0x7fa7c0070620 0x7fa7c0072a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 --> [v2:172.21.15.169:6800/3582063879,v1:172.21.15.169:6801/3582063879] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7c00730f0 con 0x7fa7c0070620 2024-04-21T08:57:51.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa7d4086b60 con 0x7fa7dc0c34c0 2024-04-21T08:57:51.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf03fff640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbefc068400 0x7fbefc06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbf04085f00 con 0x7fbf10007c90 2024-04-21T08:57:51.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf03fff640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.26:6824/3089494797,v1:172.21.15.26:6825/3089494797] conn(0x7fbefc070680 0x7fbefc072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 --> [v2:172.21.15.26:6824/3089494797,v1:172.21.15.26:6825/3089494797] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbefc073150 con 0x7fbefc070680 2024-04-21T08:57:51.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fbf04086370 con 0x7fbf10007c90 2024-04-21T08:57:51.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7dbfff640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6800/3582063879,v1:172.21.15.169:6801/3582063879] conn(0x7fa7c0070620 0x7fa7c0072a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf16ffd640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbefc068400 0x7fbefc06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf17fff640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.26:6824/3089494797,v1:172.21.15.26:6825/3089494797] conn(0x7fbefc070680 0x7fbefc072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7e085b640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa7c0068400 0x7fa7c006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d41069640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:6806/2156201471,v1:172.21.15.26:6809/2156201471] conn(0x7f1d20070600 0x7f1d20072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d40868640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1d20068400 0x7f1d2006a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd408018070 con 0x7fd410151030 2024-04-21T08:57:51.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d41069640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:6806/2156201471,v1:172.21.15.26:6809/2156201471] conn(0x7f1d20070600 0x7f1d20072a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf17fff640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.26:6824/3089494797,v1:172.21.15.26:6825/3089494797] conn(0x7fbefc070680 0x7fbefc072aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3aa359e640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3a9c0059c0 con 0x7f3a9c00ee60 2024-04-21T08:57:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd40800a640 con 0x7fd410151030 2024-04-21T08:57:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd40800aa30 con 0x7fd410151030 2024-04-21T08:57:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4101f7dd0 con 0x7fd410151030 2024-04-21T08:57:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4101f8390 con 0x7fd410151030 2024-04-21T08:57:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feff8094030 con 0x7feff00db270 2024-04-21T08:57:51.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fefedffb640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fefdc068480 0x7fefdc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feff8102000 con 0x7feff00db270 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fefedffb640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.26:6800/852338092,v1:172.21.15.26:6801/852338092] conn(0x7fefdc070700 0x7fefdc072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 --> [v2:172.21.15.26:6800/852338092,v1:172.21.15.26:6801/852338092] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feff8099ec0 con 0x7fefdc070700 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7feff81023f0 con 0x7feff00db270 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a50012b70 con 0x7f3a5404f4a0 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a437fe640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a48068380 0x7f3a4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3a50087570 con 0x7f3a5404f4a0 2024-04-21T08:57:51.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a437fe640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6809/190806267,v1:172.21.15.169:6811/190806267] conn(0x7f3a48070600 0x7f3a48072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 --> [v2:172.21.15.169:6809/190806267,v1:172.21.15.169:6811/190806267] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a50029ef0 con 0x7f3a48070600 2024-04-21T08:57:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3a50087960 con 0x7f3a5404f4a0 2024-04-21T08:57:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a94005470 con 0x7f3a9c00ee60 2024-04-21T08:57:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a5affd640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a48068380 0x7f3a4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d40868640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1d20068400 0x7f1d2006a8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d280ad000 tx=0x7f1d280a4f90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7feffd548640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fefdc068480 0x7fefdc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a5a7fc640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6809/190806267,v1:172.21.15.169:6811/190806267] conn(0x7f3a48070600 0x7f3a48072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7feffcd47640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.26:6800/852338092,v1:172.21.15.26:6801/852338092] conn(0x7fefdc070700 0x7fefdc072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f1d3008d050 con 0x7f1d3c0cca10 2024-04-21T08:57:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== osd.0 v2:172.21.15.26:6806/2156201471 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d200730d0 con 0x7f1d20070600 2024-04-21T08:57:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf16ffd640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbefc068400 0x7fbefc06a8c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf10051160 tx=0x7fbf0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7dbfff640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6800/3582063879,v1:172.21.15.169:6801/3582063879] conn(0x7fa7c0070620 0x7fa7c0072a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd410075e80 con 0x7fd410151030 2024-04-21T08:57:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a94007240 con 0x7f3a9c00ee60 2024-04-21T08:57:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== osd.2 v2:172.21.15.26:6824/3089494797 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbefc073150 con 0x7fbefc070680 2024-04-21T08:57:51.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7feffcd47640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.26:6800/852338092,v1:172.21.15.26:6801/852338092] conn(0x7fefdc070700 0x7fefdc072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f69f659c640 1 --2- 172.21.15.26:0/1116371973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f8151720 0x7f69f80cacb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f69e800bb10 tx=0x7f69e8020e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd305be1af084d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7fa7e085b640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa7c0068400 0x7fa7c006a8c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00ad000 tx=0x7fa7d0004850 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.982+0000 7f3a5affd640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a48068380 0x7f3a4806a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a54032e20 tx=0x7f3a4c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7feffd548640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fefdc068480 0x7fefdc06a940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feff4000f70 tx=0x7feff4005e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== osd.3 v2:172.21.15.26:6800/852338092 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feff8099ec0 con 0x7fefdc070700 2024-04-21T08:57:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3a5a7fc640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6809/190806267,v1:172.21.15.169:6811/190806267] conn(0x7f3a48070600 0x7f3a48072a20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a940073e0 con 0x7f3a9c00ee60 2024-04-21T08:57:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3a92ffd640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a840683b0 0x7f3a8406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3a940866a0 con 0x7f3a9c00ee60 2024-04-21T08:57:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f69f559a640 1 -- 172.21.15.26:0/1116371973 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80b6070 con 0x7f69f8151720 2024-04-21T08:57:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3a92ffd640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6808/2167632650,v1:172.21.15.169:6810/2167632650] conn(0x7f3a84070550 0x7f3a84072970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:6808/2167632650,v1:172.21.15.169:6810/2167632650] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a94005470 con 0x7f3a84070550 2024-04-21T08:57:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f69f559a640 1 -- 172.21.15.26:0/1116371973 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69e80a9e00 con 0x7f69f8151720 2024-04-21T08:57:51.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f69f559a640 1 -- 172.21.15.26:0/1116371973 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80b1640 con 0x7f69f8151720 2024-04-21T08:57:51.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f3a94086a50 con 0x7f3a9c00ee60 2024-04-21T08:57:51.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd40800abd0 con 0x7fd410151030 2024-04-21T08:57:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3aa1d9b640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a840683b0 0x7f3a8406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3aa8d94640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6808/2167632650,v1:172.21.15.169:6810/2167632650] conn(0x7f3a84070550 0x7f3a84072970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fd40cff9640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3f0068380 0x7fd3f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd408086810 con 0x7fd410151030 2024-04-21T08:57:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fd40cff9640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.26:6807/1666945982,v1:172.21.15.26:6811/1666945982] conn(0x7fd3f0070580 0x7fd3f00729a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 --> [v2:172.21.15.26:6807/1666945982,v1:172.21.15.26:6811/1666945982] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3f0073050 con 0x7fd3f0070580 2024-04-21T08:57:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fd408086ca0 con 0x7fd410151030 2024-04-21T08:57:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f69fcea2640 1 -- 172.21.15.26:0/1116371973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f8151720 msgr2=0x7f69f80cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f69fcea2640 1 --2- 172.21.15.26:0/1116371973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f8151720 0x7f69f80cacb0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f69e800bb10 tx=0x7f69e8020e50 comp rx=0 tx=0).stop 2024-04-21T08:57:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== osd.4 v2:172.21.15.169:6800/3582063879 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7c00730f0 con 0x7fa7c0070620 2024-04-21T08:57:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7fd40ffff640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3f0068380 0x7fd3f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.986+0000 7f3aa1d9b640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a840683b0 0x7f3a8406a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0df250 tx=0x7f3a98006c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7fd40f7fe640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.26:6807/1666945982,v1:172.21.15.26:6811/1666945982] conn(0x7fd3f0070580 0x7fd3f00729a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7fd40ffff640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3f0068380 0x7fd3f006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd4000013c0 tx=0x7fd400009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7fd40f7fe640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.26:6807/1666945982,v1:172.21.15.26:6811/1666945982] conn(0x7fd3f0070580 0x7fd3f00729a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7f3aa8d94640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6808/2167632650,v1:172.21.15.169:6810/2167632650] conn(0x7f3a84070550 0x7f3a84072970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7f69fcea2640 1 -- 172.21.15.26:0/1116371973 shutdown_connections 2024-04-21T08:57:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7f69fcea2640 1 --2- 172.21.15.26:0/1116371973 >> v2:172.21.15.169:3300/0 conn(0x7f69f8151b00 0x7f69f80cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7f69fcea2640 1 --2- 172.21.15.26:0/1116371973 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f8151720 0x7f69f80cacb0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7f69fcea2640 1 -- 172.21.15.26:0/1116371973 >> 172.21.15.26:0/1116371973 conn(0x7f69f8067e70 msgr2=0x7f69f80cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== osd.1 v2:172.21.15.26:6807/1666945982 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd3f0073050 con 0x7fd3f0070580 2024-04-21T08:57:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.990+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== osd.5 v2:172.21.15.169:6808/2167632650 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a94005470 con 0x7f3a84070550 2024-04-21T08:57:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.994+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== osd.6 v2:172.21.15.169:6809/190806267 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3a50029ef0 con 0x7f3a48070600 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.994+0000 7f69fcea2640 1 -- 172.21.15.26:0/1116371973 shutdown_connections 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.994+0000 7f69fcea2640 1 -- 172.21.15.26:0/1116371973 wait complete. 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 Processor -- start 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 -- start start 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f80c2a60 0x7f69f813c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69f8151720 0x7f69f813e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69f81565c0 0x7f69f8156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8070370 con 0x7f69f81565c0 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f69f80cbc60 con 0x7f69f8151720 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f69f80704f0 con 0x7f69f80c2a60 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69f81565c0 0x7f69f8156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69f81565c0 0x7f69f8156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54144/0 (socket says 172.21.15.26:54144) 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 -- 172.21.15.26:0/78407616 learned_addr learned my addr 172.21.15.26:0/78407616 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f659c640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f80c2a60 0x7f69f813c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f5d9b640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69f8151720 0x7f69f813e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 -- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f80c2a60 msgr2=0x7f69f813c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f80c2a60 0x7f69f813c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 -- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69f8151720 msgr2=0x7f69f813e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f69f8151720 0x7f69f813e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 -- 172.21.15.26:0/78407616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f81ed590 con 0x7f69f81565c0 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f659c640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f69f80c2a60 0x7f69f813c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69f6d9d640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69f81565c0 0x7f69f8156a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c760 tx=0x7f69f000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69e6ffd640 1 -- 172.21.15.26:0/78407616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0003b80 con 0x7f69f81565c0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69e6ffd640 1 -- 172.21.15.26:0/78407616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f0003d40 con 0x7f69f81565c0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69e6ffd640 1 -- 172.21.15.26:0/78407616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f000aa90 con 0x7f69f81565c0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f81ed850 con 0x7f69f81565c0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:50.998+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f813fac0 con 0x7f69f81565c0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.002+0000 7f69e6ffd640 1 -- 172.21.15.26:0/78407616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69f000ac30 con 0x7f69f81565c0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.002+0000 7f69e6ffd640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f69d8068450 0x7f69d806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.002+0000 7f69e6ffd640 1 -- 172.21.15.26:0/78407616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f69f0086850 con 0x7f69f81565c0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.002+0000 7f69fcea2640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6824/1350262825,v1:172.21.15.169:6825/1350262825] conn(0x7f69dc001660 0x7f69dc003b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.002+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 --> [v2:172.21.15.169:6824/1350262825,v1:172.21.15.169:6825/1350262825] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69dc006bc0 con 0x7f69dc001660 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.002+0000 7f69f659c640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f69d8068450 0x7f69d806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.002+0000 7f69f5d9b640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6824/1350262825,v1:172.21.15.169:6825/1350262825] conn(0x7f69dc001660 0x7f69dc003b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.006+0000 7f69f659c640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f69d8068450 0x7f69d806a910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69e80b3000 tx=0x7f69e80ab070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.006+0000 7f69f5d9b640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6824/1350262825,v1:172.21.15.169:6825/1350262825] conn(0x7f69dc001660 0x7f69dc003b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.006+0000 7f69e6ffd640 1 -- 172.21.15.26:0/78407616 <== osd.7 v2:172.21.15.169:6824/1350262825 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69dc006bc0 con 0x7f69dc001660 2024-04-21T08:57:51.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf1c85a640 1 -- 172.21.15.26:0/2314510575 --> [v2:172.21.15.26:6824/3089494797,v1:172.21.15.26:6825/3089494797] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbef8002de0 con 0x7fbefc070680 2024-04-21T08:57:51.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf03fff640 1 -- 172.21.15.26:0/2314510575 <== osd.2 v2:172.21.15.26:6824/3089494797 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbef8002de0 con 0x7fbefc070680 2024-04-21T08:57:51.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 -- 172.21.15.26:0/2314510575 >> [v2:172.21.15.26:6824/3089494797,v1:172.21.15.26:6825/3089494797] conn(0x7fbefc070680 msgr2=0x7fbefc072aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.26:6824/3089494797,v1:172.21.15.26:6825/3089494797] conn(0x7fbefc070680 0x7fbefc072aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 -- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbefc068400 msgr2=0x7fbefc06a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbefc068400 0x7fbefc06a8c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbf10051160 tx=0x7fbf0c008040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 -- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf10007c90 msgr2=0x7fbf1004fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 --2- 172.21.15.26:0/2314510575 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf10007c90 0x7fbf1004fc50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c580 tx=0x7fbf0400ca40 comp rx=0 tx=0).stop 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf17fff640 1 -- 172.21.15.26:0/2314510575 reap_dead start 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 -- 172.21.15.26:0/2314510575 shutdown_connections 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 -- 172.21.15.26:0/2314510575 >> 172.21.15.26:0/2314510575 conn(0x7fbf1004dd40 msgr2=0x7fbf1004bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 -- 172.21.15.26:0/2314510575 shutdown_connections 2024-04-21T08:57:51.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.010+0000 7fbf01ffb640 1 -- 172.21.15.26:0/2314510575 wait complete. 2024-04-21T08:57:51.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.014+0000 7fa7e185d640 1 -- 172.21.15.26:0/2145594118 --> [v2:172.21.15.169:6800/3582063879,v1:172.21.15.169:6801/3582063879] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7dc075e80 con 0x7fa7c0070620 2024-04-21T08:57:51.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.014+0000 7fa7d97fa640 1 -- 172.21.15.26:0/2145594118 <== osd.4 v2:172.21.15.169:6800/3582063879 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa7dc075e80 con 0x7fa7c0070620 2024-04-21T08:57:51.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 -- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6800/3582063879,v1:172.21.15.169:6801/3582063879] conn(0x7fa7c0070620 msgr2=0x7fa7c0072a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6800/3582063879,v1:172.21.15.169:6801/3582063879] conn(0x7fa7c0070620 0x7fa7c0072a40 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 -- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa7c0068400 msgr2=0x7fa7c006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa7c0068400 0x7fa7c006a8c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7d00ad000 tx=0x7fa7d0004850 comp rx=0 tx=0).stop 2024-04-21T08:57:51.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 -- 172.21.15.26:0/2145594118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7dc0c34c0 msgr2=0x7fa7dc0c3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 --2- 172.21.15.26:0/2145594118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa7dc0c34c0 0x7fa7dc0c3940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc0c3180 tx=0x7fa7d400c8e0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7e105c640 1 -- 172.21.15.26:0/2145594118 reap_dead start 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 -- 172.21.15.26:0/2145594118 shutdown_connections 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 -- 172.21.15.26:0/2145594118 >> 172.21.15.26:0/2145594118 conn(0x7fa7dc0c8a80 msgr2=0x7fa7dc14acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 -- 172.21.15.26:0/2145594118 shutdown_connections 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7fa7c6ffd640 1 -- 172.21.15.26:0/2145594118 wait complete. 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7f1d42acc640 1 -- 172.21.15.26:0/1632023349 --> [v2:172.21.15.26:6806/2156201471,v1:172.21.15.26:6809/2156201471] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d1c002de0 con 0x7f1d20070600 2024-04-21T08:57:51.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.018+0000 7f1d397fa640 1 -- 172.21.15.26:0/1632023349 <== osd.0 v2:172.21.15.26:6806/2156201471 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1d1c002de0 con 0x7f1d20070600 2024-04-21T08:57:51.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 --> [v2:172.21.15.26:6800/852338092,v1:172.21.15.26:6801/852338092] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feff00053a0 con 0x7fefdc070700 2024-04-21T08:57:51.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7fefedffb640 1 -- 172.21.15.26:0/3439599182 <== osd.3 v2:172.21.15.26:6800/852338092 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feff00053a0 con 0x7fefdc070700 2024-04-21T08:57:51.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 >> [v2:172.21.15.26:6800/852338092,v1:172.21.15.26:6801/852338092] conn(0x7fefdc070700 msgr2=0x7fefdc072b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.26:6800/852338092,v1:172.21.15.26:6801/852338092] conn(0x7fefdc070700 0x7fefdc072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fefdc068480 msgr2=0x7fefdc06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fefdc068480 0x7fefdc06a940 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feff4000f70 tx=0x7feff4005e70 comp rx=0 tx=0).stop 2024-04-21T08:57:51.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feff00db270 msgr2=0x7feff0175720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 --2- 172.21.15.26:0/3439599182 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feff00db270 0x7feff0175720 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feff806a970 tx=0x7feff8074690 comp rx=0 tx=0).stop 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffdd49640 1 -- 172.21.15.26:0/3439599182 reap_dead start 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 shutdown_connections 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 >> 172.21.15.26:0/3439599182 conn(0x7feff0050190 msgr2=0x7feff00d2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 shutdown_connections 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7feffe54a640 1 -- 172.21.15.26:0/3439599182 wait complete. 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3aa359e640 1 -- 172.21.15.26:0/2581982949 --> [v2:172.21.15.169:6808/2167632650,v1:172.21.15.169:6810/2167632650] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a9c17c6b0 con 0x7f3a84070550 2024-04-21T08:57:51.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3a92ffd640 1 -- 172.21.15.26:0/2581982949 <== osd.5 v2:172.21.15.169:6808/2167632650 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3a9c17c6b0 con 0x7f3a84070550 2024-04-21T08:57:51.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 --> [v2:172.21.15.26:6807/1666945982,v1:172.21.15.26:6811/1666945982] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd4100c8320 con 0x7fd3f0070580 2024-04-21T08:57:51.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3a90ff9640 1 -- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6808/2167632650,v1:172.21.15.169:6810/2167632650] conn(0x7f3a84070550 msgr2=0x7f3a84072970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3a90ff9640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6808/2167632650,v1:172.21.15.169:6810/2167632650] conn(0x7f3a84070550 0x7f3a84072970 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7fd40cff9640 1 -- 172.21.15.26:0/2523701619 <== osd.1 v2:172.21.15.26:6807/1666945982 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd4100c8320 con 0x7fd3f0070580 2024-04-21T08:57:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3a90ff9640 1 -- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a840683b0 msgr2=0x7f3a8406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3a90ff9640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a840683b0 0x7f3a8406a870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c0df250 tx=0x7f3a98006c50 comp rx=0 tx=0).stop 2024-04-21T08:57:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3a90ff9640 1 -- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 msgr2=0x7f3a9c0e2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3a90ff9640 1 --2- 172.21.15.26:0/2581982949 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c00ee60 0x7f3a9c0e2ce0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a9400c2f0 tx=0x7f3a9400c7b0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f3aa8d94640 1 -- 172.21.15.26:0/2581982949 reap_dead start 2024-04-21T08:57:51.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f1d26ffd640 1 -- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:6806/2156201471,v1:172.21.15.26:6809/2156201471] conn(0x7f1d20070600 msgr2=0x7f1d20072a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.022+0000 7f1d26ffd640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:6806/2156201471,v1:172.21.15.26:6809/2156201471] conn(0x7f1d20070600 0x7f1d20072a20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a90ff9640 1 -- 172.21.15.26:0/2581982949 shutdown_connections 2024-04-21T08:57:51.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a90ff9640 1 -- 172.21.15.26:0/2581982949 >> 172.21.15.26:0/2581982949 conn(0x7f3a9c00e340 msgr2=0x7f3a9c00e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a90ff9640 1 -- 172.21.15.26:0/2581982949 shutdown_connections 2024-04-21T08:57:51.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a90ff9640 1 -- 172.21.15.26:0/2581982949 wait complete. 2024-04-21T08:57:51.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 -- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1d20068400 msgr2=0x7f1d2006a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1d20068400 0x7f1d2006a8c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1d280ad000 tx=0x7f1d280a4f90 comp rx=0 tx=0).stop 2024-04-21T08:57:51.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 -- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0cca10 msgr2=0x7f1d3c154e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 >> [v2:172.21.15.26:6807/1666945982,v1:172.21.15.26:6811/1666945982] conn(0x7fd3f0070580 msgr2=0x7fd3f00729a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 --> [v2:172.21.15.169:6809/190806267,v1:172.21.15.169:6811/190806267] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a3c002de0 con 0x7f3a48070600 2024-04-21T08:57:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 --2- 172.21.15.26:0/1632023349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d3c0cca10 0x7f1d3c154e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000b550 tx=0x7f1d3000ba10 comp rx=0 tx=0).stop 2024-04-21T08:57:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d41069640 1 -- 172.21.15.26:0/1632023349 reap_dead start 2024-04-21T08:57:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.26:6807/1666945982,v1:172.21.15.26:6811/1666945982] conn(0x7fd3f0070580 0x7fd3f00729a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 -- 172.21.15.26:0/1632023349 shutdown_connections 2024-04-21T08:57:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 -- 172.21.15.26:0/1632023349 >> 172.21.15.26:0/1632023349 conn(0x7f1d3c0cbef0 msgr2=0x7f1d3c0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3f0068380 msgr2=0x7fd3f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd3f0068380 0x7fd3f006a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd4000013c0 tx=0x7fd400009040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 -- 172.21.15.26:0/1632023349 shutdown_connections 2024-04-21T08:57:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd410151030 msgr2=0x7fd41014f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 --2- 172.21.15.26:0/2523701619 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd410151030 0x7fd41014f6c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd408001570 tx=0x7fd40800cca0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f1d26ffd640 1 -- 172.21.15.26:0/1632023349 wait complete. 2024-04-21T08:57:51.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd414bbc640 1 -- 172.21.15.26:0/2523701619 reap_dead start 2024-04-21T08:57:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 shutdown_connections 2024-04-21T08:57:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 >> 172.21.15.26:0/2523701619 conn(0x7fd41006fde0 msgr2=0x7fd4100c27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 shutdown_connections 2024-04-21T08:57:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7fd4153bd640 1 -- 172.21.15.26:0/2523701619 wait complete. 2024-04-21T08:57:51.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a437fe640 1 -- 172.21.15.26:0/770058245 <== osd.6 v2:172.21.15.169:6809/190806267 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3a3c002de0 con 0x7f3a48070600 2024-04-21T08:57:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6809/190806267,v1:172.21.15.169:6811/190806267] conn(0x7f3a48070600 msgr2=0x7f3a48072a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.026+0000 7f3a5bfff640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6809/190806267,v1:172.21.15.169:6811/190806267] conn(0x7f3a48070600 0x7f3a48072a20 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.030+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a48068380 msgr2=0x7f3a4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.030+0000 7f3a5bfff640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a48068380 0x7f3a4806a840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3a54032e20 tx=0x7f3a4c009040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.030+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404f4a0 msgr2=0x7f3a540d60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.030+0000 7f3a5bfff640 1 --2- 172.21.15.26:0/770058245 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a5404f4a0 0x7f3a540d60f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3a5000d510 tx=0x7f3a5000d9d0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.030+0000 7f3a5b7fe640 1 -- 172.21.15.26:0/770058245 reap_dead start 2024-04-21T08:57:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.030+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 shutdown_connections 2024-04-21T08:57:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.030+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 >> 172.21.15.26:0/770058245 conn(0x7f3a54050190 msgr2=0x7f3a540da2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 --> [v2:172.21.15.169:6824/1350262825,v1:172.21.15.169:6825/1350262825] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f69dc005ca0 con 0x7f69dc001660 2024-04-21T08:57:51.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69e6ffd640 1 -- 172.21.15.26:0/78407616 <== osd.7 v2:172.21.15.169:6824/1350262825 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f69dc005ca0 con 0x7f69dc001660 2024-04-21T08:57:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6824/1350262825,v1:172.21.15.169:6825/1350262825] conn(0x7f69dc001660 msgr2=0x7f69dc003b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6824/1350262825,v1:172.21.15.169:6825/1350262825] conn(0x7f69dc001660 0x7f69dc003b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f69d8068450 msgr2=0x7f69d806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f69d8068450 0x7f69d806a910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f69e80b3000 tx=0x7f69e80ab070 comp rx=0 tx=0).stop 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69f81565c0 msgr2=0x7f69f8156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 --2- 172.21.15.26:0/78407616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69f81565c0 0x7f69f8156a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f69f000c760 tx=0x7f69f000cc20 comp rx=0 tx=0).stop 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69f6d9d640 1 -- 172.21.15.26:0/78407616 reap_dead start 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 shutdown_connections 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 >> 172.21.15.26:0/78407616 conn(0x7f69f8067e70 msgr2=0x7f69f8074b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 shutdown_connections 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.034+0000 7f69fcea2640 1 -- 172.21.15.26:0/78407616 wait complete. 2024-04-21T08:57:51.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.038+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 shutdown_connections 2024-04-21T08:57:51.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.038+0000 7f3a5bfff640 1 -- 172.21.15.26:0/770058245 wait complete. 2024-04-21T08:57:51.065 INFO:teuthology.orchestra.run.smithi026.stdout:64424509445 2024-04-21T08:57:51.066 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-21T08:57:51.066 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2024-04-21T08:57:51.067 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-21T08:57:51.068 INFO:teuthology.orchestra.run.smithi026.stdout:64424509446 2024-04-21T08:57:51.068 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-21T08:57:51.069 INFO:teuthology.orchestra.run.smithi026.stdout:64424509447 2024-04-21T08:57:51.069 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-21T08:57:51.069 INFO:teuthology.orchestra.run.smithi026.stdout:64424509446 2024-04-21T08:57:51.070 INFO:teuthology.orchestra.run.smithi026.stdout:60129542149 2024-04-21T08:57:51.070 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-21T08:57:51.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-21T08:57:51.072 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2024-04-21T08:57:51.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-21T08:57:51.073 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2024-04-21T08:57:51.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-21T08:57:51.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f9982340640 1 Processor -- start 2024-04-21T08:57:51.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f9982340640 1 -- start start 2024-04-21T08:57:51.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7fcdd12f0640 1 Processor -- start 2024-04-21T08:57:51.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f9982340640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f997c06f6b0 0x7f997c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f9982340640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f997c071310 0x7f997c0cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f9982340640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997c0c0f90 con 0x7f997c0c7490 2024-04-21T08:57:51.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f9982340640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f997c0c7c10 con 0x7f997c06f6b0 2024-04-21T08:57:51.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f9982340640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f997c0c1270 con 0x7f997c071310 2024-04-21T08:57:51.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7fcdd12f0640 1 -- start start 2024-04-21T08:57:51.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f997bfff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f997c0c7490 0x7f997c150ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:38350/0 (socket says 172.21.15.26:38350) 2024-04-21T08:57:51.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f99808dd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f997c071310 0x7f997c0cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f997bfff640 1 -- 172.21.15.26:0/4125190284 learned_addr learned my addr 172.21.15.26:0/4125190284 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:51.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7f997b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f997c06f6b0 0x7f997c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7fcdd12f0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdcc0cb100 0x7fcdcc0d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7fcdd12f0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdcc15aef0 con 0x7fcdcc154a80 2024-04-21T08:57:51.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7fcdd12f0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdcc15b1b0 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.282+0000 7fcdd12f0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcdcc0c5e60 con 0x7fcdcc0cb100 2024-04-21T08:57:51.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 Processor -- start 2024-04-21T08:57:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 -- start start 2024-04-21T08:57:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcdcaffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fcdcc154a80 0x7fcdcc0c65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42406/0 (socket says 172.21.15.26:42406) 2024-04-21T08:57:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcdcaffd640 1 -- 172.21.15.26:0/2082709637 learned_addr learned my addr 172.21.15.26:0/2082709637 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcdcb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdcc0cb100 0x7fcdcc0d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f99808dd640 1 -- 172.21.15.26:0/4125190284 >> v2:172.21.15.26:3300/0 conn(0x7f997c06f6b0 msgr2=0x7f997c0cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f99808dd640 1 --2- 172.21.15.26:0/4125190284 >> v2:172.21.15.26:3300/0 conn(0x7f997c06f6b0 0x7f997c0cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f99808dd640 1 -- 172.21.15.26:0/4125190284 >> v1:172.21.15.169:6789/0 conn(0x7f997c0c7490 legacy=0x7f997c150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f99808dd640 1 -- 172.21.15.26:0/4125190284 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c0c1550 con 0x7f997c071310 2024-04-21T08:57:51.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670e9c9640 1 Processor -- start 2024-04-21T08:57:51.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcdcb7fe640 1 -- 172.21.15.26:0/2082709637 >> v1:172.21.15.169:6789/0 conn(0x7fcdcc0c6ce0 legacy=0x7fcdcc0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcdcb7fe640 1 -- 172.21.15.26:0/2082709637 >> v1:172.21.15.26:6789/0 conn(0x7fcdcc154a80 legacy=0x7fcdcc0c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcdcb7fe640 1 -- 172.21.15.26:0/2082709637 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc15b490 con 0x7fcdcc0cb100 2024-04-21T08:57:51.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efdacf38640 1 Processor -- start 2024-04-21T08:57:51.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31ba297640 1 Processor -- start 2024-04-21T08:57:51.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd440c0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcd4406c020 0x7fcd440c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd44073c40 0x7fcd440c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcd440c13a0 con 0x7fcd44073c40 2024-04-21T08:57:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcd4415ac80 con 0x7fcd4406c020 2024-04-21T08:57:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4359e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4415af60 con 0x7fcd4406bc40 2024-04-21T08:57:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efdacf38640 1 -- start start 2024-04-21T08:57:51.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670e9c9640 1 -- start start 2024-04-21T08:57:51.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31ba297640 1 -- start start 2024-04-21T08:57:51.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68c012e640 1 Processor -- start 2024-04-21T08:57:51.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68c012e640 1 -- start start 2024-04-21T08:57:51.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcd4406c020 0x7fcd440c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcd4406c020 0x7fcd440c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51614/0 (socket says 172.21.15.26:51614) 2024-04-21T08:57:51.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 -- 172.21.15.26:0/1094128798 learned_addr learned my addr 172.21.15.26:0/1094128798 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd4259c640 1 --2- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd440c0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670e9c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f67080738b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670e9c9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6708073df0 0x7f67080cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670e9c9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67080c7b50 con 0x7f67081590c0 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670e9c9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f67081594a0 con 0x7f6708073df0 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670e9c9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6708072810 con 0x7f67080c6df0 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670cf66640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6708073df0 0x7f67080cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670cf66640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6708073df0 0x7f67080cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51624/0 (socket says 172.21.15.26:51624) 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f670cf66640 1 -- 172.21.15.26:0/3701547907 learned_addr learned my addr 172.21.15.26:0/3701547907 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd42d9d640 1 --2- 172.21.15.26:0/1094128798 >> v2:172.21.15.26:3300/0 conn(0x7fcd44073c40 0x7fcd440c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31ba297640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31b40c6860 0x7f31b40c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31ba297640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b406d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31ba297640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31b41626e0 con 0x7f31b4159010 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31ba297640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f31b40c8680 con 0x7f31b40c6860 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31ba297640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f31b41593f0 con 0x7f31b4162150 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68c012e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f68b80c2840 0x7f68b80c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68c012e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b816c6d0 0x7f68b80cbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68c012e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b80c82d0 con 0x7f68b80c2c20 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68c012e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f68b80c9480 con 0x7f68b80c2840 2024-04-21T08:57:51.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68c012e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f68b80c8590 con 0x7f68b816c6d0 2024-04-21T08:57:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f3aa3f4e640 1 Processor -- start 2024-04-21T08:57:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f3aa3f4e640 1 -- start start 2024-04-21T08:57:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efdacf38640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 0x7efda80cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efdacf38640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efda81594c0 0x7efda80cb690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 -- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 msgr2=0x7fcd440c0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 --2- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd440c0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 -- 172.21.15.26:0/1094128798 >> v2:172.21.15.26:3300/0 conn(0x7fcd44073c40 msgr2=0x7fcd440c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 --2- 172.21.15.26:0/1094128798 >> v2:172.21.15.26:3300/0 conn(0x7fcd44073c40 0x7fcd440c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7fcd41d9b640 1 -- 172.21.15.26:0/1094128798 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd4415b240 con 0x7fcd4406c020 2024-04-21T08:57:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b8a94640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31b40c6860 0x7f31b40c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b8a94640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31b40c6860 0x7f31b40c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54176/0 (socket says 172.21.15.26:54176) 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b8a94640 1 -- 172.21.15.26:0/3869461644 learned_addr learned my addr 172.21.15.26:0/3869461644 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b9a96640 1 --2- 172.21.15.26:0/3869461644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b406d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b8a94640 1 -- 172.21.15.26:0/3869461644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 msgr2=0x7f31b406d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b8a94640 1 --2- 172.21.15.26:0/3869461644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b406d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b8a94640 1 -- 172.21.15.26:0/3869461644 >> v1:172.21.15.26:6789/0 conn(0x7f31b4159010 legacy=0x7f31b40c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f31b8a94640 1 -- 172.21.15.26:0/3869461644 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b41629c0 con 0x7f31b40c6860 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68bd6c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b816c6d0 0x7f68b80cbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68bd6c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b816c6d0 0x7f68b80cbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:51062/0 (socket says 172.21.15.26:51062) 2024-04-21T08:57:51.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f68bd6c9640 1 -- 172.21.15.26:0/512933277 learned_addr learned my addr 172.21.15.26:0/512933277 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f99808dd640 1 --2- 172.21.15.26:0/4125190284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c071310 0x7f997c0cc340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f997c06e750 tx=0x7f997401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20b5383ab028d542 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa3f4e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c072af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa3f4e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3a9c073030 0x7f3a9c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa3f4e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9c15a040 con 0x7f3a9c0c7bc0 2024-04-21T08:57:51.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa3f4e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3a9c0735c0 con 0x7f3a9c073030 2024-04-21T08:57:51.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa3f4e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c15a2e0 con 0x7f3a9c150c90 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f67077fe640 1 --2- 172.21.15.26:0/3701547907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f67080738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f6706ffd640 1 -- 172.21.15.26:0/3701547907 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066883360 0 0) 0x7f67080c7b50 con 0x7f67081590c0 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7f6706ffd640 1 -- 172.21.15.26:0/3701547907 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66f0003530 con 0x7f67081590c0 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efdacf38640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efda80cb3b0 con 0x7efda80c5130 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efdacf38640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7efda80cd3a0 con 0x7efda81594c0 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efdacf38640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efda80c55c0 con 0x7efda81590e0 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efda7fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7efda80c5130 0x7efda80d01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:38376/0 (socket says 172.21.15.26:38376) 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.286+0000 7efda7fff640 1 -- 172.21.15.26:0/34137582 learned_addr learned my addr 172.21.15.26:0/34137582 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:51.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efd9ffff640 1 --2- 172.21.15.26:0/34137582 >> v2:172.21.15.169:3300/0 conn(0x7efda81594c0 0x7efda80cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f68bdeca640 1 --2- 172.21.15.26:0/512933277 >> v2:172.21.15.169:3300/0 conn(0x7f68b80c2840 0x7f68b80c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda77fe640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 0x7efda80cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdcb7fe640 1 --2- 172.21.15.26:0/2082709637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 0x7fcdcc0d0870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009d90 tx=0x7fcdc401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59ab42f08efe03d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f68bcec8640 1 -- 172.21.15.26:0/512933277 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154869487 0 0) 0x7f68b80c82d0 con 0x7f68b80c2c20 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f68bcec8640 1 -- 172.21.15.26:0/512933277 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68a4003530 con 0x7f68b80c2c20 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f68bd6c9640 1 -- 172.21.15.26:0/512933277 >> v2:172.21.15.169:3300/0 conn(0x7f68b80c2840 msgr2=0x7f68b80c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f68bd6c9640 1 --2- 172.21.15.26:0/512933277 >> v2:172.21.15.169:3300/0 conn(0x7f68b80c2840 0x7f68b80c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f68bd6c9640 1 -- 172.21.15.26:0/512933277 >> v1:172.21.15.26:6789/0 conn(0x7f68b80c2c20 legacy=0x7f68b816ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f68bd6c9640 1 -- 172.21.15.26:0/512933277 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b80c8870 con 0x7f68b816c6d0 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa24eb640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a9c0c7bc0 0x7f3a9c156aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42442/0 (socket says 172.21.15.26:42442) 2024-04-21T08:57:51.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa24eb640 1 -- 172.21.15.26:0/4127864251 learned_addr learned my addr 172.21.15.26:0/4127864251 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdc9ffb640 1 -- 172.21.15.26:0/2082709637 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40b2070 con 0x7fcdcc0cb100 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdc9ffb640 1 -- 172.21.15.26:0/2082709637 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdc40a5830 con 0x7fcdcc0cb100 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdc9ffb640 1 -- 172.21.15.26:0/2082709637 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdc40a5c00 con 0x7fcdcc0cb100 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdd12f0640 1 -- 172.21.15.26:0/2082709637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 msgr2=0x7fcdcc0d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdd12f0640 1 --2- 172.21.15.26:0/2082709637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 0x7fcdcc0d0870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcdc4009d90 tx=0x7fcdc401c970 comp rx=0 tx=0).stop 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa14e9640 1 --2- 172.21.15.26:0/4127864251 >> v2:172.21.15.169:3300/0 conn(0x7f3a9c073030 0x7f3a9c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa1cea640 1 --2- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa0ce8640 1 -- 172.21.15.26:0/4127864251 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2916568597 0 0) 0x7f3a9c15a040 con 0x7f3a9c0c7bc0 2024-04-21T08:57:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa0ce8640 1 -- 172.21.15.26:0/4127864251 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a8800bd40 con 0x7f3a9c0c7bc0 2024-04-21T08:57:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa14e9640 1 -- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 msgr2=0x7f3a9c072af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa14e9640 1 --2- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c072af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa14e9640 1 -- 172.21.15.26:0/4127864251 >> v1:172.21.15.26:6789/0 conn(0x7f3a9c0c7bc0 legacy=0x7f3a9c156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f3aa14e9640 1 -- 172.21.15.26:0/4127864251 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c15a5c0 con 0x7f3a9c073030 2024-04-21T08:57:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31b8a94640 1 --2- 172.21.15.26:0/3869461644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b40c6860 0x7f31b40c8140 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31b415c860 tx=0x7f31a401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0cea4461a0281f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdd12f0640 1 -- 172.21.15.26:0/2082709637 shutdown_connections 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdd12f0640 1 --2- 172.21.15.26:0/2082709637 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 0x7fcdcc0d0870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdd12f0640 1 -- 172.21.15.26:0/2082709637 >> 172.21.15.26:0/2082709637 conn(0x7fcdcc067760 msgr2=0x7fcdcc067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdd12f0640 1 -- 172.21.15.26:0/2082709637 shutdown_connections 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f6706ffd640 1 -- 172.21.15.26:0/3701547907 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 856506481 0 0) 0x7f66f0003530 con 0x7f67081590c0 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f67077fe640 1 -- 172.21.15.26:0/3701547907 >> v2:172.21.15.169:3300/0 conn(0x7f6708073df0 msgr2=0x7f67080cbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f67077fe640 1 --2- 172.21.15.26:0/3701547907 >> v2:172.21.15.169:3300/0 conn(0x7f6708073df0 0x7f67080cbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f67077fe640 1 -- 172.21.15.26:0/3701547907 >> v1:172.21.15.26:6789/0 conn(0x7f67081590c0 legacy=0x7f670815f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f67077fe640 1 -- 172.21.15.26:0/3701547907 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6708072af0 con 0x7f67080c6df0 2024-04-21T08:57:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcdd12f0640 1 -- 172.21.15.26:0/2082709637 wait complete. 2024-04-21T08:57:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597856219 0 0) 0x7efda80cb3b0 con 0x7efda80c5130 2024-04-21T08:57:51.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd94003530 con 0x7efda80c5130 2024-04-21T08:57:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31abfff640 1 -- 172.21.15.26:0/3869461644 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a40b1070 con 0x7f31b40c6860 2024-04-21T08:57:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31abfff640 1 -- 172.21.15.26:0/3869461644 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a40ac640 con 0x7f31b40c6860 2024-04-21T08:57:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31abfff640 1 -- 172.21.15.26:0/3869461644 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a40aca10 con 0x7f31b40c6860 2024-04-21T08:57:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 -- 172.21.15.26:0/3869461644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b40c6860 msgr2=0x7f31b40c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 --2- 172.21.15.26:0/3869461644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b40c6860 0x7f31b40c8140 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f31b415c860 tx=0x7f31a401c440 comp rx=0 tx=0).stop 2024-04-21T08:57:51.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f997affd640 1 -- 172.21.15.26:0/4125190284 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99740b4070 con 0x7f997c071310 2024-04-21T08:57:51.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f997affd640 1 -- 172.21.15.26:0/4125190284 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99740af600 con 0x7f997c071310 2024-04-21T08:57:51.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f997affd640 1 -- 172.21.15.26:0/4125190284 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99740af9d0 con 0x7f997c071310 2024-04-21T08:57:51.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f9982340640 1 -- 172.21.15.26:0/4125190284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c071310 msgr2=0x7f997c0cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f9982340640 1 --2- 172.21.15.26:0/4125190284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c071310 0x7f997c0cc340 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f997c06e750 tx=0x7f997401f150 comp rx=0 tx=0).stop 2024-04-21T08:57:51.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7fcd41d9b640 1 --2- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4406c020 0x7fcd440c7d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406fd90 tx=0x7fcd3c01f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dd473c096a5fb83 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 387520468 0 0) 0x7efd94003530 con 0x7efda80c5130 2024-04-21T08:57:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 msgr2=0x7efda80cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 0x7efda80cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 -- 172.21.15.26:0/3869461644 shutdown_connections 2024-04-21T08:57:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 --2- 172.21.15.26:0/3869461644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b406d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 --2- 172.21.15.26:0/3869461644 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b40c6860 0x7f31b40c8140 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 -- 172.21.15.26:0/3869461644 >> 172.21.15.26:0/3869461644 conn(0x7f31b40c8a80 msgr2=0x7f31b40c8e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 >> v2:172.21.15.169:3300/0 conn(0x7efda81594c0 msgr2=0x7efda80cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 --2- 172.21.15.26:0/34137582 >> v2:172.21.15.169:3300/0 conn(0x7efda81594c0 0x7efda80cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda80cc4b0 con 0x7efda80c5130 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7efda0001a00 con 0x7efda80c5130 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f9982340640 1 -- 172.21.15.26:0/4125190284 shutdown_connections 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f9982340640 1 --2- 172.21.15.26:0/4125190284 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c071310 0x7f997c0cc340 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f9982340640 1 --2- 172.21.15.26:0/4125190284 >> v2:172.21.15.26:3300/0 conn(0x7f997c06f6b0 0x7f997c0cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f9982340640 1 -- 172.21.15.26:0/4125190284 >> 172.21.15.26:0/4125190284 conn(0x7f997c067d60 msgr2=0x7f997c06ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 >> v1:172.21.15.169:6789/0 conn(0x7efda80c5130 legacy=0x7efda80d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 -- 172.21.15.26:0/3869461644 shutdown_connections 2024-04-21T08:57:51.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f31ba297640 1 -- 172.21.15.26:0/3869461644 wait complete. 2024-04-21T08:57:51.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7f9982340640 1 -- 172.21.15.26:0/4125190284 shutdown_connections 2024-04-21T08:57:51.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 0x7efd94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd94004d50 0x7efd940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efda80cd3a0 con 0x7efd94004d50 2024-04-21T08:57:51.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efda80c55c0 con 0x7efd940039c0 2024-04-21T08:57:51.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.290+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efd9400ba90 con 0x7efda81590e0 2024-04-21T08:57:51.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 Processor -- start 2024-04-21T08:57:51.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68bd6c9640 1 --2- 172.21.15.26:0/512933277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b816c6d0 0x7f68b80cbd20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68b80c9600 tx=0x7f68b401ed70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f8fe32880d627b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f67077fe640 1 --2- 172.21.15.26:0/3701547907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f67080738b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6708159620 tx=0x7f670001f060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b93f2260daec51b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda7fff640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd94004d50 0x7efd940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 -- start start 2024-04-21T08:57:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efd9ffff640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 0x7efd94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 -- 172.21.15.26:0/4125190284 wait complete. 2024-04-21T08:57:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda77fe640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda7fff640 1 -- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 msgr2=0x7efd94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda7fff640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efda81590e0 0x7efd94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda7fff640 1 -- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd940039c0 msgr2=0x7efd94003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68bcec8640 1 -- 172.21.15.26:0/512933277 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b40b5070 con 0x7f68b816c6d0 2024-04-21T08:57:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f6706ffd640 1 -- 172.21.15.26:0/3701547907 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67000b5070 con 0x7f67080c6df0 2024-04-21T08:57:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f6706ffd640 1 -- 172.21.15.26:0/3701547907 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67000a8bb0 con 0x7f67080c6df0 2024-04-21T08:57:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f6706ffd640 1 -- 172.21.15.26:0/3701547907 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc001680 con 0x7f67080c6df0 2024-04-21T08:57:51.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda7fff640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda7fff640 1 -- 172.21.15.26:0/34137582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda80cc4b0 con 0x7efd94004d50 2024-04-21T08:57:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa14e9640 1 --2- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c073030 0x7f3a9c0cbd00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00a860 tx=0x7f3a8c01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e8f942cce8a18 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda77fe640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efd940039c0 0x7efd94003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa0ce8640 1 -- 172.21.15.26:0/4127864251 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c0ae070 con 0x7f3a9c073030 2024-04-21T08:57:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa0ce8640 1 -- 172.21.15.26:0/4127864251 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a8c0a8e10 con 0x7f3a9c073030 2024-04-21T08:57:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa0ce8640 1 -- 172.21.15.26:0/4127864251 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c0b2600 con 0x7f3a9c073030 2024-04-21T08:57:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 Processor -- start 2024-04-21T08:57:51.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdcc0c6ce0 0x7fcdcc15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 0x7fcdcc15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68bcec8640 1 -- 172.21.15.26:0/512933277 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b40a8a30 con 0x7f68b816c6d0 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68bcec8640 1 -- 172.21.15.26:0/512933277 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b40a8e00 con 0x7f68b816c6d0 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68c012e640 1 -- 172.21.15.26:0/512933277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b816c6d0 msgr2=0x7f68b80cbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68c012e640 1 --2- 172.21.15.26:0/512933277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b816c6d0 0x7f68b80cbd20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68b80c9600 tx=0x7f68b401ed70 comp rx=0 tx=0).stop 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68c012e640 1 -- 172.21.15.26:0/512933277 shutdown_connections 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68c012e640 1 --2- 172.21.15.26:0/512933277 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b816c6d0 0x7f68b80cbd20 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f68b80c9600 tx=0x7f68b401ed70 comp rx=0 tx=0).stop 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68c012e640 1 --2- 172.21.15.26:0/512933277 >> v2:172.21.15.169:3300/0 conn(0x7f68b80c2840 0x7f68b80c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68c012e640 1 -- 172.21.15.26:0/512933277 >> 172.21.15.26:0/512933277 conn(0x7f68b8067d60 msgr2=0x7f68b806ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 Processor -- start 2024-04-21T08:57:51.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 -- start start 2024-04-21T08:57:51.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c073030 msgr2=0x7f3a9c0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c073030 0x7f3a9c0cbd00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c00a860 tx=0x7f3a8c01f000 comp rx=0 tx=0).stop 2024-04-21T08:57:51.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 -- 172.21.15.26:0/3701547907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 msgr2=0x7f67080738b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3701547907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f67080738b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6708159620 tx=0x7f670001f060 comp rx=0 tx=0).stop 2024-04-21T08:57:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 -- start start 2024-04-21T08:57:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4159a640 1 -- 172.21.15.26:0/1094128798 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0b4070 con 0x7fcd4406c020 2024-04-21T08:57:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4159a640 1 -- 172.21.15.26:0/1094128798 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c0af400 con 0x7fcd4406c020 2024-04-21T08:57:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4159a640 1 -- 172.21.15.26:0/1094128798 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0af7d0 con 0x7fcd4406c020 2024-04-21T08:57:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 -- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4406c020 msgr2=0x7fcd440c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 --2- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4406c020 0x7fcd440c7d80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406fd90 tx=0x7fcd3c01f1e0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdcc154a80 0x7fcdcc2028d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc0c6140 con 0x7fcdcc0cb100 2024-04-21T08:57:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcdcc1550b0 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdcc0c6ce0 0x7fcdcc15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdcc0c6ce0 0x7fcdcc15e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51666/0 (socket says 172.21.15.26:51666) 2024-04-21T08:57:51.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 -- 172.21.15.26:0/381071960 learned_addr learned my addr 172.21.15.26:0/381071960 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 -- 172.21.15.26:0/1094128798 shutdown_connections 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 --2- 172.21.15.26:0/1094128798 >> v2:172.21.15.26:3300/0 conn(0x7fcd44073c40 0x7fcd440c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 --2- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd4406c020 0x7fcd440c7d80 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd4406fd90 tx=0x7fcd3c01f1e0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 --2- 172.21.15.26:0/1094128798 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd440c0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 -- 172.21.15.26:0/1094128798 >> 172.21.15.26:0/1094128798 conn(0x7fcd440cbdf0 msgr2=0x7fcd440cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdd12f0640 1 -- 172.21.15.26:0/381071960 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcdcc168ad0 con 0x7fcdcc154a80 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcb7fe640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdcc154a80 0x7fcdcc2028d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda7fff640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd94004d50 0x7efd940051d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efda000a8e0 tx=0x7efda001d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9d51864631c362 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b40c6860 0x7f31b4158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c06f6b0 0x7f997c14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f997c071310 0x7f997c1683e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f997c0c7490 0x7f997c15a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1511d0 con 0x7f997c071310 2024-04-21T08:57:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f997c0c2070 con 0x7f997c06f6b0 2024-04-21T08:57:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f9982340640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f997c0c1b40 con 0x7f997c0c7490 2024-04-21T08:57:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 -- 172.21.15.26:0/3701547907 shutdown_connections 2024-04-21T08:57:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3701547907 >> v2:172.21.15.169:3300/0 conn(0x7f6708073df0 0x7f67080cbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3701547907 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f67080738b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 -- 172.21.15.26:0/3701547907 >> 172.21.15.26:0/3701547907 conn(0x7f6708067d60 msgr2=0x7f670806ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b4159010 0x7f31b415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 -- 172.21.15.26:0/1094128798 shutdown_connections 2024-04-21T08:57:51.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdca7fc640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 0x7fcdcc15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 -- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdcc154a80 msgr2=0x7fcdcc2028d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdcc154a80 0x7fcdcc2028d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 -- 172.21.15.26:0/381071960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 msgr2=0x7fcdcc15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 0x7fcdcc15ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcaffd640 1 -- 172.21.15.26:0/381071960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdcc072c30 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcdcb7fe640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdcc154a80 0x7fcdcc2028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f68c012e640 1 -- 172.21.15.26:0/512933277 shutdown_connections 2024-04-21T08:57:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f997b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f997c071310 0x7f997c1683e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f997b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f997c071310 0x7f997c1683e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54192/0 (socket says 172.21.15.26:54192) 2024-04-21T08:57:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f997b7fe640 1 -- 172.21.15.26:0/2842325164 learned_addr learned my addr 172.21.15.26:0/2842325164 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f997bfff640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c06f6b0 0x7f997c14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 -- 172.21.15.26:0/3701547907 shutdown_connections 2024-04-21T08:57:51.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f670e9c9640 1 -- 172.21.15.26:0/3701547907 wait complete. 2024-04-21T08:57:51.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda000a4e0 con 0x7efd94004d50 2024-04-21T08:57:51.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efda00a9020 con 0x7efd94004d50 2024-04-21T08:57:51.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7efda6ffd640 1 -- 172.21.15.26:0/34137582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda00072f0 con 0x7efd94004d50 2024-04-21T08:57:51.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31b9295640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b40c6860 0x7f31b4158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31b9295640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b40c6860 0x7f31b4158070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51676/0 (socket says 172.21.15.26:51676) 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31b9295640 1 -- 172.21.15.26:0/3988995323 learned_addr learned my addr 172.21.15.26:0/3988995323 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31b8a94640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b4159010 0x7f31b415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b415e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f31b40c7d10 con 0x7f31b4159010 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31b406cc70 con 0x7f31b40c6860 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f31b40c7e90 con 0x7f31b4162150 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f31b9a96640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7fcd4359e640 1 -- 172.21.15.26:0/1094128798 wait complete. 2024-04-21T08:57:51.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f997b7fe640 1 -- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f997c0c7490 msgr2=0x7f997c15a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f997b7fe640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f997c0c7490 0x7f997c15a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f997b7fe640 1 -- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c06f6b0 msgr2=0x7f997c14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f997b7fe640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c06f6b0 0x7f997c14e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f997b7fe640 1 -- 172.21.15.26:0/2842325164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c0c2c80 con 0x7f997c071310 2024-04-21T08:57:51.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efdacf38640 1 -- 172.21.15.26:0/34137582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd94004d50 msgr2=0x7efd940051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efdacf38640 1 --2- 172.21.15.26:0/34137582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd94004d50 0x7efd940051d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efda000a8e0 tx=0x7efda001d3c0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcdcaffd640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdcc0c6ce0 0x7fcdcc15e690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c430 tx=0x7fcdbc00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/4127864251 shutdown_connections 2024-04-21T08:57:51.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c073030 0x7f3a9c0cbd00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/4127864251 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c072af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.294+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/4127864251 >> 172.21.15.26:0/4127864251 conn(0x7f3a9c067d60 msgr2=0x7f3a9c06ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efda7fff640 1 -- 172.21.15.26:0/34137582 reap_dead start 2024-04-21T08:57:51.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 -- 172.21.15.26:0/512933277 wait complete. 2024-04-21T08:57:51.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efdacf38640 1 -- 172.21.15.26:0/34137582 shutdown_connections 2024-04-21T08:57:51.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efdacf38640 1 -- 172.21.15.26:0/34137582 >> 172.21.15.26:0/34137582 conn(0x7efda8067760 msgr2=0x7efda8067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efdacf38640 1 -- 172.21.15.26:0/34137582 shutdown_connections 2024-04-21T08:57:51.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efdacf38640 1 -- 172.21.15.26:0/34137582 wait complete. 2024-04-21T08:57:51.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f997b7fe640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f997c071310 0x7f997c1683e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f997000e930 tx=0x7f997000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcdb37fe640 1 -- 172.21.15.26:0/381071960 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc017070 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcdb37fe640 1 -- 172.21.15.26:0/381071960 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc005cf0 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcdb37fe640 1 -- 172.21.15.26:0/381071960 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0072d0 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcdd12f0640 1 -- 172.21.15.26:0/381071960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdcc15d300 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcdd12f0640 1 -- 172.21.15.26:0/381071960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdcc201df0 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f9978ff9640 1 -- 172.21.15.26:0/2842325164 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970017070 con 0x7f997c071310 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f9978ff9640 1 -- 172.21.15.26:0/2842325164 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f997000ca00 con 0x7f997c071310 2024-04-21T08:57:51.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f9978ff9640 1 -- 172.21.15.26:0/2842325164 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997000cdb0 con 0x7f997c071310 2024-04-21T08:57:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 Processor -- start 2024-04-21T08:57:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f9982340640 1 -- 172.21.15.26:0/2842325164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997c157d40 con 0x7f997c071310 2024-04-21T08:57:51.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 Processor -- start 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f9978ff9640 1 -- 172.21.15.26:0/2842325164 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f997001a070 con 0x7f997c071310 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f9982340640 1 -- 172.21.15.26:0/2842325164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997c158000 con 0x7f997c071310 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/4127864251 shutdown_connections 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/4127864251 wait complete. 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 Processor -- start 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 -- start start 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6708073df0 0x7f670814b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f670814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67081590c0 0x7f6708146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6708073390 con 0x7f67081590c0 2024-04-21T08:57:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67080730b0 con 0x7f6708073df0 2024-04-21T08:57:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670e9c9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f67080c7600 con 0x7f67080c6df0 2024-04-21T08:57:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7efdacf38640 1 Processor -- start 2024-04-21T08:57:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31b9295640 1 -- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 msgr2=0x7f31b415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31b9295640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b415e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31b9295640 1 -- 172.21.15.26:0/3988995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b4159010 msgr2=0x7f31b415e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31b9295640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b4159010 0x7f31b415e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31b9295640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b4072690 con 0x7f31b40c6860 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 -- start start 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd441fd940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd44073c40 0x7fcd44159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd44155eb0 0x7fcd44156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4406ca00 con 0x7fcd44073c40 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcd4415b800 con 0x7fcd44155eb0 2024-04-21T08:57:51.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4359e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcd4406cb80 con 0x7fcd4406bc40 2024-04-21T08:57:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd44073c40 0x7fcd44159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd44073c40 0x7fcd44159e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54208/0 (socket says 172.21.15.26:54208) 2024-04-21T08:57:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 -- 172.21.15.26:0/863336740 learned_addr learned my addr 172.21.15.26:0/863336740 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670cf66640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67081590c0 0x7f6708146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670cf66640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67081590c0 0x7f6708146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54218/0 (socket says 172.21.15.26:54218) 2024-04-21T08:57:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f670cf66640 1 -- 172.21.15.26:0/3864183651 learned_addr learned my addr 172.21.15.26:0/3864183651 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f67077fe640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f670814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcdd12f0640 1 -- 172.21.15.26:0/381071960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdac0052a0 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcdb37fe640 1 -- 172.21.15.26:0/381071960 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcdbc01a070 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcdb37fe640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdb8068480 0x7fcdb806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcdb37fe640 1 -- 172.21.15.26:0/381071960 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcdbc085e00 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 -- start start 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68b80c2840 0x7f68b80caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b80c2c20 0x7f68b80cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b815b410 0x7f68b815b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f68b80c9110 con 0x7f68b80c2840 2024-04-21T08:57:51.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f68b80c8e30 con 0x7f68b80c2c20 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68c012e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f68b80c7330 con 0x7f68b815b410 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f68be6cb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b815b410 0x7f68b815b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68bdeca640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68b80c2840 0x7f68b80caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b815b410 0x7f68b815b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:51124/0 (socket says 172.21.15.26:51124) 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 -- 172.21.15.26:0/3169870560 learned_addr learned my addr 172.21.15.26:0/3169870560 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 -- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b80c2c20 msgr2=0x7f68b80cb430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b80c2c20 0x7f68b80cb430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 -- 172.21.15.26:0/3169870560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68b80c2840 msgr2=0x7f68b80caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68b80c2840 0x7f68b80caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 -- 172.21.15.26:0/3169870560 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b80c5b60 con 0x7f68b815b410 2024-04-21T08:57:51.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68be6cb640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b815b410 0x7f68b815b8c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007fa0 tx=0x7f68a8001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f9978ff9640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f99680683d0 0x7f996806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99540052a0 con 0x7f997c071310 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f997bfff640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f99680683d0 0x7f996806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f9978ff9640 1 -- 172.21.15.26:0/2842325164 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9970054190 con 0x7f997c071310 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 Processor -- start 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 -- start start 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c073030 0x7f3a9c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0c7bc0 0x7f3a9c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c1efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c151070 con 0x7f3a9c073030 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f3aa3f4e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9c15ab80 con 0x7f3a9c0c7bc0 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa3f4e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3a9c1511f0 con 0x7f3a9c150c90 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c073030 0x7f3a9c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c073030 0x7f3a9c155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54238/0 (socket says 172.21.15.26:54238) 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 -- 172.21.15.26:0/2860004166 learned_addr learned my addr 172.21.15.26:0/2860004166 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa24eb640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c1efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa14e9640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0c7bc0 0x7f3a9c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 -- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 msgr2=0x7f3a9c1efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c1efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 -- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0c7bc0 msgr2=0x7f3a9c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0c7bc0 0x7f3a9c1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 -- 172.21.15.26:0/2860004166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9c151750 con 0x7f3a9c073030 2024-04-21T08:57:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa14e9640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0c7bc0 0x7f3a9c1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f6707fff640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6708073df0 0x7f670814b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f670cf66640 1 -- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 msgr2=0x7f670814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f670cf66640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f670814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f670cf66640 1 -- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6708073df0 msgr2=0x7f670814b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f670cf66640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6708073df0 0x7f670814b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f670cf66640 1 -- 172.21.15.26:0/3864183651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67081469d0 con 0x7f67081590c0 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31b9295640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b40c6860 0x7f31b4158070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31b000c490 tx=0x7f31b0001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31a9ffb640 1 -- 172.21.15.26:0/3988995323 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b0017070 con 0x7f31b40c6860 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31a9ffb640 1 -- 172.21.15.26:0/3988995323 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b0003600 con 0x7f31b40c6860 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31a9ffb640 1 -- 172.21.15.26:0/3988995323 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b00039f0 con 0x7f31b40c6860 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b4156c50 con 0x7f31b40c6860 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b41571f0 con 0x7f31b40c6860 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b4075e80 con 0x7f31b40c6860 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd4259c640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd441fd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 -- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 msgr2=0x7fcd441fd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd441fd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 -- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd44155eb0 msgr2=0x7fcd44156360 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd44155eb0 0x7fcd44156360 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 -- 172.21.15.26:0/863336740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd440c42a0 con 0x7fcd44073c40 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.298+0000 7fcd41d9b640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd44073c40 0x7fcd44159e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009f10 tx=0x7fcd3c01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcdca7fc640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdb8068480 0x7fcdb806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efdacf38640 1 -- start start 2024-04-21T08:57:51.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efdacf38640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd94004d50 0x7efda815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efdacf38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80c75b0 0x7efda815df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efdacf38640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efda8152a00 0x7efda8152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efdacf38640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efda80cca70 con 0x7efda80c75b0 2024-04-21T08:57:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efdacf38640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7efda80cc250 con 0x7efda8152a00 2024-04-21T08:57:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efdacf38640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7efda80ccd50 con 0x7efd94004d50 2024-04-21T08:57:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcd32ffd640 1 -- 172.21.15.26:0/863336740 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0b4040 con 0x7fcd44073c40 2024-04-21T08:57:51.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcd32ffd640 1 -- 172.21.15.26:0/863336740 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd3c0090d0 con 0x7fcd44073c40 2024-04-21T08:57:51.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68ae7fc640 1 -- 172.21.15.26:0/3169870560 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8039070 con 0x7f68b815b410 2024-04-21T08:57:51.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f3aa1cea640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c073030 0x7f3a9c155ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800df00 tx=0x7f3a9800bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efda7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efda8152a00 0x7efda8152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcdca7fc640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdb8068480 0x7fcdb806a940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc170ed0 tx=0x7fcdc0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b815ce90 con 0x7f68b815b410 2024-04-21T08:57:51.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b815d170 con 0x7f68b815b410 2024-04-21T08:57:51.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68ae7fc640 1 -- 172.21.15.26:0/3169870560 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a80050d0 con 0x7f68b815b410 2024-04-21T08:57:51.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68ae7fc640 1 -- 172.21.15.26:0/3169870560 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a80054a0 con 0x7f68b815b410 2024-04-21T08:57:51.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f670cf66640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67081590c0 0x7f6708146490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f66f800e8b0 tx=0x7f66f800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efda7fff640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efda8152a00 0x7efda8152e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51722/0 (socket says 172.21.15.26:51722) 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efda7fff640 1 -- 172.21.15.26:0/4136910409 learned_addr learned my addr 172.21.15.26:0/4136910409 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efd9ffff640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80c75b0 0x7efda815df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efd9ffff640 1 -- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd94004d50 msgr2=0x7efda815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efd9ffff640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd94004d50 0x7efda815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efd9ffff640 1 -- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efda8152a00 msgr2=0x7efda8152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efd9ffff640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efda8152a00 0x7efda8152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efd9ffff640 1 -- 172.21.15.26:0/4136910409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efda815b3b0 con 0x7efda80c75b0 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd440add50 con 0x7fcd44073c40 2024-04-21T08:57:51.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcd32ffd640 1 -- 172.21.15.26:0/863336740 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0afe60 con 0x7fcd44073c40 2024-04-21T08:57:51.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd440ae310 con 0x7fcd44073c40 2024-04-21T08:57:51.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7efd9ffff640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80c75b0 0x7efda815df00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd9000f5b0 tx=0x7efd9000fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a00052a0 con 0x7f68b815b410 2024-04-21T08:57:51.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd44075e80 con 0x7fcd44073c40 2024-04-21T08:57:51.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.302+0000 7f997bfff640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f99680683d0 0x7f996806a890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f996c005890 tx=0x7f996c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f68ae7fc640 1 -- 172.21.15.26:0/3169870560 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f68a803c070 con 0x7f68b815b410 2024-04-21T08:57:51.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f68ae7fc640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f68a4068850 0x7f68a406ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f68ae7fc640 1 -- 172.21.15.26:0/3169870560 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f68a80a7e70 con 0x7f68b815b410 2024-04-21T08:57:51.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f68bdeca640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f68a4068850 0x7f68a406ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f9978ff9640 1 -- 172.21.15.26:0/2842325164 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f99700567f0 con 0x7f997c071310 2024-04-21T08:57:51.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7efda4ff9640 1 -- 172.21.15.26:0/4136910409 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90004440 con 0x7efda80c75b0 2024-04-21T08:57:51.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f3a927fc640 1 -- 172.21.15.26:0/2860004166 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a980088a0 con 0x7f3a9c073030 2024-04-21T08:57:51.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9c1f0540 con 0x7f3a9c073030 2024-04-21T08:57:51.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efda8158360 con 0x7efda80c75b0 2024-04-21T08:57:51.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efda815b650 con 0x7efda80c75b0 2024-04-21T08:57:51.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a9c0c1da0 con 0x7f3a9c073030 2024-04-21T08:57:51.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f68bdeca640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f68a4068850 0x7f68a406ad10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68b00113e0 tx=0x7f68b000b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda8075e80 con 0x7efda80c75b0 2024-04-21T08:57:51.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.306+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9c075e80 con 0x7f3a9c073030 2024-04-21T08:57:51.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f6704ff9640 1 -- 172.21.15.26:0/3864183651 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f8017070 con 0x7f67081590c0 2024-04-21T08:57:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f3a927fc640 1 -- 172.21.15.26:0/2860004166 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a98008a40 con 0x7f3a9c073030 2024-04-21T08:57:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f3a927fc640 1 -- 172.21.15.26:0/2860004166 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98008df0 con 0x7f3a9c073030 2024-04-21T08:57:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67080c9eb0 con 0x7f67081590c0 2024-04-21T08:57:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f6704ff9640 1 -- 172.21.15.26:0/3864183651 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f800c8e0 con 0x7f67081590c0 2024-04-21T08:57:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f6704ff9640 1 -- 172.21.15.26:0/3864183651 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f800ccd0 con 0x7f67081590c0 2024-04-21T08:57:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670814a560 con 0x7f67081590c0 2024-04-21T08:57:51.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6708075e80 con 0x7f67081590c0 2024-04-21T08:57:51.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7fcd32ffd640 1 -- 172.21.15.26:0/863336740 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd3c0c1020 con 0x7fcd44073c40 2024-04-21T08:57:51.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7efda4ff9640 1 -- 172.21.15.26:0/4136910409 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd9001a070 con 0x7efda80c75b0 2024-04-21T08:57:51.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7efda4ff9640 1 -- 172.21.15.26:0/4136910409 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd90005ba0 con 0x7efda80c75b0 2024-04-21T08:57:51.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f3a927fc640 1 -- 172.21.15.26:0/2860004166 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a98037410 con 0x7f3a9c073030 2024-04-21T08:57:51.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f3a927fc640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a80068380 0x7f3a8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7f3aa14e9640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a80068380 0x7f3a8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7fcd32ffd640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcd24068480 0x7fcd2406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7fcd32ffd640 1 -- 172.21.15.26:0/863336740 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd3c1247f0 con 0x7fcd44073c40 2024-04-21T08:57:51.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7efda4ff9640 1 -- 172.21.15.26:0/4136910409 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd90012070 con 0x7efda80c75b0 2024-04-21T08:57:51.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7efda4ff9640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7efd88068380 0x7efd8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.310+0000 7efda77fe640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7efd88068380 0x7efd8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.314+0000 7fcd4259c640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcd24068480 0x7fcd2406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.314+0000 7f3aa14e9640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a80068380 0x7f3a8006a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0b3000 tx=0x7f3a8c004740 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.314+0000 7efda77fe640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7efd88068380 0x7efd8806a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd98009a20 tx=0x7efd98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.314+0000 7fcd4259c640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcd24068480 0x7fcd2406a940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c870 tx=0x7fcd38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7fcdb37fe640 1 -- 172.21.15.26:0/381071960 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcdbc055d50 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7f31a9ffb640 1 -- 172.21.15.26:0/3988995323 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31b001a070 con 0x7f31b40c6860 2024-04-21T08:57:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7f3a927fc640 1 -- 172.21.15.26:0/2860004166 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3a980774f0 con 0x7f3a9c073030 2024-04-21T08:57:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7efda4ff9640 1 -- 172.21.15.26:0/4136910409 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efd90055180 con 0x7efda80c75b0 2024-04-21T08:57:51.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7fcd32ffd640 1 -- 172.21.15.26:0/863336740 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd3c018d40 con 0x7fcd44073c40 2024-04-21T08:57:51.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7f31a9ffb640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3198068400 0x7f319806a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7f6704ff9640 1 -- 172.21.15.26:0/3864183651 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66f801a070 con 0x7f67081590c0 2024-04-21T08:57:51.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.318+0000 7f31a9ffb640 1 -- 172.21.15.26:0/3988995323 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f31b0086120 con 0x7f31b40c6860 2024-04-21T08:57:51.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.322+0000 7f68ae7fc640 1 -- 172.21.15.26:0/3169870560 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f68a8043020 con 0x7f68b815b410 2024-04-21T08:57:51.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.322+0000 7f6704ff9640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f66f4068380 0x7f66f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.322+0000 7f6704ff9640 1 -- 172.21.15.26:0/3864183651 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f66f80870f0 con 0x7f67081590c0 2024-04-21T08:57:51.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.322+0000 7f31b8a94640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3198068400 0x7f319806a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.322+0000 7f6707fff640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f66f4068380 0x7f66f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.322+0000 7f31b8a94640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3198068400 0x7f319806a8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31a40ae000 tx=0x7f31a40a6070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.322+0000 7f6707fff640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f66f4068380 0x7f66f406a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66fc007900 tx=0x7f66fc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.326+0000 7f3a927fc640 1 -- 172.21.15.26:0/2860004166 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a98079b50 con 0x7f3a9c073030 2024-04-21T08:57:51.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.330+0000 7f31a9ffb640 1 -- 172.21.15.26:0/3988995323 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31b0021020 con 0x7f31b40c6860 2024-04-21T08:57:51.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.338+0000 7efda4ff9640 1 -- 172.21.15.26:0/4136910409 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd900577e0 con 0x7efda80c75b0 2024-04-21T08:57:51.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.346+0000 7f6704ff9640 1 -- 172.21.15.26:0/3864183651 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f66f8057040 con 0x7f67081590c0 2024-04-21T08:57:51.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:51.644 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:57:51.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.650+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9954005860 con 0x7f997c071310 2024-04-21T08:57:51.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.650+0000 7fcdd12f0640 1 -- 172.21.15.26:0/381071960 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fcdac005860 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.650+0000 7f9978ff9640 1 -- 172.21.15.26:0/2842325164 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f99700560f0 con 0x7f997c071310 2024-04-21T08:57:51.651 INFO:teuthology.orchestra.run.smithi026.stdout:55834574853 2024-04-21T08:57:51.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.650+0000 7fcdb37fe640 1 -- 172.21.15.26:0/381071960 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcdbc05a050 con 0x7fcdcc0c6ce0 2024-04-21T08:57:51.654 INFO:teuthology.orchestra.run.smithi026.stdout:64424509445 2024-04-21T08:57:51.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.650+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f68a0005860 con 0x7f68b815b410 2024-04-21T08:57:51.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f68ae7fc640 1 -- 172.21.15.26:0/3169870560 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f68a8077e30 con 0x7f68b815b410 2024-04-21T08:57:51.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f99680683d0 msgr2=0x7f996806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.656 INFO:teuthology.orchestra.run.smithi026.stdout:64424509446 2024-04-21T08:57:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f99680683d0 0x7f996806a890 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f996c005890 tx=0x7f996c009040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f997c071310 msgr2=0x7f997c1683e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f997c071310 0x7f997c1683e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f997000e930 tx=0x7f997000edf0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 shutdown_connections 2024-04-21T08:57:51.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f997c0c7490 0x7f997c15a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f99680683d0 0x7f996806a890 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f997c071310 0x7f997c1683e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 --2- 172.21.15.26:0/2842325164 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f997c06f6b0 0x7f997c14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 >> 172.21.15.26:0/2842325164 conn(0x7f997c067d60 msgr2=0x7f997c0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 shutdown_connections 2024-04-21T08:57:51.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.654+0000 7f99627fc640 1 -- 172.21.15.26:0/2842325164 wait complete. 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 -- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdb8068480 msgr2=0x7fcdb806a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdb8068480 0x7fcdb806a940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc170ed0 tx=0x7fcdc0009040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 -- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdcc0c6ce0 msgr2=0x7fcdcc15e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdcc0c6ce0 0x7fcdcc15e690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc00c430 tx=0x7fcdbc00c8f0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 -- 172.21.15.26:0/381071960 shutdown_connections 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f68a4068850 msgr2=0x7f68a406ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f68a4068850 0x7f68a406ad10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f68b00113e0 tx=0x7f68b000b040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b815b410 msgr2=0x7f68b815b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b815b410 0x7f68b815b8c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007fa0 tx=0x7f68a8001e80 comp rx=0 tx=0).stop 2024-04-21T08:57:51.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 shutdown_connections 2024-04-21T08:57:51.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdcc154a80 0x7fcdcc2028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdb8068480 0x7fcdb806a940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdcc0cb100 0x7fcdcc15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 --2- 172.21.15.26:0/381071960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdcc0c6ce0 0x7fcdcc15e690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 -- 172.21.15.26:0/381071960 >> 172.21.15.26:0/381071960 conn(0x7fcdcc067760 msgr2=0x7fcdcc151e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68b815b410 0x7f68b815b8c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f68b80c2c20 0x7f68b80cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f68a4068850 0x7f68a406ad10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 --2- 172.21.15.26:0/3169870560 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f68b80c2840 0x7f68b80caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 >> 172.21.15.26:0/3169870560 conn(0x7f68b8067d60 msgr2=0x7f68b80c1640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 -- 172.21.15.26:0/381071960 shutdown_connections 2024-04-21T08:57:51.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.658+0000 7fcdb17fa640 1 -- 172.21.15.26:0/381071960 wait complete. 2024-04-21T08:57:51.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.662+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 shutdown_connections 2024-04-21T08:57:51.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.662+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3a9c0c79a0 con 0x7f3a9c073030 2024-04-21T08:57:51.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.662+0000 7f3a927fc640 1 -- 172.21.15.26:0/2860004166 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3a98079450 con 0x7f3a9c073030 2024-04-21T08:57:51.663 INFO:teuthology.orchestra.run.smithi026.stdout:64424509447 2024-04-21T08:57:51.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.662+0000 7f68c012e640 1 -- 172.21.15.26:0/3169870560 wait complete. 2024-04-21T08:57:51.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.662+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fcd440c85c0 con 0x7fcd44073c40 2024-04-21T08:57:51.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.662+0000 7fcd32ffd640 1 -- 172.21.15.26:0/863336740 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcd3c0f4d00 con 0x7fcd44073c40 2024-04-21T08:57:51.664 INFO:teuthology.orchestra.run.smithi026.stdout:60129542148 2024-04-21T08:57:51.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f31b40c73e0 con 0x7f31b40c6860 2024-04-21T08:57:51.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcd24068480 msgr2=0x7fcd2406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7fcd4359e640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcd24068480 0x7fcd2406a940 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcd3800c870 tx=0x7fcd38008040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd44073c40 msgr2=0x7fcd44159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a80068380 msgr2=0x7f3a8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a80068380 0x7f3a8006a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c0b3000 tx=0x7f3a8c004740 comp rx=0 tx=0).stop 2024-04-21T08:57:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c073030 msgr2=0x7f3a9c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7fcd4359e640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd44073c40 0x7fcd44159e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009f10 tx=0x7fcd3c01bf80 comp rx=0 tx=0).stop 2024-04-21T08:57:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c073030 0x7f3a9c155ef0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800df00 tx=0x7f3a9800bda0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 shutdown_connections 2024-04-21T08:57:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a9c150c90 0x7f3a9c1efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a9c0c7bc0 0x7f3a9c1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f31a9ffb640 1 -- 172.21.15.26:0/3988995323 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31b00560e0 con 0x7f31b40c6860 2024-04-21T08:57:51.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3a80068380 0x7f3a8006a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 --2- 172.21.15.26:0/2860004166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a9c073030 0x7f3a9c155ef0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 >> 172.21.15.26:0/2860004166 conn(0x7f3a9c067d60 msgr2=0x7f3a9c14da50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 shutdown_connections 2024-04-21T08:57:51.670 INFO:teuthology.orchestra.run.smithi026.stdout:55834574854 2024-04-21T08:57:51.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.666+0000 7f3aa3f4e640 1 -- 172.21.15.26:0/2860004166 wait complete. 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3198068400 msgr2=0x7f319806a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3198068400 0x7f319806a8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f31a40ae000 tx=0x7f31a40a6070 comp rx=0 tx=0).stop 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b40c6860 msgr2=0x7f31b4158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b40c6860 0x7f31b4158070 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f31b000c490 tx=0x7f31b0001e80 comp rx=0 tx=0).stop 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 shutdown_connections 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31b4162150 0x7f31b415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3198068400 0x7f319806a8c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31b4159010 0x7f31b415e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 --2- 172.21.15.26:0/3988995323 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31b40c6860 0x7f31b4158070 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 >> 172.21.15.26:0/3988995323 conn(0x7f31b40c8a80 msgr2=0x7f31b4071db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 shutdown_connections 2024-04-21T08:57:51.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7f31ba297640 1 -- 172.21.15.26:0/3988995323 wait complete. 2024-04-21T08:57:51.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7efda80cbc40 con 0x7efda80c75b0 2024-04-21T08:57:51.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 shutdown_connections 2024-04-21T08:57:51.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd44155eb0 0x7fcd44156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcd24068480 0x7fcd2406a940 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd44073c40 0x7fcd44159e10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 --2- 172.21.15.26:0/863336740 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd4406bc40 0x7fcd441fd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 >> 172.21.15.26:0/863336740 conn(0x7fcd440cbdf0 msgr2=0x7fcd4406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 shutdown_connections 2024-04-21T08:57:51.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7fcd4359e640 1 -- 172.21.15.26:0/863336740 wait complete. 2024-04-21T08:57:51.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.670+0000 7efda4ff9640 1 -- 172.21.15.26:0/4136910409 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd900570e0 con 0x7efda80c75b0 2024-04-21T08:57:51.675 INFO:teuthology.orchestra.run.smithi026.stdout:60129542149 2024-04-21T08:57:51.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7efd88068380 msgr2=0x7efd8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7efd88068380 0x7efd8806a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efd98009a20 tx=0x7efd98008040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80c75b0 msgr2=0x7efda815df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80c75b0 0x7efda815df00 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd9000f5b0 tx=0x7efd9000fa70 comp rx=0 tx=0).stop 2024-04-21T08:57:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 shutdown_connections 2024-04-21T08:57:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efda8152a00 0x7efda8152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7efd88068380 0x7efd8806a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efda80c75b0 0x7efda815df00 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 --2- 172.21.15.26:0/4136910409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efd94004d50 0x7efda815be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 >> 172.21.15.26:0/4136910409 conn(0x7efda8067760 msgr2=0x7efda81549b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 shutdown_connections 2024-04-21T08:57:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.674+0000 7efdacf38640 1 -- 172.21.15.26:0/4136910409 wait complete. 2024-04-21T08:57:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.678+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f67080c7930 con 0x7f67081590c0 2024-04-21T08:57:51.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.678+0000 7f6704ff9640 1 -- 172.21.15.26:0/3864183651 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f66f805b340 con 0x7f67081590c0 2024-04-21T08:57:51.680 INFO:teuthology.orchestra.run.smithi026.stdout:64424509446 2024-04-21T08:57:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f66f4068380 msgr2=0x7f66f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f66f4068380 0x7f66f406a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f66fc007900 tx=0x7f66fc009040 comp rx=0 tx=0).stop 2024-04-21T08:57:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67081590c0 msgr2=0x7f6708146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67081590c0 0x7f6708146490 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f66f800e8b0 tx=0x7f66f800ed70 comp rx=0 tx=0).stop 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 shutdown_connections 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f66f4068380 0x7f66f406a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67081590c0 0x7f6708146490 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f67080c6df0 0x7f670814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 --2- 172.21.15.26:0/3864183651 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6708073df0 0x7f670814b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 >> 172.21.15.26:0/3864183651 conn(0x7f6708067d60 msgr2=0x7f67081eb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 shutdown_connections 2024-04-21T08:57:51.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.682+0000 7f670e9c9640 1 -- 172.21.15.26:0/3864183651 wait complete. 2024-04-21T08:57:51.692 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-21T08:57:51.692 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.2 2024-04-21T08:57:51.697 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.3 2024-04-21T08:57:51.700 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.707 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.0 2024-04-21T08:57:51.708 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.708 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-21T08:57:51.708 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.710 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.7 2024-04-21T08:57:51.710 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.711 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-04-21T08:57:51.711 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.714 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-04-21T08:57:51.714 DEBUG:teuthology.parallel:result is None 2024-04-21T08:57:51.714 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-21T08:57:51.715 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T08:57:51.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.858+0000 7f99bf63e640 1 Processor -- start 2024-04-21T08:57:51.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.858+0000 7f99bf63e640 1 -- start start 2024-04-21T08:57:51.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bf63e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b80c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bf63e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f99b80b2de0 0x7f99b80c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bf63e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b80c9710 con 0x7f99b8154d00 2024-04-21T08:57:51.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bf63e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f99b80c92f0 con 0x7f99b80b2de0 2024-04-21T08:57:51.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bf63e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f99b815acf0 con 0x7f99b80c1f50 2024-04-21T08:57:51.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bdbdb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f99b80b2de0 0x7f99b80c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bcbd9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b80c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bdbdb640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f99b80b2de0 0x7f99b80c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:51732/0 (socket says 172.21.15.26:51732) 2024-04-21T08:57:51.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bdbdb640 1 -- 172.21.15.26:0/3865589007 learned_addr learned my addr 172.21.15.26:0/3865589007 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bd3da640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f99b8154d00 0x7f99b815b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:38390/0 (socket says 172.21.15.26:38390) 2024-04-21T08:57:51.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bdbdb640 1 -- 172.21.15.26:0/3865589007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 msgr2=0x7f99b80c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:51.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bdbdb640 1 --2- 172.21.15.26:0/3865589007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b80c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bdbdb640 1 -- 172.21.15.26:0/3865589007 >> v1:172.21.15.169:6789/0 conn(0x7f99b8154d00 legacy=0x7f99b815b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.862+0000 7f99bdbdb640 1 -- 172.21.15.26:0/3865589007 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b80c4540 con 0x7f99b80b2de0 2024-04-21T08:57:51.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bdbdb640 1 --2- 172.21.15.26:0/3865589007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80b2de0 0x7f99b80c3920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99b80c9470 tx=0x7f99b001f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5881a3ec6c5cc93f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99affff640 1 -- 172.21.15.26:0/3865589007 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00b4070 con 0x7f99b80b2de0 2024-04-21T08:57:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99affff640 1 -- 172.21.15.26:0/3865589007 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b00af400 con 0x7f99b80b2de0 2024-04-21T08:57:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99affff640 1 -- 172.21.15.26:0/3865589007 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b00af7d0 con 0x7f99b80b2de0 2024-04-21T08:57:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- 172.21.15.26:0/3865589007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80b2de0 msgr2=0x7f99b80c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3865589007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80b2de0 0x7f99b80c3920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f99b80c9470 tx=0x7f99b001f200 comp rx=0 tx=0).stop 2024-04-21T08:57:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- 172.21.15.26:0/3865589007 shutdown_connections 2024-04-21T08:57:51.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3865589007 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b80b2de0 0x7f99b80c3920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3865589007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b80c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- 172.21.15.26:0/3865589007 >> 172.21.15.26:0/3865589007 conn(0x7f99b80701f0 msgr2=0x7f99b8070600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- 172.21.15.26:0/3865589007 shutdown_connections 2024-04-21T08:57:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- 172.21.15.26:0/3865589007 wait complete. 2024-04-21T08:57:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 Processor -- start 2024-04-21T08:57:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- start start 2024-04-21T08:57:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b80b2de0 0x7f99b81f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b81f2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b8154d00 0x7f99b81f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f99b815b890 con 0x7f99b80b2de0 2024-04-21T08:57:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f99b80c9010 con 0x7f99b8154d00 2024-04-21T08:57:51.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f99b815ba10 con 0x7f99b80c1f50 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b80b2de0 0x7f99b81f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b80b2de0 0x7f99b81f2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54254/0 (socket says 172.21.15.26:54254) 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 -- 172.21.15.26:0/3504561796 learned_addr learned my addr 172.21.15.26:0/3504561796 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bcbd9640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b81f2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bdbdb640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b8154d00 0x7f99b81f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 -- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 msgr2=0x7f99b81f2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b81f2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 -- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b8154d00 msgr2=0x7f99b81f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b8154d00 0x7f99b81f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 -- 172.21.15.26:0/3504561796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b80cc580 con 0x7f99b80b2de0 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bcbd9640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b81f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bd3da640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b80b2de0 0x7f99b81f2680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99b400c3a0 tx=0x7f99b400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99adffb640 1 -- 172.21.15.26:0/3504561796 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b40074e0 con 0x7f99b80b2de0 2024-04-21T08:57:51.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99adffb640 1 -- 172.21.15.26:0/3504561796 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99b4007680 con 0x7f99b80b2de0 2024-04-21T08:57:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b8155640 con 0x7f99b80b2de0 2024-04-21T08:57:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99adffb640 1 -- 172.21.15.26:0/3504561796 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4004a30 con 0x7f99b80b2de0 2024-04-21T08:57:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.866+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b8155c00 con 0x7f99b80b2de0 2024-04-21T08:57:51.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.870+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99b8075ef0 con 0x7f99b80b2de0 2024-04-21T08:57:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.870+0000 7f99adffb640 1 -- 172.21.15.26:0/3504561796 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f99b401a020 con 0x7f99b80b2de0 2024-04-21T08:57:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.870+0000 7f99adffb640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f999c068380 0x7f999c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.870+0000 7f99adffb640 1 -- 172.21.15.26:0/3504561796 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f99b40860c0 con 0x7f99b80b2de0 2024-04-21T08:57:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.870+0000 7f99bcbd9640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f999c068380 0x7f999c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:51.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.870+0000 7f99bcbd9640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f999c068380 0x7f999c06a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99b8159740 tx=0x7f99a8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:51.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:51.874+0000 7f99adffb640 1 -- 172.21.15.26:0/3504561796 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f99b4056710 con 0x7f99b80b2de0 2024-04-21T08:57:52.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.026+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f99b80c94f0 con 0x7f999c068380 2024-04-21T08:57:52.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.046+0000 7f99adffb640 1 -- 172.21.15.26:0/3504561796 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252020 (secure 0 0 0) 0x7f99b80c94f0 con 0x7f999c068380 2024-04-21T08:57:52.048 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:52.050 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T08:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f999c068380 msgr2=0x7f999c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f999c068380 0x7f999c06a840 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99b8159740 tx=0x7f99a8008040 comp rx=0 tx=0).stop 2024-04-21T08:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b80b2de0 msgr2=0x7f99b81f2680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b80b2de0 0x7f99b81f2680 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f99b400c3a0 tx=0x7f99b400c860 comp rx=0 tx=0).stop 2024-04-21T08:57:52.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 shutdown_connections 2024-04-21T08:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f99b8154d00 0x7f99b81f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f99b80c1f50 0x7f99b81f2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f999c068380 0x7f999c06a840 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 --2- 172.21.15.26:0/3504561796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f99b80b2de0 0x7f99b81f2680 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 >> 172.21.15.26:0/3504561796 conn(0x7f99b80701f0 msgr2=0x7f99b815a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 shutdown_connections 2024-04-21T08:57:52.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.050+0000 7f99bf63e640 1 -- 172.21.15.26:0/3504561796 wait complete. 2024-04-21T08:57:52.067 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-21T08:57:51.125175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234600,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740120,"statfs":{"total":773094113280,"available":772853882880,"internally_reserved":0,"allocated":1867776,"data_stored":1773404,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.893865"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478008+0000","last_change":"2024-04-21T08:57:44.312400+0000","last_active":"2024-04-21T08:57:45.478008+0000","last_peered":"2024-04-21T08:57:45.478008+0000","last_clean":"2024-04-21T08:57:45.478008+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T08:57:45.478008+0000","last_undegraded":"2024-04-21T08:57:45.478008+0000","last_fullsized":"2024-04-21T08:57:45.478008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302244+0000","last_change":"2024-04-21T08:57:44.307469+0000","last_active":"2024-04-21T08:57:45.302244+0000","last_peered":"2024-04-21T08:57:45.302244+0000","last_clean":"2024-04-21T08:57:45.302244+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T08:57:45.302244+0000","last_undegraded":"2024-04-21T08:57:45.302244+0000","last_fullsized":"2024-04-21T08:57:45.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301915+0000","last_change":"2024-04-21T08:57:44.283704+0000","last_active":"2024-04-21T08:57:45.301915+0000","last_peered":"2024-04-21T08:57:45.301915+0000","last_clean":"2024-04-21T08:57:45.301915+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T08:57:45.301915+0000","last_undegraded":"2024-04-21T08:57:45.301915+0000","last_fullsized":"2024-04-21T08:57:45.301915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:22:29.477559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474882+0000","last_change":"2024-04-21T08:57:44.297940+0000","last_active":"2024-04-21T08:57:45.474882+0000","last_peered":"2024-04-21T08:57:45.474882+0000","last_clean":"2024-04-21T08:57:45.474882+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T08:57:45.474882+0000","last_undegraded":"2024-04-21T08:57:45.474882+0000","last_fullsized":"2024-04-21T08:57:45.474882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477621+0000","last_change":"2024-04-21T08:57:44.319147+0000","last_active":"2024-04-21T08:57:45.477621+0000","last_peered":"2024-04-21T08:57:45.477621+0000","last_clean":"2024-04-21T08:57:45.477621+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T08:57:45.477621+0000","last_undegraded":"2024-04-21T08:57:45.477621+0000","last_fullsized":"2024-04-21T08:57:45.477621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475406+0000","last_change":"2024-04-21T08:57:44.292228+0000","last_active":"2024-04-21T08:57:45.475406+0000","last_peered":"2024-04-21T08:57:45.475406+0000","last_clean":"2024-04-21T08:57:45.475406+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T08:57:45.475406+0000","last_undegraded":"2024-04-21T08:57:45.475406+0000","last_fullsized":"2024-04-21T08:57:45.475406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476097+0000","last_change":"2024-04-21T08:57:44.307483+0000","last_active":"2024-04-21T08:57:45.476097+0000","last_peered":"2024-04-21T08:57:45.476097+0000","last_clean":"2024-04-21T08:57:45.476097+0000","last_became_active":"2024-04-21T08:57:44.307147+0000","last_became_peered":"2024-04-21T08:57:44.307147+0000","last_unstale":"2024-04-21T08:57:45.476097+0000","last_undegraded":"2024-04-21T08:57:45.476097+0000","last_fullsized":"2024-04-21T08:57:45.476097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301538+0000","last_change":"2024-04-21T08:57:44.316305+0000","last_active":"2024-04-21T08:57:45.301538+0000","last_peered":"2024-04-21T08:57:45.301538+0000","last_clean":"2024-04-21T08:57:45.301538+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T08:57:45.301538+0000","last_undegraded":"2024-04-21T08:57:45.301538+0000","last_fullsized":"2024-04-21T08:57:45.301538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:02.718251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296716+0000","last_change":"2024-04-21T08:57:44.306928+0000","last_active":"2024-04-21T08:57:45.296716+0000","last_peered":"2024-04-21T08:57:45.296716+0000","last_clean":"2024-04-21T08:57:45.296716+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T08:57:45.296716+0000","last_undegraded":"2024-04-21T08:57:45.296716+0000","last_fullsized":"2024-04-21T08:57:45.296716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:47.382588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477106+0000","last_change":"2024-04-21T08:57:44.307925+0000","last_active":"2024-04-21T08:57:45.477106+0000","last_peered":"2024-04-21T08:57:45.477106+0000","last_clean":"2024-04-21T08:57:45.477106+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T08:57:45.477106+0000","last_undegraded":"2024-04-21T08:57:45.477106+0000","last_fullsized":"2024-04-21T08:57:45.477106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475344+0000","last_change":"2024-04-21T08:57:44.312289+0000","last_active":"2024-04-21T08:57:45.475344+0000","last_peered":"2024-04-21T08:57:45.475344+0000","last_clean":"2024-04-21T08:57:45.475344+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T08:57:45.475344+0000","last_undegraded":"2024-04-21T08:57:45.475344+0000","last_fullsized":"2024-04-21T08:57:45.475344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477952+0000","last_change":"2024-04-21T08:57:44.315406+0000","last_active":"2024-04-21T08:57:45.477952+0000","last_peered":"2024-04-21T08:57:45.477952+0000","last_clean":"2024-04-21T08:57:45.477952+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T08:57:45.477952+0000","last_undegraded":"2024-04-21T08:57:45.477952+0000","last_fullsized":"2024-04-21T08:57:45.477952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475316+0000","last_change":"2024-04-21T08:57:44.321357+0000","last_active":"2024-04-21T08:57:45.475316+0000","last_peered":"2024-04-21T08:57:45.475316+0000","last_clean":"2024-04-21T08:57:45.475316+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T08:57:45.475316+0000","last_undegraded":"2024-04-21T08:57:45.475316+0000","last_fullsized":"2024-04-21T08:57:45.475316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:01:59.921966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475445+0000","last_change":"2024-04-21T08:57:44.315428+0000","last_active":"2024-04-21T08:57:45.475445+0000","last_peered":"2024-04-21T08:57:45.475445+0000","last_clean":"2024-04-21T08:57:45.475445+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T08:57:45.475445+0000","last_undegraded":"2024-04-21T08:57:45.475445+0000","last_fullsized":"2024-04-21T08:57:45.475445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301076+0000","last_change":"2024-04-21T08:57:44.285663+0000","last_active":"2024-04-21T08:57:45.301076+0000","last_peered":"2024-04-21T08:57:45.301076+0000","last_clean":"2024-04-21T08:57:45.301076+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T08:57:45.301076+0000","last_undegraded":"2024-04-21T08:57:45.301076+0000","last_fullsized":"2024-04-21T08:57:45.301076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:54:18.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474994+0000","last_change":"2024-04-21T08:57:44.288842+0000","last_active":"2024-04-21T08:57:45.474994+0000","last_peered":"2024-04-21T08:57:45.474994+0000","last_clean":"2024-04-21T08:57:45.474994+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T08:57:45.474994+0000","last_undegraded":"2024-04-21T08:57:45.474994+0000","last_fullsized":"2024-04-21T08:57:45.474994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479022+0000","last_change":"2024-04-21T08:57:44.320371+0000","last_active":"2024-04-21T08:57:45.479022+0000","last_peered":"2024-04-21T08:57:45.479022+0000","last_clean":"2024-04-21T08:57:45.479022+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T08:57:45.479022+0000","last_undegraded":"2024-04-21T08:57:45.479022+0000","last_fullsized":"2024-04-21T08:57:45.479022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:37:23.456724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474849+0000","last_change":"2024-04-21T08:57:44.302161+0000","last_active":"2024-04-21T08:57:45.474849+0000","last_peered":"2024-04-21T08:57:45.474849+0000","last_clean":"2024-04-21T08:57:45.474849+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T08:57:45.474849+0000","last_undegraded":"2024-04-21T08:57:45.474849+0000","last_fullsized":"2024-04-21T08:57:45.474849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478601+0000","last_change":"2024-04-21T08:57:44.289531+0000","last_active":"2024-04-21T08:57:45.478601+0000","last_peered":"2024-04-21T08:57:45.478601+0000","last_clean":"2024-04-21T08:57:45.478601+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T08:57:45.478601+0000","last_undegraded":"2024-04-21T08:57:45.478601+0000","last_fullsized":"2024-04-21T08:57:45.478601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:42:25.869615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477213+0000","last_change":"2024-04-21T08:57:44.315116+0000","last_active":"2024-04-21T08:57:45.477213+0000","last_peered":"2024-04-21T08:57:45.477213+0000","last_clean":"2024-04-21T08:57:45.477213+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T08:57:45.477213+0000","last_undegraded":"2024-04-21T08:57:45.477213+0000","last_fullsized":"2024-04-21T08:57:45.477213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300338+0000","last_change":"2024-04-21T08:57:44.299295+0000","last_active":"2024-04-21T08:57:45.300338+0000","last_peered":"2024-04-21T08:57:45.300338+0000","last_clean":"2024-04-21T08:57:45.300338+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T08:57:45.300338+0000","last_undegraded":"2024-04-21T08:57:45.300338+0000","last_fullsized":"2024-04-21T08:57:45.300338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:32:23.460346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296074+0000","last_change":"2024-04-21T08:57:44.293141+0000","last_active":"2024-04-21T08:57:45.296074+0000","last_peered":"2024-04-21T08:57:45.296074+0000","last_clean":"2024-04-21T08:57:45.296074+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T08:57:45.296074+0000","last_undegraded":"2024-04-21T08:57:45.296074+0000","last_fullsized":"2024-04-21T08:57:45.296074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301628+0000","last_change":"2024-04-21T08:57:44.291347+0000","last_active":"2024-04-21T08:57:45.301628+0000","last_peered":"2024-04-21T08:57:45.301628+0000","last_clean":"2024-04-21T08:57:45.301628+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T08:57:45.301628+0000","last_undegraded":"2024-04-21T08:57:45.301628+0000","last_fullsized":"2024-04-21T08:57:45.301628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:29.349924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475426+0000","last_change":"2024-04-21T08:57:44.283481+0000","last_active":"2024-04-21T08:57:45.475426+0000","last_peered":"2024-04-21T08:57:45.475426+0000","last_clean":"2024-04-21T08:57:45.475426+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T08:57:45.475426+0000","last_undegraded":"2024-04-21T08:57:45.475426+0000","last_fullsized":"2024-04-21T08:57:45.475426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302199+0000","last_change":"2024-04-21T08:57:44.304218+0000","last_active":"2024-04-21T08:57:45.302199+0000","last_peered":"2024-04-21T08:57:45.302199+0000","last_clean":"2024-04-21T08:57:45.302199+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T08:57:45.302199+0000","last_undegraded":"2024-04-21T08:57:45.302199+0000","last_fullsized":"2024-04-21T08:57:45.302199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476814+0000","last_change":"2024-04-21T08:57:44.305569+0000","last_active":"2024-04-21T08:57:45.476814+0000","last_peered":"2024-04-21T08:57:45.476814+0000","last_clean":"2024-04-21T08:57:45.476814+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T08:57:45.476814+0000","last_undegraded":"2024-04-21T08:57:45.476814+0000","last_fullsized":"2024-04-21T08:57:45.476814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476147+0000","last_change":"2024-04-21T08:57:44.314872+0000","last_active":"2024-04-21T08:57:45.476147+0000","last_peered":"2024-04-21T08:57:45.476147+0000","last_clean":"2024-04-21T08:57:45.476147+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T08:57:45.476147+0000","last_undegraded":"2024-04-21T08:57:45.476147+0000","last_fullsized":"2024-04-21T08:57:45.476147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475471+0000","last_change":"2024-04-21T08:57:44.320786+0000","last_active":"2024-04-21T08:57:45.475471+0000","last_peered":"2024-04-21T08:57:45.475471+0000","last_clean":"2024-04-21T08:57:45.475471+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T08:57:45.475471+0000","last_undegraded":"2024-04-21T08:57:45.475471+0000","last_fullsized":"2024-04-21T08:57:45.475471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301360+0000","last_change":"2024-04-21T08:57:44.292576+0000","last_active":"2024-04-21T08:57:45.301360+0000","last_peered":"2024-04-21T08:57:45.301360+0000","last_clean":"2024-04-21T08:57:45.301360+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T08:57:45.301360+0000","last_undegraded":"2024-04-21T08:57:45.301360+0000","last_fullsized":"2024-04-21T08:57:45.301360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:41:15.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476800+0000","last_change":"2024-04-21T08:57:44.301159+0000","last_active":"2024-04-21T08:57:45.476800+0000","last_peered":"2024-04-21T08:57:45.476800+0000","last_clean":"2024-04-21T08:57:45.476800+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T08:57:45.476800+0000","last_undegraded":"2024-04-21T08:57:45.476800+0000","last_fullsized":"2024-04-21T08:57:45.476800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473997+0000","last_change":"2024-04-21T08:57:44.295923+0000","last_active":"2024-04-21T08:57:45.473997+0000","last_peered":"2024-04-21T08:57:45.473997+0000","last_clean":"2024-04-21T08:57:45.473997+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T08:57:45.473997+0000","last_undegraded":"2024-04-21T08:57:45.473997+0000","last_fullsized":"2024-04-21T08:57:45.473997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474254+0000","last_change":"2024-04-21T08:57:44.317457+0000","last_active":"2024-04-21T08:57:45.474254+0000","last_peered":"2024-04-21T08:57:45.474254+0000","last_clean":"2024-04-21T08:57:45.474254+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T08:57:45.474254+0000","last_undegraded":"2024-04-21T08:57:45.474254+0000","last_fullsized":"2024-04-21T08:57:45.474254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:17.843858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296164+0000","last_change":"2024-04-21T08:57:44.293278+0000","last_active":"2024-04-21T08:57:45.296164+0000","last_peered":"2024-04-21T08:57:45.296164+0000","last_clean":"2024-04-21T08:57:45.296164+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T08:57:45.296164+0000","last_undegraded":"2024-04-21T08:57:45.296164+0000","last_fullsized":"2024-04-21T08:57:45.296164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162151+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T08:57:47.162151+0000","last_peered":"2024-04-21T08:57:47.162151+0000","last_clean":"2024-04-21T08:57:47.162151+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T08:57:47.162151+0000","last_undegraded":"2024-04-21T08:57:47.162151+0000","last_fullsized":"2024-04-21T08:57:47.162151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300238+0000","last_change":"2024-04-21T08:57:44.308011+0000","last_active":"2024-04-21T08:57:45.300238+0000","last_peered":"2024-04-21T08:57:45.300238+0000","last_clean":"2024-04-21T08:57:45.300238+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T08:57:45.300238+0000","last_undegraded":"2024-04-21T08:57:45.300238+0000","last_fullsized":"2024-04-21T08:57:45.300238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:45.396672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478237+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T08:57:45.478237+0000","last_peered":"2024-04-21T08:57:45.478237+0000","last_clean":"2024-04-21T08:57:45.478237+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T08:57:45.478237+0000","last_undegraded":"2024-04-21T08:57:45.478237+0000","last_fullsized":"2024-04-21T08:57:45.478237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475213+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T08:57:45.475213+0000","last_peered":"2024-04-21T08:57:45.475213+0000","last_clean":"2024-04-21T08:57:45.475213+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T08:57:45.475213+0000","last_undegraded":"2024-04-21T08:57:45.475213+0000","last_fullsized":"2024-04-21T08:57:45.475213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302334+0000","last_change":"2024-04-21T08:57:44.307616+0000","last_active":"2024-04-21T08:57:45.302334+0000","last_peered":"2024-04-21T08:57:45.302334+0000","last_clean":"2024-04-21T08:57:45.302334+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T08:57:45.302334+0000","last_undegraded":"2024-04-21T08:57:45.302334+0000","last_fullsized":"2024-04-21T08:57:45.302334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475348+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T08:57:45.475348+0000","last_peered":"2024-04-21T08:57:45.475348+0000","last_clean":"2024-04-21T08:57:45.475348+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T08:57:45.475348+0000","last_undegraded":"2024-04-21T08:57:45.475348+0000","last_fullsized":"2024-04-21T08:57:45.475348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300102+0000","last_change":"2024-04-21T08:57:44.285516+0000","last_active":"2024-04-21T08:57:45.300102+0000","last_peered":"2024-04-21T08:57:45.300102+0000","last_clean":"2024-04-21T08:57:45.300102+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T08:57:45.300102+0000","last_undegraded":"2024-04-21T08:57:45.300102+0000","last_fullsized":"2024-04-21T08:57:45.300102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296625+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T08:57:45.296625+0000","last_peered":"2024-04-21T08:57:45.296625+0000","last_clean":"2024-04-21T08:57:45.296625+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T08:57:45.296625+0000","last_undegraded":"2024-04-21T08:57:45.296625+0000","last_fullsized":"2024-04-21T08:57:45.296625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477228+0000","last_change":"2024-04-21T08:57:44.305837+0000","last_active":"2024-04-21T08:57:45.477228+0000","last_peered":"2024-04-21T08:57:45.477228+0000","last_clean":"2024-04-21T08:57:45.477228+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T08:57:45.477228+0000","last_undegraded":"2024-04-21T08:57:45.477228+0000","last_fullsized":"2024-04-21T08:57:45.477228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477323+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T08:57:45.477323+0000","last_peered":"2024-04-21T08:57:45.477323+0000","last_clean":"2024-04-21T08:57:45.477323+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T08:57:45.477323+0000","last_undegraded":"2024-04-21T08:57:45.477323+0000","last_fullsized":"2024-04-21T08:57:45.477323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302616+0000","last_change":"2024-04-21T08:57:44.305156+0000","last_active":"2024-04-21T08:57:45.302616+0000","last_peered":"2024-04-21T08:57:45.302616+0000","last_clean":"2024-04-21T08:57:45.302616+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T08:57:45.302616+0000","last_undegraded":"2024-04-21T08:57:45.302616+0000","last_fullsized":"2024-04-21T08:57:45.302616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.320749+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T08:57:49.320749+0000","last_peered":"2024-04-21T08:57:49.320749+0000","last_clean":"2024-04-21T08:57:49.320749+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T08:57:49.320749+0000","last_undegraded":"2024-04-21T08:57:49.320749+0000","last_fullsized":"2024-04-21T08:57:49.320749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476386+0000","last_change":"2024-04-21T08:57:44.296804+0000","last_active":"2024-04-21T08:57:45.476386+0000","last_peered":"2024-04-21T08:57:45.476386+0000","last_clean":"2024-04-21T08:57:45.476386+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T08:57:45.476386+0000","last_undegraded":"2024-04-21T08:57:45.476386+0000","last_fullsized":"2024-04-21T08:57:45.476386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319718+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T08:57:49.319718+0000","last_peered":"2024-04-21T08:57:49.319718+0000","last_clean":"2024-04-21T08:57:49.319718+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T08:57:49.319718+0000","last_undegraded":"2024-04-21T08:57:49.319718+0000","last_fullsized":"2024-04-21T08:57:49.319718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475742+0000","last_change":"2024-04-21T08:57:44.323678+0000","last_active":"2024-04-21T08:57:45.475742+0000","last_peered":"2024-04-21T08:57:45.475742+0000","last_clean":"2024-04-21T08:57:45.475742+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T08:57:45.475742+0000","last_undegraded":"2024-04-21T08:57:45.475742+0000","last_fullsized":"2024-04-21T08:57:45.475742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318895+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T08:57:49.318895+0000","last_peered":"2024-04-21T08:57:49.318895+0000","last_clean":"2024-04-21T08:57:49.318895+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T08:57:49.318895+0000","last_undegraded":"2024-04-21T08:57:49.318895+0000","last_fullsized":"2024-04-21T08:57:49.318895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475320+0000","last_change":"2024-04-21T08:57:44.310092+0000","last_active":"2024-04-21T08:57:45.475320+0000","last_peered":"2024-04-21T08:57:45.475320+0000","last_clean":"2024-04-21T08:57:45.475320+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T08:57:45.475320+0000","last_undegraded":"2024-04-21T08:57:45.475320+0000","last_fullsized":"2024-04-21T08:57:45.475320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:03.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478308+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T08:57:45.478308+0000","last_peered":"2024-04-21T08:57:45.478308+0000","last_clean":"2024-04-21T08:57:45.478308+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T08:57:45.478308+0000","last_undegraded":"2024-04-21T08:57:45.478308+0000","last_fullsized":"2024-04-21T08:57:45.478308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477225+0000","last_change":"2024-04-21T08:57:44.320598+0000","last_active":"2024-04-21T08:57:45.477225+0000","last_peered":"2024-04-21T08:57:45.477225+0000","last_clean":"2024-04-21T08:57:45.477225+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T08:57:45.477225+0000","last_undegraded":"2024-04-21T08:57:45.477225+0000","last_fullsized":"2024-04-21T08:57:45.477225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:51.743927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476234+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T08:57:45.476234+0000","last_peered":"2024-04-21T08:57:45.476234+0000","last_clean":"2024-04-21T08:57:45.476234+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T08:57:45.476234+0000","last_undegraded":"2024-04-21T08:57:45.476234+0000","last_fullsized":"2024-04-21T08:57:45.476234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295791+0000","last_change":"2024-04-21T08:57:44.292658+0000","last_active":"2024-04-21T08:57:45.295791+0000","last_peered":"2024-04-21T08:57:45.295791+0000","last_clean":"2024-04-21T08:57:45.295791+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T08:57:45.295791+0000","last_undegraded":"2024-04-21T08:57:45.295791+0000","last_fullsized":"2024-04-21T08:57:45.295791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.321102+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T08:57:49.321102+0000","last_peered":"2024-04-21T08:57:49.321102+0000","last_clean":"2024-04-21T08:57:49.321102+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T08:57:49.321102+0000","last_undegraded":"2024-04-21T08:57:49.321102+0000","last_fullsized":"2024-04-21T08:57:49.321102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475925+0000","last_change":"2024-04-21T08:57:44.289358+0000","last_active":"2024-04-21T08:57:45.475925+0000","last_peered":"2024-04-21T08:57:45.475925+0000","last_clean":"2024-04-21T08:57:45.475925+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T08:57:45.475925+0000","last_undegraded":"2024-04-21T08:57:45.475925+0000","last_fullsized":"2024-04-21T08:57:45.475925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478220+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T08:57:45.478220+0000","last_peered":"2024-04-21T08:57:45.478220+0000","last_clean":"2024-04-21T08:57:45.478220+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T08:57:45.478220+0000","last_undegraded":"2024-04-21T08:57:45.478220+0000","last_fullsized":"2024-04-21T08:57:45.478220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477620+0000","last_change":"2024-04-21T08:57:44.321062+0000","last_active":"2024-04-21T08:57:45.477620+0000","last_peered":"2024-04-21T08:57:45.477620+0000","last_clean":"2024-04-21T08:57:45.477620+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T08:57:45.477620+0000","last_undegraded":"2024-04-21T08:57:45.477620+0000","last_fullsized":"2024-04-21T08:57:45.477620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318978+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T08:57:49.318978+0000","last_peered":"2024-04-21T08:57:49.318978+0000","last_clean":"2024-04-21T08:57:49.318978+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T08:57:49.318978+0000","last_undegraded":"2024-04-21T08:57:49.318978+0000","last_fullsized":"2024-04-21T08:57:49.318978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477974+0000","last_change":"2024-04-21T08:57:44.315764+0000","last_active":"2024-04-21T08:57:45.477974+0000","last_peered":"2024-04-21T08:57:45.477974+0000","last_clean":"2024-04-21T08:57:45.477974+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T08:57:45.477974+0000","last_undegraded":"2024-04-21T08:57:45.477974+0000","last_fullsized":"2024-04-21T08:57:45.477974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162213+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T08:57:47.162213+0000","last_peered":"2024-04-21T08:57:47.162213+0000","last_clean":"2024-04-21T08:57:47.162213+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T08:57:47.162213+0000","last_undegraded":"2024-04-21T08:57:47.162213+0000","last_fullsized":"2024-04-21T08:57:47.162213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477623+0000","last_change":"2024-04-21T08:57:44.315316+0000","last_active":"2024-04-21T08:57:45.477623+0000","last_peered":"2024-04-21T08:57:45.477623+0000","last_clean":"2024-04-21T08:57:45.477623+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T08:57:45.477623+0000","last_undegraded":"2024-04-21T08:57:45.477623+0000","last_fullsized":"2024-04-21T08:57:45.477623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475756+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T08:57:45.475756+0000","last_peered":"2024-04-21T08:57:45.475756+0000","last_clean":"2024-04-21T08:57:45.475756+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T08:57:45.475756+0000","last_undegraded":"2024-04-21T08:57:45.475756+0000","last_fullsized":"2024-04-21T08:57:45.475756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478318+0000","last_change":"2024-04-21T08:57:44.298472+0000","last_active":"2024-04-21T08:57:45.478318+0000","last_peered":"2024-04-21T08:57:45.478318+0000","last_clean":"2024-04-21T08:57:45.478318+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T08:57:45.478318+0000","last_undegraded":"2024-04-21T08:57:45.478318+0000","last_fullsized":"2024-04-21T08:57:45.478318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:14:06.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295542+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T08:57:45.295542+0000","last_peered":"2024-04-21T08:57:45.295542+0000","last_clean":"2024-04-21T08:57:45.295542+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T08:57:45.295542+0000","last_undegraded":"2024-04-21T08:57:45.295542+0000","last_fullsized":"2024-04-21T08:57:45.295542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477601+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T08:57:45.477601+0000","last_peered":"2024-04-21T08:57:45.477601+0000","last_clean":"2024-04-21T08:57:45.477601+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T08:57:45.477601+0000","last_undegraded":"2024-04-21T08:57:45.477601+0000","last_fullsized":"2024-04-21T08:57:45.477601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300093+0000","last_change":"2024-04-21T08:57:44.289877+0000","last_active":"2024-04-21T08:57:45.300093+0000","last_peered":"2024-04-21T08:57:45.300093+0000","last_clean":"2024-04-21T08:57:45.300093+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T08:57:45.300093+0000","last_undegraded":"2024-04-21T08:57:45.300093+0000","last_fullsized":"2024-04-21T08:57:45.300093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475561+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T08:57:45.475561+0000","last_peered":"2024-04-21T08:57:45.475561+0000","last_clean":"2024-04-21T08:57:45.475561+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T08:57:45.475561+0000","last_undegraded":"2024-04-21T08:57:45.475561+0000","last_fullsized":"2024-04-21T08:57:45.475561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474956+0000","last_change":"2024-04-21T08:57:44.309539+0000","last_active":"2024-04-21T08:57:45.474956+0000","last_peered":"2024-04-21T08:57:45.474956+0000","last_clean":"2024-04-21T08:57:45.474956+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T08:57:45.474956+0000","last_undegraded":"2024-04-21T08:57:45.474956+0000","last_fullsized":"2024-04-21T08:57:45.474956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:47:34.419511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473930+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T08:57:45.473930+0000","last_peered":"2024-04-21T08:57:45.473930+0000","last_clean":"2024-04-21T08:57:45.473930+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T08:57:45.473930+0000","last_undegraded":"2024-04-21T08:57:45.473930+0000","last_fullsized":"2024-04-21T08:57:45.473930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301947+0000","last_change":"2024-04-21T08:57:44.298533+0000","last_active":"2024-04-21T08:57:45.301947+0000","last_peered":"2024-04-21T08:57:45.301947+0000","last_clean":"2024-04-21T08:57:45.301947+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T08:57:45.301947+0000","last_undegraded":"2024-04-21T08:57:45.301947+0000","last_fullsized":"2024-04-21T08:57:45.301947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478433+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T08:57:45.478433+0000","last_peered":"2024-04-21T08:57:45.478433+0000","last_clean":"2024-04-21T08:57:45.478433+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T08:57:45.478433+0000","last_undegraded":"2024-04-21T08:57:45.478433+0000","last_fullsized":"2024-04-21T08:57:45.478433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477998+0000","last_change":"2024-04-21T08:57:44.315633+0000","last_active":"2024-04-21T08:57:45.477998+0000","last_peered":"2024-04-21T08:57:45.477998+0000","last_clean":"2024-04-21T08:57:45.477998+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T08:57:45.477998+0000","last_undegraded":"2024-04-21T08:57:45.477998+0000","last_fullsized":"2024-04-21T08:57:45.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301760+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T08:57:45.301760+0000","last_peered":"2024-04-21T08:57:45.301760+0000","last_clean":"2024-04-21T08:57:45.301760+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T08:57:45.301760+0000","last_undegraded":"2024-04-21T08:57:45.301760+0000","last_fullsized":"2024-04-21T08:57:45.301760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475775+0000","last_change":"2024-04-21T08:57:44.318478+0000","last_active":"2024-04-21T08:57:45.475775+0000","last_peered":"2024-04-21T08:57:45.475775+0000","last_clean":"2024-04-21T08:57:45.475775+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T08:57:45.475775+0000","last_undegraded":"2024-04-21T08:57:45.475775+0000","last_fullsized":"2024-04-21T08:57:45.475775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478561+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T08:57:45.478561+0000","last_peered":"2024-04-21T08:57:45.478561+0000","last_clean":"2024-04-21T08:57:45.478561+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T08:57:45.478561+0000","last_undegraded":"2024-04-21T08:57:45.478561+0000","last_fullsized":"2024-04-21T08:57:45.478561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475343+0000","last_change":"2024-04-21T08:57:44.305172+0000","last_active":"2024-04-21T08:57:45.475343+0000","last_peered":"2024-04-21T08:57:45.475343+0000","last_clean":"2024-04-21T08:57:45.475343+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T08:57:45.475343+0000","last_undegraded":"2024-04-21T08:57:45.475343+0000","last_fullsized":"2024-04-21T08:57:45.475343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:13:46.282333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301089+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T08:57:45.301089+0000","last_peered":"2024-04-21T08:57:45.301089+0000","last_clean":"2024-04-21T08:57:45.301089+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T08:57:45.301089+0000","last_undegraded":"2024-04-21T08:57:45.301089+0000","last_fullsized":"2024-04-21T08:57:45.301089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300739+0000","last_change":"2024-04-21T08:57:44.311283+0000","last_active":"2024-04-21T08:57:45.300739+0000","last_peered":"2024-04-21T08:57:45.300739+0000","last_clean":"2024-04-21T08:57:45.300739+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T08:57:45.300739+0000","last_undegraded":"2024-04-21T08:57:45.300739+0000","last_fullsized":"2024-04-21T08:57:45.300739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:06:14.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.316902+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T08:57:49.316902+0000","last_peered":"2024-04-21T08:57:49.316902+0000","last_clean":"2024-04-21T08:57:49.316902+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T08:57:49.316902+0000","last_undegraded":"2024-04-21T08:57:49.316902+0000","last_fullsized":"2024-04-21T08:57:49.316902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300568+0000","last_change":"2024-04-21T08:57:44.293449+0000","last_active":"2024-04-21T08:57:45.300568+0000","last_peered":"2024-04-21T08:57:45.300568+0000","last_clean":"2024-04-21T08:57:45.300568+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T08:57:45.300568+0000","last_undegraded":"2024-04-21T08:57:45.300568+0000","last_fullsized":"2024-04-21T08:57:45.300568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:13:04.768707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474913+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T08:57:45.474913+0000","last_peered":"2024-04-21T08:57:45.474913+0000","last_clean":"2024-04-21T08:57:45.474913+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T08:57:45.474913+0000","last_undegraded":"2024-04-21T08:57:45.474913+0000","last_fullsized":"2024-04-21T08:57:45.474913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476103+0000","last_change":"2024-04-21T08:57:44.294831+0000","last_active":"2024-04-21T08:57:45.476103+0000","last_peered":"2024-04-21T08:57:45.476103+0000","last_clean":"2024-04-21T08:57:45.476103+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T08:57:45.476103+0000","last_undegraded":"2024-04-21T08:57:45.476103+0000","last_fullsized":"2024-04-21T08:57:45.476103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300649+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T08:57:45.300649+0000","last_peered":"2024-04-21T08:57:45.300649+0000","last_clean":"2024-04-21T08:57:45.300649+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T08:57:45.300649+0000","last_undegraded":"2024-04-21T08:57:45.300649+0000","last_fullsized":"2024-04-21T08:57:45.300649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.299620+0000","last_change":"2024-04-21T08:57:44.299090+0000","last_active":"2024-04-21T08:57:45.299620+0000","last_peered":"2024-04-21T08:57:45.299620+0000","last_clean":"2024-04-21T08:57:45.299620+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T08:57:45.299620+0000","last_undegraded":"2024-04-21T08:57:45.299620+0000","last_fullsized":"2024-04-21T08:57:45.299620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475613+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T08:57:45.475613+0000","last_peered":"2024-04-21T08:57:45.475613+0000","last_clean":"2024-04-21T08:57:45.475613+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T08:57:45.475613+0000","last_undegraded":"2024-04-21T08:57:45.475613+0000","last_fullsized":"2024-04-21T08:57:45.475613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474385+0000","last_change":"2024-04-21T08:57:44.317697+0000","last_active":"2024-04-21T08:57:45.474385+0000","last_peered":"2024-04-21T08:57:45.474385+0000","last_clean":"2024-04-21T08:57:45.474385+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T08:57:45.474385+0000","last_undegraded":"2024-04-21T08:57:45.474385+0000","last_fullsized":"2024-04-21T08:57:45.474385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.317492+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T08:57:49.317492+0000","last_peered":"2024-04-21T08:57:49.317492+0000","last_clean":"2024-04-21T08:57:49.317492+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T08:57:49.317492+0000","last_undegraded":"2024-04-21T08:57:49.317492+0000","last_fullsized":"2024-04-21T08:57:49.317492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478072+0000","last_change":"2024-04-21T08:57:44.300498+0000","last_active":"2024-04-21T08:57:45.478072+0000","last_peered":"2024-04-21T08:57:45.478072+0000","last_clean":"2024-04-21T08:57:45.478072+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T08:57:45.478072+0000","last_undegraded":"2024-04-21T08:57:45.478072+0000","last_fullsized":"2024-04-21T08:57:45.478072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:36:51.242004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478121+0000","last_change":"2024-04-21T08:57:44.321085+0000","last_active":"2024-04-21T08:57:45.478121+0000","last_peered":"2024-04-21T08:57:45.478121+0000","last_clean":"2024-04-21T08:57:45.478121+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T08:57:45.478121+0000","last_undegraded":"2024-04-21T08:57:45.478121+0000","last_fullsized":"2024-04-21T08:57:45.478121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:49.754472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.313140+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T08:57:49.313140+0000","last_peered":"2024-04-21T08:57:49.313140+0000","last_clean":"2024-04-21T08:57:49.313140+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T08:57:49.313140+0000","last_undegraded":"2024-04-21T08:57:49.313140+0000","last_fullsized":"2024-04-21T08:57:49.313140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296663+0000","last_change":"2024-04-21T08:57:44.315810+0000","last_active":"2024-04-21T08:57:45.296663+0000","last_peered":"2024-04-21T08:57:45.296663+0000","last_clean":"2024-04-21T08:57:45.296663+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T08:57:45.296663+0000","last_undegraded":"2024-04-21T08:57:45.296663+0000","last_fullsized":"2024-04-21T08:57:45.296663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.311969+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T08:57:49.311969+0000","last_peered":"2024-04-21T08:57:49.311969+0000","last_clean":"2024-04-21T08:57:49.311969+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T08:57:49.311969+0000","last_undegraded":"2024-04-21T08:57:49.311969+0000","last_fullsized":"2024-04-21T08:57:49.311969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302388+0000","last_change":"2024-04-21T08:57:44.303912+0000","last_active":"2024-04-21T08:57:45.302388+0000","last_peered":"2024-04-21T08:57:45.302388+0000","last_clean":"2024-04-21T08:57:45.302388+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T08:57:45.302388+0000","last_undegraded":"2024-04-21T08:57:45.302388+0000","last_fullsized":"2024-04-21T08:57:45.302388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162279+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T08:57:47.162279+0000","last_peered":"2024-04-21T08:57:47.162279+0000","last_clean":"2024-04-21T08:57:47.162279+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T08:57:47.162279+0000","last_undegraded":"2024-04-21T08:57:47.162279+0000","last_fullsized":"2024-04-21T08:57:47.162279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302272+0000","last_change":"2024-04-21T08:57:44.301951+0000","last_active":"2024-04-21T08:57:45.302272+0000","last_peered":"2024-04-21T08:57:45.302272+0000","last_clean":"2024-04-21T08:57:45.302272+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T08:57:45.302272+0000","last_undegraded":"2024-04-21T08:57:45.302272+0000","last_fullsized":"2024-04-21T08:57:45.302272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319970+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T08:57:49.319970+0000","last_peered":"2024-04-21T08:57:49.319970+0000","last_clean":"2024-04-21T08:57:49.319970+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T08:57:49.319970+0000","last_undegraded":"2024-04-21T08:57:49.319970+0000","last_fullsized":"2024-04-21T08:57:49.319970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":212992,"data_stored":74063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":75093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":663919,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":217088,"data_stored":73537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":663941,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T08:57:52.071 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T08:57:52.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f92dd640 1 Processor -- start 2024-04-21T08:57:52.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f92dd640 1 -- start start 2024-04-21T08:57:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f92dd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f40c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f92dd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5f40c5690 0x7fd5f41595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f92dd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5f40c6050 con 0x7fd5f40c52b0 2024-04-21T08:57:52.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f92dd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd5f40c5e00 con 0x7fd5f40c5690 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f92dd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f40c6330 con 0x7fd5f4073b50 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5f40c5690 0x7fd5f41595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd5f40c5690 0x7fd5f41595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54256/0 (socket says 172.21.15.26:54256) 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f37fe640 1 -- 172.21.15.26:0/1686541107 learned_addr learned my addr 172.21.15.26:0/1686541107 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5ebfff640 1 --2- 172.21.15.26:0/1686541107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f40c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f37fe640 1 -- 172.21.15.26:0/1686541107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 msgr2=0x7fd5f40c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f37fe640 1 --2- 172.21.15.26:0/1686541107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f40c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f37fe640 1 -- 172.21.15.26:0/1686541107 >> v1:172.21.15.169:6789/0 conn(0x7fd5f40c52b0 legacy=0x7fd5f41529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:52.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.230+0000 7fd5f37fe640 1 -- 172.21.15.26:0/1686541107 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f40c3470 con 0x7fd5f40c5690 2024-04-21T08:57:52.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f37fe640 1 --2- 172.21.15.26:0/1686541107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c5690 0x7fd5f41595d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009e50 tx=0x7fd5ec01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f750c405d46f93 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f27fc640 1 -- 172.21.15.26:0/1686541107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0a5660 con 0x7fd5f40c5690 2024-04-21T08:57:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f27fc640 1 -- 172.21.15.26:0/1686541107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ec0a5800 con 0x7fd5f40c5690 2024-04-21T08:57:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f27fc640 1 -- 172.21.15.26:0/1686541107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0a5bd0 con 0x7fd5f40c5690 2024-04-21T08:57:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- 172.21.15.26:0/1686541107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c5690 msgr2=0x7fd5f41595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/1686541107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c5690 0x7fd5f41595d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec009e50 tx=0x7fd5ec01c8d0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- 172.21.15.26:0/1686541107 shutdown_connections 2024-04-21T08:57:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/1686541107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c5690 0x7fd5f41595d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/1686541107 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f40c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- 172.21.15.26:0/1686541107 >> 172.21.15.26:0/1686541107 conn(0x7fd5f40c8960 msgr2=0x7fd5f40c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- 172.21.15.26:0/1686541107 shutdown_connections 2024-04-21T08:57:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- 172.21.15.26:0/1686541107 wait complete. 2024-04-21T08:57:52.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 Processor -- start 2024-04-21T08:57:52.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- start start 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f414f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c52b0 0x7fd5f41f4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5f40c5690 0x7fd5f41507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f4165870 con 0x7fd5f40c52b0 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd5f41656f0 con 0x7fd5f40c5690 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f92dd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd5f41659f0 con 0x7fd5f4073b50 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c52b0 0x7fd5f41f4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c52b0 0x7fd5f41f4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54268/0 (socket says 172.21.15.26:54268) 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 -- 172.21.15.26:0/83091233 learned_addr learned my addr 172.21.15.26:0/83091233 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f37fe640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5f40c5690 0x7fd5f41507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f2ffd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f414f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 -- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 msgr2=0x7fd5f414f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f414f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 -- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5f40c5690 msgr2=0x7fd5f41507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5f40c5690 0x7fd5f41507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5ebfff640 1 -- 172.21.15.26:0/83091233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5f41f5650 con 0x7fd5f40c52b0 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f37fe640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5f40c5690 0x7fd5f41507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.234+0000 7fd5f2ffd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5ebfff640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c52b0 0x7fd5f41f4bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00c820 tx=0x7fd5dc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5eb7fe640 1 -- 172.21.15.26:0/83091233 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc015070 con 0x7fd5f40c52b0 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5eb7fe640 1 -- 172.21.15.26:0/83091233 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc004240 con 0x7fd5f40c52b0 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5f4155cb0 con 0x7fd5f40c52b0 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5eb7fe640 1 -- 172.21.15.26:0/83091233 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc00ce10 con 0x7fd5f40c52b0 2024-04-21T08:57:52.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5f4156250 con 0x7fd5f40c52b0 2024-04-21T08:57:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5f4075ef0 con 0x7fd5f40c52b0 2024-04-21T08:57:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5eb7fe640 1 -- 172.21.15.26:0/83091233 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd5dc007830 con 0x7fd5f40c52b0 2024-04-21T08:57:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5eb7fe640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd5d4068380 0x7fd5d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5eb7fe640 1 -- 172.21.15.26:0/83091233 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd5dc0868a0 con 0x7fd5f40c52b0 2024-04-21T08:57:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5f2ffd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd5d4068380 0x7fd5d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.238+0000 7fd5f2ffd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd5d4068380 0x7fd5d406a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4003e40 tx=0x7fd5e4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.242+0000 7fd5eb7fe640 1 -- 172.21.15.26:0/83091233 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd5dc056e60 con 0x7fd5f40c52b0 2024-04-21T08:57:52.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.402+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd5f4152240 con 0x7fd5d4068380 2024-04-21T08:57:52.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.418+0000 7fd5eb7fe640 1 -- 172.21.15.26:0/83091233 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252020 (secure 0 0 0) 0x7fd5e4055890 con 0x7fd5d4068380 2024-04-21T08:57:52.423 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:52.424 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T08:57:52.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd5d4068380 msgr2=0x7fd5d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd5d4068380 0x7fd5d406a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4003e40 tx=0x7fd5e4009040 comp rx=0 tx=0).stop 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c52b0 msgr2=0x7fd5f41f4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c52b0 0x7fd5f41f4bf0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc00c820 tx=0x7fd5dc00cce0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 shutdown_connections 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd5f40c5690 0x7fd5f41507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd5d4068380 0x7fd5d406a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd5f40c52b0 0x7fd5f41f4bf0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 --2- 172.21.15.26:0/83091233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd5f4073b50 0x7fd5f414f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 >> 172.21.15.26:0/83091233 conn(0x7fd5f40c8960 msgr2=0x7fd5f414cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 shutdown_connections 2024-04-21T08:57:52.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.422+0000 7fd5f92dd640 1 -- 172.21.15.26:0/83091233 wait complete. 2024-04-21T08:57:52.441 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-04-21T08:57:51.125175+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234600,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740120,"statfs":{"total":773094113280,"available":772853882880,"internally_reserved":0,"allocated":1867776,"data_stored":1773404,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.893865"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478008+0000","last_change":"2024-04-21T08:57:44.312400+0000","last_active":"2024-04-21T08:57:45.478008+0000","last_peered":"2024-04-21T08:57:45.478008+0000","last_clean":"2024-04-21T08:57:45.478008+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T08:57:45.478008+0000","last_undegraded":"2024-04-21T08:57:45.478008+0000","last_fullsized":"2024-04-21T08:57:45.478008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302244+0000","last_change":"2024-04-21T08:57:44.307469+0000","last_active":"2024-04-21T08:57:45.302244+0000","last_peered":"2024-04-21T08:57:45.302244+0000","last_clean":"2024-04-21T08:57:45.302244+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T08:57:45.302244+0000","last_undegraded":"2024-04-21T08:57:45.302244+0000","last_fullsized":"2024-04-21T08:57:45.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301915+0000","last_change":"2024-04-21T08:57:44.283704+0000","last_active":"2024-04-21T08:57:45.301915+0000","last_peered":"2024-04-21T08:57:45.301915+0000","last_clean":"2024-04-21T08:57:45.301915+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T08:57:45.301915+0000","last_undegraded":"2024-04-21T08:57:45.301915+0000","last_fullsized":"2024-04-21T08:57:45.301915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:22:29.477559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474882+0000","last_change":"2024-04-21T08:57:44.297940+0000","last_active":"2024-04-21T08:57:45.474882+0000","last_peered":"2024-04-21T08:57:45.474882+0000","last_clean":"2024-04-21T08:57:45.474882+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T08:57:45.474882+0000","last_undegraded":"2024-04-21T08:57:45.474882+0000","last_fullsized":"2024-04-21T08:57:45.474882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477621+0000","last_change":"2024-04-21T08:57:44.319147+0000","last_active":"2024-04-21T08:57:45.477621+0000","last_peered":"2024-04-21T08:57:45.477621+0000","last_clean":"2024-04-21T08:57:45.477621+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T08:57:45.477621+0000","last_undegraded":"2024-04-21T08:57:45.477621+0000","last_fullsized":"2024-04-21T08:57:45.477621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475406+0000","last_change":"2024-04-21T08:57:44.292228+0000","last_active":"2024-04-21T08:57:45.475406+0000","last_peered":"2024-04-21T08:57:45.475406+0000","last_clean":"2024-04-21T08:57:45.475406+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T08:57:45.475406+0000","last_undegraded":"2024-04-21T08:57:45.475406+0000","last_fullsized":"2024-04-21T08:57:45.475406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476097+0000","last_change":"2024-04-21T08:57:44.307483+0000","last_active":"2024-04-21T08:57:45.476097+0000","last_peered":"2024-04-21T08:57:45.476097+0000","last_clean":"2024-04-21T08:57:45.476097+0000","last_became_active":"2024-04-21T08:57:44.307147+0000","last_became_peered":"2024-04-21T08:57:44.307147+0000","last_unstale":"2024-04-21T08:57:45.476097+0000","last_undegraded":"2024-04-21T08:57:45.476097+0000","last_fullsized":"2024-04-21T08:57:45.476097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301538+0000","last_change":"2024-04-21T08:57:44.316305+0000","last_active":"2024-04-21T08:57:45.301538+0000","last_peered":"2024-04-21T08:57:45.301538+0000","last_clean":"2024-04-21T08:57:45.301538+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T08:57:45.301538+0000","last_undegraded":"2024-04-21T08:57:45.301538+0000","last_fullsized":"2024-04-21T08:57:45.301538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:02.718251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296716+0000","last_change":"2024-04-21T08:57:44.306928+0000","last_active":"2024-04-21T08:57:45.296716+0000","last_peered":"2024-04-21T08:57:45.296716+0000","last_clean":"2024-04-21T08:57:45.296716+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T08:57:45.296716+0000","last_undegraded":"2024-04-21T08:57:45.296716+0000","last_fullsized":"2024-04-21T08:57:45.296716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:47.382588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477106+0000","last_change":"2024-04-21T08:57:44.307925+0000","last_active":"2024-04-21T08:57:45.477106+0000","last_peered":"2024-04-21T08:57:45.477106+0000","last_clean":"2024-04-21T08:57:45.477106+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T08:57:45.477106+0000","last_undegraded":"2024-04-21T08:57:45.477106+0000","last_fullsized":"2024-04-21T08:57:45.477106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475344+0000","last_change":"2024-04-21T08:57:44.312289+0000","last_active":"2024-04-21T08:57:45.475344+0000","last_peered":"2024-04-21T08:57:45.475344+0000","last_clean":"2024-04-21T08:57:45.475344+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T08:57:45.475344+0000","last_undegraded":"2024-04-21T08:57:45.475344+0000","last_fullsized":"2024-04-21T08:57:45.475344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477952+0000","last_change":"2024-04-21T08:57:44.315406+0000","last_active":"2024-04-21T08:57:45.477952+0000","last_peered":"2024-04-21T08:57:45.477952+0000","last_clean":"2024-04-21T08:57:45.477952+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T08:57:45.477952+0000","last_undegraded":"2024-04-21T08:57:45.477952+0000","last_fullsized":"2024-04-21T08:57:45.477952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475316+0000","last_change":"2024-04-21T08:57:44.321357+0000","last_active":"2024-04-21T08:57:45.475316+0000","last_peered":"2024-04-21T08:57:45.475316+0000","last_clean":"2024-04-21T08:57:45.475316+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T08:57:45.475316+0000","last_undegraded":"2024-04-21T08:57:45.475316+0000","last_fullsized":"2024-04-21T08:57:45.475316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:01:59.921966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475445+0000","last_change":"2024-04-21T08:57:44.315428+0000","last_active":"2024-04-21T08:57:45.475445+0000","last_peered":"2024-04-21T08:57:45.475445+0000","last_clean":"2024-04-21T08:57:45.475445+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T08:57:45.475445+0000","last_undegraded":"2024-04-21T08:57:45.475445+0000","last_fullsized":"2024-04-21T08:57:45.475445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301076+0000","last_change":"2024-04-21T08:57:44.285663+0000","last_active":"2024-04-21T08:57:45.301076+0000","last_peered":"2024-04-21T08:57:45.301076+0000","last_clean":"2024-04-21T08:57:45.301076+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T08:57:45.301076+0000","last_undegraded":"2024-04-21T08:57:45.301076+0000","last_fullsized":"2024-04-21T08:57:45.301076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:54:18.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474994+0000","last_change":"2024-04-21T08:57:44.288842+0000","last_active":"2024-04-21T08:57:45.474994+0000","last_peered":"2024-04-21T08:57:45.474994+0000","last_clean":"2024-04-21T08:57:45.474994+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T08:57:45.474994+0000","last_undegraded":"2024-04-21T08:57:45.474994+0000","last_fullsized":"2024-04-21T08:57:45.474994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479022+0000","last_change":"2024-04-21T08:57:44.320371+0000","last_active":"2024-04-21T08:57:45.479022+0000","last_peered":"2024-04-21T08:57:45.479022+0000","last_clean":"2024-04-21T08:57:45.479022+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T08:57:45.479022+0000","last_undegraded":"2024-04-21T08:57:45.479022+0000","last_fullsized":"2024-04-21T08:57:45.479022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:37:23.456724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474849+0000","last_change":"2024-04-21T08:57:44.302161+0000","last_active":"2024-04-21T08:57:45.474849+0000","last_peered":"2024-04-21T08:57:45.474849+0000","last_clean":"2024-04-21T08:57:45.474849+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T08:57:45.474849+0000","last_undegraded":"2024-04-21T08:57:45.474849+0000","last_fullsized":"2024-04-21T08:57:45.474849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478601+0000","last_change":"2024-04-21T08:57:44.289531+0000","last_active":"2024-04-21T08:57:45.478601+0000","last_peered":"2024-04-21T08:57:45.478601+0000","last_clean":"2024-04-21T08:57:45.478601+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T08:57:45.478601+0000","last_undegraded":"2024-04-21T08:57:45.478601+0000","last_fullsized":"2024-04-21T08:57:45.478601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:42:25.869615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477213+0000","last_change":"2024-04-21T08:57:44.315116+0000","last_active":"2024-04-21T08:57:45.477213+0000","last_peered":"2024-04-21T08:57:45.477213+0000","last_clean":"2024-04-21T08:57:45.477213+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T08:57:45.477213+0000","last_undegraded":"2024-04-21T08:57:45.477213+0000","last_fullsized":"2024-04-21T08:57:45.477213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300338+0000","last_change":"2024-04-21T08:57:44.299295+0000","last_active":"2024-04-21T08:57:45.300338+0000","last_peered":"2024-04-21T08:57:45.300338+0000","last_clean":"2024-04-21T08:57:45.300338+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T08:57:45.300338+0000","last_undegraded":"2024-04-21T08:57:45.300338+0000","last_fullsized":"2024-04-21T08:57:45.300338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:32:23.460346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296074+0000","last_change":"2024-04-21T08:57:44.293141+0000","last_active":"2024-04-21T08:57:45.296074+0000","last_peered":"2024-04-21T08:57:45.296074+0000","last_clean":"2024-04-21T08:57:45.296074+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T08:57:45.296074+0000","last_undegraded":"2024-04-21T08:57:45.296074+0000","last_fullsized":"2024-04-21T08:57:45.296074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301628+0000","last_change":"2024-04-21T08:57:44.291347+0000","last_active":"2024-04-21T08:57:45.301628+0000","last_peered":"2024-04-21T08:57:45.301628+0000","last_clean":"2024-04-21T08:57:45.301628+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T08:57:45.301628+0000","last_undegraded":"2024-04-21T08:57:45.301628+0000","last_fullsized":"2024-04-21T08:57:45.301628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:29.349924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475426+0000","last_change":"2024-04-21T08:57:44.283481+0000","last_active":"2024-04-21T08:57:45.475426+0000","last_peered":"2024-04-21T08:57:45.475426+0000","last_clean":"2024-04-21T08:57:45.475426+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T08:57:45.475426+0000","last_undegraded":"2024-04-21T08:57:45.475426+0000","last_fullsized":"2024-04-21T08:57:45.475426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302199+0000","last_change":"2024-04-21T08:57:44.304218+0000","last_active":"2024-04-21T08:57:45.302199+0000","last_peered":"2024-04-21T08:57:45.302199+0000","last_clean":"2024-04-21T08:57:45.302199+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T08:57:45.302199+0000","last_undegraded":"2024-04-21T08:57:45.302199+0000","last_fullsized":"2024-04-21T08:57:45.302199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476814+0000","last_change":"2024-04-21T08:57:44.305569+0000","last_active":"2024-04-21T08:57:45.476814+0000","last_peered":"2024-04-21T08:57:45.476814+0000","last_clean":"2024-04-21T08:57:45.476814+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T08:57:45.476814+0000","last_undegraded":"2024-04-21T08:57:45.476814+0000","last_fullsized":"2024-04-21T08:57:45.476814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476147+0000","last_change":"2024-04-21T08:57:44.314872+0000","last_active":"2024-04-21T08:57:45.476147+0000","last_peered":"2024-04-21T08:57:45.476147+0000","last_clean":"2024-04-21T08:57:45.476147+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T08:57:45.476147+0000","last_undegraded":"2024-04-21T08:57:45.476147+0000","last_fullsized":"2024-04-21T08:57:45.476147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475471+0000","last_change":"2024-04-21T08:57:44.320786+0000","last_active":"2024-04-21T08:57:45.475471+0000","last_peered":"2024-04-21T08:57:45.475471+0000","last_clean":"2024-04-21T08:57:45.475471+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T08:57:45.475471+0000","last_undegraded":"2024-04-21T08:57:45.475471+0000","last_fullsized":"2024-04-21T08:57:45.475471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301360+0000","last_change":"2024-04-21T08:57:44.292576+0000","last_active":"2024-04-21T08:57:45.301360+0000","last_peered":"2024-04-21T08:57:45.301360+0000","last_clean":"2024-04-21T08:57:45.301360+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T08:57:45.301360+0000","last_undegraded":"2024-04-21T08:57:45.301360+0000","last_fullsized":"2024-04-21T08:57:45.301360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:41:15.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476800+0000","last_change":"2024-04-21T08:57:44.301159+0000","last_active":"2024-04-21T08:57:45.476800+0000","last_peered":"2024-04-21T08:57:45.476800+0000","last_clean":"2024-04-21T08:57:45.476800+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T08:57:45.476800+0000","last_undegraded":"2024-04-21T08:57:45.476800+0000","last_fullsized":"2024-04-21T08:57:45.476800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473997+0000","last_change":"2024-04-21T08:57:44.295923+0000","last_active":"2024-04-21T08:57:45.473997+0000","last_peered":"2024-04-21T08:57:45.473997+0000","last_clean":"2024-04-21T08:57:45.473997+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T08:57:45.473997+0000","last_undegraded":"2024-04-21T08:57:45.473997+0000","last_fullsized":"2024-04-21T08:57:45.473997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474254+0000","last_change":"2024-04-21T08:57:44.317457+0000","last_active":"2024-04-21T08:57:45.474254+0000","last_peered":"2024-04-21T08:57:45.474254+0000","last_clean":"2024-04-21T08:57:45.474254+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T08:57:45.474254+0000","last_undegraded":"2024-04-21T08:57:45.474254+0000","last_fullsized":"2024-04-21T08:57:45.474254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:17.843858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296164+0000","last_change":"2024-04-21T08:57:44.293278+0000","last_active":"2024-04-21T08:57:45.296164+0000","last_peered":"2024-04-21T08:57:45.296164+0000","last_clean":"2024-04-21T08:57:45.296164+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T08:57:45.296164+0000","last_undegraded":"2024-04-21T08:57:45.296164+0000","last_fullsized":"2024-04-21T08:57:45.296164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162151+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T08:57:47.162151+0000","last_peered":"2024-04-21T08:57:47.162151+0000","last_clean":"2024-04-21T08:57:47.162151+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T08:57:47.162151+0000","last_undegraded":"2024-04-21T08:57:47.162151+0000","last_fullsized":"2024-04-21T08:57:47.162151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300238+0000","last_change":"2024-04-21T08:57:44.308011+0000","last_active":"2024-04-21T08:57:45.300238+0000","last_peered":"2024-04-21T08:57:45.300238+0000","last_clean":"2024-04-21T08:57:45.300238+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T08:57:45.300238+0000","last_undegraded":"2024-04-21T08:57:45.300238+0000","last_fullsized":"2024-04-21T08:57:45.300238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:45.396672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478237+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T08:57:45.478237+0000","last_peered":"2024-04-21T08:57:45.478237+0000","last_clean":"2024-04-21T08:57:45.478237+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T08:57:45.478237+0000","last_undegraded":"2024-04-21T08:57:45.478237+0000","last_fullsized":"2024-04-21T08:57:45.478237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475213+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T08:57:45.475213+0000","last_peered":"2024-04-21T08:57:45.475213+0000","last_clean":"2024-04-21T08:57:45.475213+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T08:57:45.475213+0000","last_undegraded":"2024-04-21T08:57:45.475213+0000","last_fullsized":"2024-04-21T08:57:45.475213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302334+0000","last_change":"2024-04-21T08:57:44.307616+0000","last_active":"2024-04-21T08:57:45.302334+0000","last_peered":"2024-04-21T08:57:45.302334+0000","last_clean":"2024-04-21T08:57:45.302334+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T08:57:45.302334+0000","last_undegraded":"2024-04-21T08:57:45.302334+0000","last_fullsized":"2024-04-21T08:57:45.302334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475348+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T08:57:45.475348+0000","last_peered":"2024-04-21T08:57:45.475348+0000","last_clean":"2024-04-21T08:57:45.475348+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T08:57:45.475348+0000","last_undegraded":"2024-04-21T08:57:45.475348+0000","last_fullsized":"2024-04-21T08:57:45.475348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300102+0000","last_change":"2024-04-21T08:57:44.285516+0000","last_active":"2024-04-21T08:57:45.300102+0000","last_peered":"2024-04-21T08:57:45.300102+0000","last_clean":"2024-04-21T08:57:45.300102+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T08:57:45.300102+0000","last_undegraded":"2024-04-21T08:57:45.300102+0000","last_fullsized":"2024-04-21T08:57:45.300102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296625+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T08:57:45.296625+0000","last_peered":"2024-04-21T08:57:45.296625+0000","last_clean":"2024-04-21T08:57:45.296625+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T08:57:45.296625+0000","last_undegraded":"2024-04-21T08:57:45.296625+0000","last_fullsized":"2024-04-21T08:57:45.296625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477228+0000","last_change":"2024-04-21T08:57:44.305837+0000","last_active":"2024-04-21T08:57:45.477228+0000","last_peered":"2024-04-21T08:57:45.477228+0000","last_clean":"2024-04-21T08:57:45.477228+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T08:57:45.477228+0000","last_undegraded":"2024-04-21T08:57:45.477228+0000","last_fullsized":"2024-04-21T08:57:45.477228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477323+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T08:57:45.477323+0000","last_peered":"2024-04-21T08:57:45.477323+0000","last_clean":"2024-04-21T08:57:45.477323+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T08:57:45.477323+0000","last_undegraded":"2024-04-21T08:57:45.477323+0000","last_fullsized":"2024-04-21T08:57:45.477323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302616+0000","last_change":"2024-04-21T08:57:44.305156+0000","last_active":"2024-04-21T08:57:45.302616+0000","last_peered":"2024-04-21T08:57:45.302616+0000","last_clean":"2024-04-21T08:57:45.302616+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T08:57:45.302616+0000","last_undegraded":"2024-04-21T08:57:45.302616+0000","last_fullsized":"2024-04-21T08:57:45.302616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.320749+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T08:57:49.320749+0000","last_peered":"2024-04-21T08:57:49.320749+0000","last_clean":"2024-04-21T08:57:49.320749+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T08:57:49.320749+0000","last_undegraded":"2024-04-21T08:57:49.320749+0000","last_fullsized":"2024-04-21T08:57:49.320749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476386+0000","last_change":"2024-04-21T08:57:44.296804+0000","last_active":"2024-04-21T08:57:45.476386+0000","last_peered":"2024-04-21T08:57:45.476386+0000","last_clean":"2024-04-21T08:57:45.476386+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T08:57:45.476386+0000","last_undegraded":"2024-04-21T08:57:45.476386+0000","last_fullsized":"2024-04-21T08:57:45.476386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319718+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T08:57:49.319718+0000","last_peered":"2024-04-21T08:57:49.319718+0000","last_clean":"2024-04-21T08:57:49.319718+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T08:57:49.319718+0000","last_undegraded":"2024-04-21T08:57:49.319718+0000","last_fullsized":"2024-04-21T08:57:49.319718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475742+0000","last_change":"2024-04-21T08:57:44.323678+0000","last_active":"2024-04-21T08:57:45.475742+0000","last_peered":"2024-04-21T08:57:45.475742+0000","last_clean":"2024-04-21T08:57:45.475742+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T08:57:45.475742+0000","last_undegraded":"2024-04-21T08:57:45.475742+0000","last_fullsized":"2024-04-21T08:57:45.475742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318895+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T08:57:49.318895+0000","last_peered":"2024-04-21T08:57:49.318895+0000","last_clean":"2024-04-21T08:57:49.318895+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T08:57:49.318895+0000","last_undegraded":"2024-04-21T08:57:49.318895+0000","last_fullsized":"2024-04-21T08:57:49.318895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475320+0000","last_change":"2024-04-21T08:57:44.310092+0000","last_active":"2024-04-21T08:57:45.475320+0000","last_peered":"2024-04-21T08:57:45.475320+0000","last_clean":"2024-04-21T08:57:45.475320+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T08:57:45.475320+0000","last_undegraded":"2024-04-21T08:57:45.475320+0000","last_fullsized":"2024-04-21T08:57:45.475320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:03.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478308+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T08:57:45.478308+0000","last_peered":"2024-04-21T08:57:45.478308+0000","last_clean":"2024-04-21T08:57:45.478308+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T08:57:45.478308+0000","last_undegraded":"2024-04-21T08:57:45.478308+0000","last_fullsized":"2024-04-21T08:57:45.478308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477225+0000","last_change":"2024-04-21T08:57:44.320598+0000","last_active":"2024-04-21T08:57:45.477225+0000","last_peered":"2024-04-21T08:57:45.477225+0000","last_clean":"2024-04-21T08:57:45.477225+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T08:57:45.477225+0000","last_undegraded":"2024-04-21T08:57:45.477225+0000","last_fullsized":"2024-04-21T08:57:45.477225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:51.743927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476234+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T08:57:45.476234+0000","last_peered":"2024-04-21T08:57:45.476234+0000","last_clean":"2024-04-21T08:57:45.476234+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T08:57:45.476234+0000","last_undegraded":"2024-04-21T08:57:45.476234+0000","last_fullsized":"2024-04-21T08:57:45.476234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295791+0000","last_change":"2024-04-21T08:57:44.292658+0000","last_active":"2024-04-21T08:57:45.295791+0000","last_peered":"2024-04-21T08:57:45.295791+0000","last_clean":"2024-04-21T08:57:45.295791+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T08:57:45.295791+0000","last_undegraded":"2024-04-21T08:57:45.295791+0000","last_fullsized":"2024-04-21T08:57:45.295791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.321102+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T08:57:49.321102+0000","last_peered":"2024-04-21T08:57:49.321102+0000","last_clean":"2024-04-21T08:57:49.321102+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T08:57:49.321102+0000","last_undegraded":"2024-04-21T08:57:49.321102+0000","last_fullsized":"2024-04-21T08:57:49.321102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475925+0000","last_change":"2024-04-21T08:57:44.289358+0000","last_active":"2024-04-21T08:57:45.475925+0000","last_peered":"2024-04-21T08:57:45.475925+0000","last_clean":"2024-04-21T08:57:45.475925+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T08:57:45.475925+0000","last_undegraded":"2024-04-21T08:57:45.475925+0000","last_fullsized":"2024-04-21T08:57:45.475925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478220+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T08:57:45.478220+0000","last_peered":"2024-04-21T08:57:45.478220+0000","last_clean":"2024-04-21T08:57:45.478220+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T08:57:45.478220+0000","last_undegraded":"2024-04-21T08:57:45.478220+0000","last_fullsized":"2024-04-21T08:57:45.478220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477620+0000","last_change":"2024-04-21T08:57:44.321062+0000","last_active":"2024-04-21T08:57:45.477620+0000","last_peered":"2024-04-21T08:57:45.477620+0000","last_clean":"2024-04-21T08:57:45.477620+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T08:57:45.477620+0000","last_undegraded":"2024-04-21T08:57:45.477620+0000","last_fullsized":"2024-04-21T08:57:45.477620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318978+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T08:57:49.318978+0000","last_peered":"2024-04-21T08:57:49.318978+0000","last_clean":"2024-04-21T08:57:49.318978+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T08:57:49.318978+0000","last_undegraded":"2024-04-21T08:57:49.318978+0000","last_fullsized":"2024-04-21T08:57:49.318978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477974+0000","last_change":"2024-04-21T08:57:44.315764+0000","last_active":"2024-04-21T08:57:45.477974+0000","last_peered":"2024-04-21T08:57:45.477974+0000","last_clean":"2024-04-21T08:57:45.477974+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T08:57:45.477974+0000","last_undegraded":"2024-04-21T08:57:45.477974+0000","last_fullsized":"2024-04-21T08:57:45.477974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162213+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T08:57:47.162213+0000","last_peered":"2024-04-21T08:57:47.162213+0000","last_clean":"2024-04-21T08:57:47.162213+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T08:57:47.162213+0000","last_undegraded":"2024-04-21T08:57:47.162213+0000","last_fullsized":"2024-04-21T08:57:47.162213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477623+0000","last_change":"2024-04-21T08:57:44.315316+0000","last_active":"2024-04-21T08:57:45.477623+0000","last_peered":"2024-04-21T08:57:45.477623+0000","last_clean":"2024-04-21T08:57:45.477623+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T08:57:45.477623+0000","last_undegraded":"2024-04-21T08:57:45.477623+0000","last_fullsized":"2024-04-21T08:57:45.477623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475756+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T08:57:45.475756+0000","last_peered":"2024-04-21T08:57:45.475756+0000","last_clean":"2024-04-21T08:57:45.475756+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T08:57:45.475756+0000","last_undegraded":"2024-04-21T08:57:45.475756+0000","last_fullsized":"2024-04-21T08:57:45.475756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478318+0000","last_change":"2024-04-21T08:57:44.298472+0000","last_active":"2024-04-21T08:57:45.478318+0000","last_peered":"2024-04-21T08:57:45.478318+0000","last_clean":"2024-04-21T08:57:45.478318+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T08:57:45.478318+0000","last_undegraded":"2024-04-21T08:57:45.478318+0000","last_fullsized":"2024-04-21T08:57:45.478318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:14:06.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295542+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T08:57:45.295542+0000","last_peered":"2024-04-21T08:57:45.295542+0000","last_clean":"2024-04-21T08:57:45.295542+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T08:57:45.295542+0000","last_undegraded":"2024-04-21T08:57:45.295542+0000","last_fullsized":"2024-04-21T08:57:45.295542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477601+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T08:57:45.477601+0000","last_peered":"2024-04-21T08:57:45.477601+0000","last_clean":"2024-04-21T08:57:45.477601+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T08:57:45.477601+0000","last_undegraded":"2024-04-21T08:57:45.477601+0000","last_fullsized":"2024-04-21T08:57:45.477601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300093+0000","last_change":"2024-04-21T08:57:44.289877+0000","last_active":"2024-04-21T08:57:45.300093+0000","last_peered":"2024-04-21T08:57:45.300093+0000","last_clean":"2024-04-21T08:57:45.300093+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T08:57:45.300093+0000","last_undegraded":"2024-04-21T08:57:45.300093+0000","last_fullsized":"2024-04-21T08:57:45.300093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475561+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T08:57:45.475561+0000","last_peered":"2024-04-21T08:57:45.475561+0000","last_clean":"2024-04-21T08:57:45.475561+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T08:57:45.475561+0000","last_undegraded":"2024-04-21T08:57:45.475561+0000","last_fullsized":"2024-04-21T08:57:45.475561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474956+0000","last_change":"2024-04-21T08:57:44.309539+0000","last_active":"2024-04-21T08:57:45.474956+0000","last_peered":"2024-04-21T08:57:45.474956+0000","last_clean":"2024-04-21T08:57:45.474956+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T08:57:45.474956+0000","last_undegraded":"2024-04-21T08:57:45.474956+0000","last_fullsized":"2024-04-21T08:57:45.474956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:47:34.419511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473930+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T08:57:45.473930+0000","last_peered":"2024-04-21T08:57:45.473930+0000","last_clean":"2024-04-21T08:57:45.473930+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T08:57:45.473930+0000","last_undegraded":"2024-04-21T08:57:45.473930+0000","last_fullsized":"2024-04-21T08:57:45.473930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301947+0000","last_change":"2024-04-21T08:57:44.298533+0000","last_active":"2024-04-21T08:57:45.301947+0000","last_peered":"2024-04-21T08:57:45.301947+0000","last_clean":"2024-04-21T08:57:45.301947+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T08:57:45.301947+0000","last_undegraded":"2024-04-21T08:57:45.301947+0000","last_fullsized":"2024-04-21T08:57:45.301947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478433+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T08:57:45.478433+0000","last_peered":"2024-04-21T08:57:45.478433+0000","last_clean":"2024-04-21T08:57:45.478433+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T08:57:45.478433+0000","last_undegraded":"2024-04-21T08:57:45.478433+0000","last_fullsized":"2024-04-21T08:57:45.478433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477998+0000","last_change":"2024-04-21T08:57:44.315633+0000","last_active":"2024-04-21T08:57:45.477998+0000","last_peered":"2024-04-21T08:57:45.477998+0000","last_clean":"2024-04-21T08:57:45.477998+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T08:57:45.477998+0000","last_undegraded":"2024-04-21T08:57:45.477998+0000","last_fullsized":"2024-04-21T08:57:45.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301760+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T08:57:45.301760+0000","last_peered":"2024-04-21T08:57:45.301760+0000","last_clean":"2024-04-21T08:57:45.301760+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T08:57:45.301760+0000","last_undegraded":"2024-04-21T08:57:45.301760+0000","last_fullsized":"2024-04-21T08:57:45.301760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475775+0000","last_change":"2024-04-21T08:57:44.318478+0000","last_active":"2024-04-21T08:57:45.475775+0000","last_peered":"2024-04-21T08:57:45.475775+0000","last_clean":"2024-04-21T08:57:45.475775+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T08:57:45.475775+0000","last_undegraded":"2024-04-21T08:57:45.475775+0000","last_fullsized":"2024-04-21T08:57:45.475775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478561+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T08:57:45.478561+0000","last_peered":"2024-04-21T08:57:45.478561+0000","last_clean":"2024-04-21T08:57:45.478561+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T08:57:45.478561+0000","last_undegraded":"2024-04-21T08:57:45.478561+0000","last_fullsized":"2024-04-21T08:57:45.478561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475343+0000","last_change":"2024-04-21T08:57:44.305172+0000","last_active":"2024-04-21T08:57:45.475343+0000","last_peered":"2024-04-21T08:57:45.475343+0000","last_clean":"2024-04-21T08:57:45.475343+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T08:57:45.475343+0000","last_undegraded":"2024-04-21T08:57:45.475343+0000","last_fullsized":"2024-04-21T08:57:45.475343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:13:46.282333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301089+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T08:57:45.301089+0000","last_peered":"2024-04-21T08:57:45.301089+0000","last_clean":"2024-04-21T08:57:45.301089+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T08:57:45.301089+0000","last_undegraded":"2024-04-21T08:57:45.301089+0000","last_fullsized":"2024-04-21T08:57:45.301089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300739+0000","last_change":"2024-04-21T08:57:44.311283+0000","last_active":"2024-04-21T08:57:45.300739+0000","last_peered":"2024-04-21T08:57:45.300739+0000","last_clean":"2024-04-21T08:57:45.300739+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T08:57:45.300739+0000","last_undegraded":"2024-04-21T08:57:45.300739+0000","last_fullsized":"2024-04-21T08:57:45.300739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:06:14.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.316902+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T08:57:49.316902+0000","last_peered":"2024-04-21T08:57:49.316902+0000","last_clean":"2024-04-21T08:57:49.316902+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T08:57:49.316902+0000","last_undegraded":"2024-04-21T08:57:49.316902+0000","last_fullsized":"2024-04-21T08:57:49.316902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300568+0000","last_change":"2024-04-21T08:57:44.293449+0000","last_active":"2024-04-21T08:57:45.300568+0000","last_peered":"2024-04-21T08:57:45.300568+0000","last_clean":"2024-04-21T08:57:45.300568+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T08:57:45.300568+0000","last_undegraded":"2024-04-21T08:57:45.300568+0000","last_fullsized":"2024-04-21T08:57:45.300568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:13:04.768707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474913+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T08:57:45.474913+0000","last_peered":"2024-04-21T08:57:45.474913+0000","last_clean":"2024-04-21T08:57:45.474913+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T08:57:45.474913+0000","last_undegraded":"2024-04-21T08:57:45.474913+0000","last_fullsized":"2024-04-21T08:57:45.474913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476103+0000","last_change":"2024-04-21T08:57:44.294831+0000","last_active":"2024-04-21T08:57:45.476103+0000","last_peered":"2024-04-21T08:57:45.476103+0000","last_clean":"2024-04-21T08:57:45.476103+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T08:57:45.476103+0000","last_undegraded":"2024-04-21T08:57:45.476103+0000","last_fullsized":"2024-04-21T08:57:45.476103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300649+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T08:57:45.300649+0000","last_peered":"2024-04-21T08:57:45.300649+0000","last_clean":"2024-04-21T08:57:45.300649+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T08:57:45.300649+0000","last_undegraded":"2024-04-21T08:57:45.300649+0000","last_fullsized":"2024-04-21T08:57:45.300649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.299620+0000","last_change":"2024-04-21T08:57:44.299090+0000","last_active":"2024-04-21T08:57:45.299620+0000","last_peered":"2024-04-21T08:57:45.299620+0000","last_clean":"2024-04-21T08:57:45.299620+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T08:57:45.299620+0000","last_undegraded":"2024-04-21T08:57:45.299620+0000","last_fullsized":"2024-04-21T08:57:45.299620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475613+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T08:57:45.475613+0000","last_peered":"2024-04-21T08:57:45.475613+0000","last_clean":"2024-04-21T08:57:45.475613+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T08:57:45.475613+0000","last_undegraded":"2024-04-21T08:57:45.475613+0000","last_fullsized":"2024-04-21T08:57:45.475613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474385+0000","last_change":"2024-04-21T08:57:44.317697+0000","last_active":"2024-04-21T08:57:45.474385+0000","last_peered":"2024-04-21T08:57:45.474385+0000","last_clean":"2024-04-21T08:57:45.474385+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T08:57:45.474385+0000","last_undegraded":"2024-04-21T08:57:45.474385+0000","last_fullsized":"2024-04-21T08:57:45.474385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.317492+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T08:57:49.317492+0000","last_peered":"2024-04-21T08:57:49.317492+0000","last_clean":"2024-04-21T08:57:49.317492+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T08:57:49.317492+0000","last_undegraded":"2024-04-21T08:57:49.317492+0000","last_fullsized":"2024-04-21T08:57:49.317492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478072+0000","last_change":"2024-04-21T08:57:44.300498+0000","last_active":"2024-04-21T08:57:45.478072+0000","last_peered":"2024-04-21T08:57:45.478072+0000","last_clean":"2024-04-21T08:57:45.478072+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T08:57:45.478072+0000","last_undegraded":"2024-04-21T08:57:45.478072+0000","last_fullsized":"2024-04-21T08:57:45.478072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:36:51.242004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478121+0000","last_change":"2024-04-21T08:57:44.321085+0000","last_active":"2024-04-21T08:57:45.478121+0000","last_peered":"2024-04-21T08:57:45.478121+0000","last_clean":"2024-04-21T08:57:45.478121+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T08:57:45.478121+0000","last_undegraded":"2024-04-21T08:57:45.478121+0000","last_fullsized":"2024-04-21T08:57:45.478121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:49.754472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.313140+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T08:57:49.313140+0000","last_peered":"2024-04-21T08:57:49.313140+0000","last_clean":"2024-04-21T08:57:49.313140+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T08:57:49.313140+0000","last_undegraded":"2024-04-21T08:57:49.313140+0000","last_fullsized":"2024-04-21T08:57:49.313140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296663+0000","last_change":"2024-04-21T08:57:44.315810+0000","last_active":"2024-04-21T08:57:45.296663+0000","last_peered":"2024-04-21T08:57:45.296663+0000","last_clean":"2024-04-21T08:57:45.296663+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T08:57:45.296663+0000","last_undegraded":"2024-04-21T08:57:45.296663+0000","last_fullsized":"2024-04-21T08:57:45.296663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.311969+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T08:57:49.311969+0000","last_peered":"2024-04-21T08:57:49.311969+0000","last_clean":"2024-04-21T08:57:49.311969+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T08:57:49.311969+0000","last_undegraded":"2024-04-21T08:57:49.311969+0000","last_fullsized":"2024-04-21T08:57:49.311969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302388+0000","last_change":"2024-04-21T08:57:44.303912+0000","last_active":"2024-04-21T08:57:45.302388+0000","last_peered":"2024-04-21T08:57:45.302388+0000","last_clean":"2024-04-21T08:57:45.302388+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T08:57:45.302388+0000","last_undegraded":"2024-04-21T08:57:45.302388+0000","last_fullsized":"2024-04-21T08:57:45.302388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162279+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T08:57:47.162279+0000","last_peered":"2024-04-21T08:57:47.162279+0000","last_clean":"2024-04-21T08:57:47.162279+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T08:57:47.162279+0000","last_undegraded":"2024-04-21T08:57:47.162279+0000","last_fullsized":"2024-04-21T08:57:47.162279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302272+0000","last_change":"2024-04-21T08:57:44.301951+0000","last_active":"2024-04-21T08:57:45.302272+0000","last_peered":"2024-04-21T08:57:45.302272+0000","last_clean":"2024-04-21T08:57:45.302272+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T08:57:45.302272+0000","last_undegraded":"2024-04-21T08:57:45.302272+0000","last_fullsized":"2024-04-21T08:57:45.302272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319970+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T08:57:49.319970+0000","last_peered":"2024-04-21T08:57:49.319970+0000","last_clean":"2024-04-21T08:57:49.319970+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T08:57:49.319970+0000","last_undegraded":"2024-04-21T08:57:49.319970+0000","last_fullsized":"2024-04-21T08:57:49.319970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":212992,"data_stored":74063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":75093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":663919,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":217088,"data_stored":73537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542148,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":663941,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":75765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T08:57:52.445 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-21T08:57:52.445 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-21T08:57:52.445 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-21T08:57:52.445 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-21T08:57:52.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.594+0000 7feb151e8640 1 Processor -- start 2024-04-21T08:57:52.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.594+0000 7feb151e8640 1 -- start start 2024-04-21T08:57:52.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb151e8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb10154c70 0x7feb1015b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb151e8640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7feb1006b9e0 0x7feb100c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb151e8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb1015bb60 con 0x7feb1006be50 2024-04-21T08:57:52.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb151e8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7feb10155050 con 0x7feb10154c70 2024-04-21T08:57:52.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb151e8640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7feb100c75b0 con 0x7feb1006b9e0 2024-04-21T08:57:52.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb0ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb10154c70 0x7feb1015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb0ed9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb10154c70 0x7feb1015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54274/0 (socket says 172.21.15.26:54274) 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb0ed9d640 1 -- 172.21.15.26:0/1135394893 learned_addr learned my addr 172.21.15.26:0/1135394893 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb07fff640 1 --2- 172.21.15.26:0/1135394893 >> v2:172.21.15.169:3300/0 conn(0x7feb1006b9e0 0x7feb100c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb0ed9d640 1 -- 172.21.15.26:0/1135394893 >> v2:172.21.15.169:3300/0 conn(0x7feb1006b9e0 msgr2=0x7feb100c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb0ed9d640 1 --2- 172.21.15.26:0/1135394893 >> v2:172.21.15.169:3300/0 conn(0x7feb1006b9e0 0x7feb100c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb0ed9d640 1 -- 172.21.15.26:0/1135394893 >> v1:172.21.15.169:6789/0 conn(0x7feb1006be50 legacy=0x7feb100c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb0ed9d640 1 -- 172.21.15.26:0/1135394893 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100c7890 con 0x7feb10154c70 2024-04-21T08:57:52.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.598+0000 7feb07fff640 1 --2- 172.21.15.26:0/1135394893 >> v2:172.21.15.169:3300/0 conn(0x7feb1006b9e0 0x7feb100c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:52.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb0ed9d640 1 --2- 172.21.15.26:0/1135394893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb10154c70 0x7feb1015b620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009870 tx=0x7feaf801c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175e331b75623212 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb0e59c640 1 -- 172.21.15.26:0/1135394893 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80b0070 con 0x7feb10154c70 2024-04-21T08:57:52.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb0e59c640 1 -- 172.21.15.26:0/1135394893 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaf80ab600 con 0x7feb10154c70 2024-04-21T08:57:52.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb0e59c640 1 -- 172.21.15.26:0/1135394893 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaf80ab9d0 con 0x7feb10154c70 2024-04-21T08:57:52.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- 172.21.15.26:0/1135394893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb10154c70 msgr2=0x7feb1015b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 --2- 172.21.15.26:0/1135394893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb10154c70 0x7feb1015b620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feaf8009870 tx=0x7feaf801c2d0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- 172.21.15.26:0/1135394893 shutdown_connections 2024-04-21T08:57:52.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 --2- 172.21.15.26:0/1135394893 >> v2:172.21.15.169:3300/0 conn(0x7feb1006b9e0 0x7feb100c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 --2- 172.21.15.26:0/1135394893 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb10154c70 0x7feb1015b620 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- 172.21.15.26:0/1135394893 >> 172.21.15.26:0/1135394893 conn(0x7feb100702c0 msgr2=0x7feb100cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- 172.21.15.26:0/1135394893 shutdown_connections 2024-04-21T08:57:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- 172.21.15.26:0/1135394893 wait complete. 2024-04-21T08:57:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 Processor -- start 2024-04-21T08:57:52.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- start start 2024-04-21T08:57:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb1006b9e0 0x7feb10159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb1006be50 0x7feb10149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb10154c70 0x7feb101f6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feb100c71b0 con 0x7feb1006be50 2024-04-21T08:57:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7feb10072d80 con 0x7feb10154c70 2024-04-21T08:57:52.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb151e8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7feb100c7330 con 0x7feb1006b9e0 2024-04-21T08:57:52.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb07fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb1006be50 0x7feb10149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb07fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb1006be50 0x7feb10149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54276/0 (socket says 172.21.15.26:54276) 2024-04-21T08:57:52.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb0ed9d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb1006b9e0 0x7feb10159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb07fff640 1 -- 172.21.15.26:0/3076591662 learned_addr learned my addr 172.21.15.26:0/3076591662 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:52.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.602+0000 7feb0f59e640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb10154c70 0x7feb101f6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb07fff640 1 -- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb1006b9e0 msgr2=0x7feb10159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb07fff640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb1006b9e0 0x7feb10159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb07fff640 1 -- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb10154c70 msgr2=0x7feb101f6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb07fff640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb10154c70 0x7feb101f6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb07fff640 1 -- 172.21.15.26:0/3076591662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb100c86d0 con 0x7feb1006be50 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb07fff640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb1006be50 0x7feb10149040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb0000c7f0 tx=0x7feb0000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb077fe640 1 -- 172.21.15.26:0/3076591662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00015070 con 0x7feb1006be50 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb077fe640 1 -- 172.21.15.26:0/3076591662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb00007820 con 0x7feb1006be50 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb1014add0 con 0x7feb1006be50 2024-04-21T08:57:52.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb077fe640 1 -- 172.21.15.26:0/3076591662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb00007c10 con 0x7feb1006be50 2024-04-21T08:57:52.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb1014b390 con 0x7feb1006be50 2024-04-21T08:57:52.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb1014bab0 con 0x7feb1006be50 2024-04-21T08:57:52.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb077fe640 1 -- 172.21.15.26:0/3076591662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb00018070 con 0x7feb1006be50 2024-04-21T08:57:52.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb077fe640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7feaf0068380 0x7feaf006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb077fe640 1 -- 172.21.15.26:0/3076591662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7feb00086a00 con 0x7feb1006be50 2024-04-21T08:57:52.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb0ed9d640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7feaf0068380 0x7feaf006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.606+0000 7feb0ed9d640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7feaf0068380 0x7feaf006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feaf80ad000 tx=0x7feaf80a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.610+0000 7feb077fe640 1 -- 172.21.15.26:0/3076591662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb100c86d0 con 0x7feb1006be50 2024-04-21T08:57:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.798+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feb100c82f0 con 0x7feb1006be50 2024-04-21T08:57:52.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb077fe640 1 -- 172.21.15.26:0/3076591662 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7feb00056970 con 0x7feb1006be50 2024-04-21T08:57:52.803 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:52.803 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-21T08:57:52.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7feaf0068380 msgr2=0x7feaf006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7feaf0068380 0x7feaf006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feaf80ad000 tx=0x7feaf80a6000 comp rx=0 tx=0).stop 2024-04-21T08:57:52.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb1006be50 msgr2=0x7feb10149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb1006be50 0x7feb10149040 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feb0000c7f0 tx=0x7feb0000ccb0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 shutdown_connections 2024-04-21T08:57:52.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb10154c70 0x7feb101f6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7feaf0068380 0x7feaf006a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb1006be50 0x7feb10149040 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 --2- 172.21.15.26:0/3076591662 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb1006b9e0 0x7feb10159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 >> 172.21.15.26:0/3076591662 conn(0x7feb100702c0 msgr2=0x7feb10152eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 shutdown_connections 2024-04-21T08:57:52.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.802+0000 7feb151e8640 1 -- 172.21.15.26:0/3076591662 wait complete. 2024-04-21T08:57:52.820 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-21T08:57:52.820 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7f4b0f640 1 Processor -- start 2024-04-21T08:57:52.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7f4b0f640 1 -- start start 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7f4b0f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7f00c6260 0x7fb7f00c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7f4b0f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c5bc0 0x7fb7f00c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7f4b0f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f00c96e0 con 0x7fb7f0154e90 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7f4b0f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f00c9980 con 0x7fb7f00c6260 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7f4b0f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f00c6050 con 0x7fb7f00c5bc0 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7ee59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb7f0154e90 0x7fb7f00c67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42446/0 (socket says 172.21.15.26:42446) 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7edd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7f00c6260 0x7fb7f00c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7ee59c640 1 -- 172.21.15.26:0/3647515865 learned_addr learned my addr 172.21.15.26:0/3647515865 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7eed9d640 1 --2- 172.21.15.26:0/3647515865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c5bc0 0x7fb7f00c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7ed59a640 1 -- 172.21.15.26:0/3647515865 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343372244 0 0) 0x7fb7f00c96e0 con 0x7fb7f0154e90 2024-04-21T08:57:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7ed59a640 1 -- 172.21.15.26:0/3647515865 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7d8003530 con 0x7fb7f0154e90 2024-04-21T08:57:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7edd9b640 1 -- 172.21.15.26:0/3647515865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c5bc0 msgr2=0x7fb7f00c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7edd9b640 1 --2- 172.21.15.26:0/3647515865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c5bc0 0x7fb7f00c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7edd9b640 1 -- 172.21.15.26:0/3647515865 >> v1:172.21.15.26:6789/0 conn(0x7fb7f0154e90 legacy=0x7fb7f00c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.938+0000 7fb7edd9b640 1 -- 172.21.15.26:0/3647515865 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f015b7b0 con 0x7fb7f00c6260 2024-04-21T08:57:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7edd9b640 1 --2- 172.21.15.26:0/3647515865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f00c6260 0x7fb7f00c7910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40097c0 tx=0x7fb7e401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcb7a9f30943498 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7ed59a640 1 -- 172.21.15.26:0/3647515865 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40a7070 con 0x7fb7f00c6260 2024-04-21T08:57:52.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7ed59a640 1 -- 172.21.15.26:0/3647515865 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e40b0070 con 0x7fb7f00c6260 2024-04-21T08:57:52.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7ed59a640 1 -- 172.21.15.26:0/3647515865 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40ab890 con 0x7fb7f00c6260 2024-04-21T08:57:52.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/3647515865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f00c6260 msgr2=0x7fb7f00c7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/3647515865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f00c6260 0x7fb7f00c7910 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40097c0 tx=0x7fb7e401c470 comp rx=0 tx=0).stop 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/3647515865 shutdown_connections 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/3647515865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c5bc0 0x7fb7f00c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/3647515865 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f00c6260 0x7fb7f00c7910 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/3647515865 >> 172.21.15.26:0/3647515865 conn(0x7fb7f00725c0 msgr2=0x7fb7f00729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/3647515865 shutdown_connections 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/3647515865 wait complete. 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 Processor -- start 2024-04-21T08:57:52.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- start start 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7f00c5bc0 0x7fb7f01ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c6260 0x7fb7f014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f0154e90 0x7fb7f0159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00c7400 con 0x7fb7f0154e90 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f00c56a0 con 0x7fb7f00c5bc0 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f0155270 con 0x7fb7f00c6260 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f0154e90 0x7fb7f0159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f0154e90 0x7fb7f0159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54280/0 (socket says 172.21.15.26:54280) 2024-04-21T08:57:52.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 -- 172.21.15.26:0/2045841455 learned_addr learned my addr 172.21.15.26:0/2045841455 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 -- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c6260 msgr2=0x7fb7f014c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7edd9b640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c6260 0x7fb7f014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c6260 0x7fb7f014c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 -- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7f00c5bc0 msgr2=0x7fb7f01ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7f00c5bc0 0x7fb7f01ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 -- 172.21.15.26:0/2045841455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f014d870 con 0x7fb7f0154e90 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7eed9d640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f0154e90 0x7fb7f0159710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8007e60 tx=0x7fb7e800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7deffd640 1 -- 172.21.15.26:0/2045841455 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8014420 con 0x7fb7f0154e90 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7deffd640 1 -- 172.21.15.26:0/2045841455 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8019070 con 0x7fb7f0154e90 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f014db30 con 0x7fb7f0154e90 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7deffd640 1 -- 172.21.15.26:0/2045841455 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8014820 con 0x7fb7f0154e90 2024-04-21T08:57:52.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.942+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f0158950 con 0x7fb7f0154e90 2024-04-21T08:57:52.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.946+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f0075ef0 con 0x7fb7f0154e90 2024-04-21T08:57:52.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.946+0000 7fb7deffd640 1 -- 172.21.15.26:0/2045841455 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb7e80149c0 con 0x7fb7f0154e90 2024-04-21T08:57:52.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.946+0000 7fb7deffd640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb7d00683b0 0x7fb7d006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:52.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.946+0000 7fb7deffd640 1 -- 172.21.15.26:0/2045841455 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb7e8087130 con 0x7fb7f0154e90 2024-04-21T08:57:52.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.946+0000 7fb7ee59c640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb7d00683b0 0x7fb7d006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:52.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.946+0000 7fb7ee59c640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb7d00683b0 0x7fb7d006a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0007fd0 tx=0x7fb7e0007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:52.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:52.950+0000 7fb7deffd640 1 -- 172.21.15.26:0/2045841455 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb7e8057780 con 0x7fb7f0154e90 2024-04-21T08:57:53.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.106+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb7f00c4df0 con 0x7fb7f0154e90 2024-04-21T08:57:53.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.106+0000 7fb7deffd640 1 -- 172.21.15.26:0/2045841455 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7fb7e8057080 con 0x7fb7f0154e90 2024-04-21T08:57:53.110 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:53.110 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:53.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb7d00683b0 msgr2=0x7fb7d006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb7d00683b0 0x7fb7d006a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0007fd0 tx=0x7fb7e0007900 comp rx=0 tx=0).stop 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f0154e90 msgr2=0x7fb7f0159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f0154e90 0x7fb7f0159710 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb7e8007e60 tx=0x7fb7e800e4b0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 shutdown_connections 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb7d00683b0 0x7fb7d006a870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7f0154e90 0x7fb7f0159710 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb7f00c6260 0x7fb7f014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 --2- 172.21.15.26:0/2045841455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb7f00c5bc0 0x7fb7f01ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 >> 172.21.15.26:0/2045841455 conn(0x7fb7f00725c0 msgr2=0x7fb7f00c7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 shutdown_connections 2024-04-21T08:57:53.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.110+0000 7fb7f4b0f640 1 -- 172.21.15.26:0/2045841455 wait complete. 2024-04-21T08:57:53.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T08:57:53.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T08:57:53.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.238+0000 7f4dc75c0640 1 Processor -- start 2024-04-21T08:57:53.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.238+0000 7f4dc75c0640 1 -- start start 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc75c0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 0x7f4dc006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc75c0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc00c3180 con 0x7f4dc0157940 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc75c0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dc00c3420 con 0x7f4dc0151c10 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc75c0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc00c6020 con 0x7f4dc006caf0 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc5b5d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4dc0157940 0x7f4dc0162260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42450/0 (socket says 172.21.15.26:42450) 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc5b5d640 1 -- 172.21.15.26:0/39968779 learned_addr learned my addr 172.21.15.26:0/39968779 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 0x7f4dc006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2691524062 0 0) 0x7f4dc00c3180 con 0x7f4dc0157940 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4dac003530 con 0x7f4dc0157940 2024-04-21T08:57:53.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2405015656 0 0) 0x7f4dac003530 con 0x7f4dc0157940 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 msgr2=0x7f4dc006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 0x7f4dc006cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 >> v1:172.21.15.169:6789/0 conn(0x7f4dc0151c10 legacy=0x7f4dc00c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc00c3700 con 0x7f4dc0157940 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f4db8001a20 con 0x7f4dc0157940 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 >> v1:172.21.15.26:6789/0 conn(0x7f4dc0157940 legacy=0x7f4dc0162260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac0039f0 0x7f4dac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac004810 0x7f4dac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 0x7f4dac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc00c6020 con 0x7f4dac004810 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4dac00bb70 con 0x7f4dac0039f0 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac00bd70 con 0x7f4dc006caf0 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac004810 0x7f4dac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc535c640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac0039f0 0x7f4dac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc5b5d640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 0x7f4dac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc4b5b640 1 -- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 msgr2=0x7f4dac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 0x7f4dac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc4b5b640 1 -- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac0039f0 msgr2=0x7f4dac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac0039f0 0x7f4dac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc4b5b640 1 -- 172.21.15.26:0/39968779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac003530 con 0x7f4dac004810 2024-04-21T08:57:53.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.242+0000 7f4dc5b5d640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc006caf0 0x7f4dac0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:53.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac004810 0x7f4dac004c90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009ab0 tx=0x7f4db001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd522457425b1dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00b2070 con 0x7f4dac004810 2024-04-21T08:57:53.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db00a5620 con 0x7f4dac004810 2024-04-21T08:57:53.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4db7fff640 1 -- 172.21.15.26:0/39968779 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00096b0 con 0x7f4dac004810 2024-04-21T08:57:53.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- 172.21.15.26:0/39968779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac004810 msgr2=0x7f4dac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 --2- 172.21.15.26:0/39968779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dac004810 0x7f4dac004c90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009ab0 tx=0x7f4db001ca30 comp rx=0 tx=0).stop 2024-04-21T08:57:53.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc5b5d640 1 -- 172.21.15.26:0/39968779 reap_dead start 2024-04-21T08:57:53.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- 172.21.15.26:0/39968779 shutdown_connections 2024-04-21T08:57:53.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- 172.21.15.26:0/39968779 >> 172.21.15.26:0/39968779 conn(0x7f4dc00702c0 msgr2=0x7f4dc00cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:53.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- 172.21.15.26:0/39968779 shutdown_connections 2024-04-21T08:57:53.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- 172.21.15.26:0/39968779 wait complete. 2024-04-21T08:57:53.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 Processor -- start 2024-04-21T08:57:53.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- start start 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac004810 0x7f4dc01edea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc014efa0 0x7f4dc014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc00ca610 0x7f4dc0147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc00c89d0 con 0x7f4dc014efa0 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4dc00c5cb0 con 0x7f4dac004810 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4dc0151ff0 con 0x7f4dc00ca610 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc014efa0 0x7f4dc014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc5b5d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc00ca610 0x7f4dc0147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc014efa0 0x7f4dc014a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54292/0 (socket says 172.21.15.26:54292) 2024-04-21T08:57:53.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 -- 172.21.15.26:0/1289360244 learned_addr learned my addr 172.21.15.26:0/1289360244 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc535c640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac004810 0x7f4dc01edea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 -- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc00ca610 msgr2=0x7f4dc0147100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc00ca610 0x7f4dc0147100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 -- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac004810 msgr2=0x7f4dc01edea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac004810 0x7f4dc01edea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 -- 172.21.15.26:0/1289360244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dc01ee3e0 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc535c640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac004810 0x7f4dc01edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc4b5b640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc014efa0 0x7f4dc014a730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009ab0 tx=0x7f4dac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4db5ffb640 1 -- 172.21.15.26:0/1289360244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00ba070 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4db5ffb640 1 -- 172.21.15.26:0/1289360244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4db0004220 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dc01e1250 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4db5ffb640 1 -- 172.21.15.26:0/1289360244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db00b2040 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.246+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dc01e17f0 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.250+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc01e1a30 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.250+0000 7f4db5ffb640 1 -- 172.21.15.26:0/1289360244 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4db0003620 con 0x7f4dc014efa0 2024-04-21T08:57:53.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.250+0000 7f4db5ffb640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4da40683b0 0x7f4da406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.250+0000 7f4db5ffb640 1 -- 172.21.15.26:0/1289360244 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4db0122a50 con 0x7f4dc014efa0 2024-04-21T08:57:53.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.250+0000 7f4dc535c640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4da40683b0 0x7f4da406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.250+0000 7f4dc535c640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4da40683b0 0x7f4da406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc005510 tx=0x7f4dbc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.254+0000 7f4db5ffb640 1 -- 172.21.15.26:0/1289360244 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4db0016740 con 0x7f4dc014efa0 2024-04-21T08:57:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4dc0074320 con 0x7f4dc014efa0 2024-04-21T08:57:53.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4db5ffb640 1 -- 172.21.15.26:0/1289360244 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f4db00f29c0 con 0x7f4dc014efa0 2024-04-21T08:57:53.416 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4da40683b0 msgr2=0x7f4da406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4da40683b0 0x7f4da406a870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc005510 tx=0x7f4dbc009040 comp rx=0 tx=0).stop 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc014efa0 msgr2=0x7f4dc014a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc014efa0 0x7f4dc014a730 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4db0009ab0 tx=0x7f4dac005840 comp rx=0 tx=0).stop 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 shutdown_connections 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4dc00ca610 0x7f4dc0147100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4da40683b0 0x7f4da406a870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4dc014efa0 0x7f4dc014a730 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 --2- 172.21.15.26:0/1289360244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4dac004810 0x7f4dc01edea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 >> 172.21.15.26:0/1289360244 conn(0x7f4dc00702c0 msgr2=0x7f4dc0156b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 shutdown_connections 2024-04-21T08:57:53.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.414+0000 7f4dc75c0640 1 -- 172.21.15.26:0/1289360244 wait complete. 2024-04-21T08:57:53.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T08:57:53.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41bc9e3640 1 Processor -- start 2024-04-21T08:57:53.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41bc9e3640 1 -- start start 2024-04-21T08:57:53.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41bc9e3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f41b806d4a0 0x7f41b8158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41bc9e3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 0x7f41b8159110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41bc9e3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41b8073c00 con 0x7f41b8152a90 2024-04-21T08:57:53.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41bc9e3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f41b80c71b0 con 0x7f41b806d4a0 2024-04-21T08:57:53.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41bc9e3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41b8071d50 con 0x7f41b80c8180 2024-04-21T08:57:53.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f41b8152a90 0x7f41b80c5e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42456/0 (socket says 172.21.15.26:42456) 2024-04-21T08:57:53.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 -- 172.21.15.26:0/1621853519 learned_addr learned my addr 172.21.15.26:0/1621853519 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:53.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b6d9d640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 0x7f41b8159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b5d9b640 1 --2- 172.21.15.26:0/1621853519 >> v2:172.21.15.169:3300/0 conn(0x7f41b806d4a0 0x7f41b8158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359846825 0 0) 0x7f41b8073c00 con 0x7f41b8152a90 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41a0003530 con 0x7f41b8152a90 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2442732164 0 0) 0x7f41a0003530 con 0x7f41b8152a90 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 msgr2=0x7f41b8159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 0x7f41b8159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 >> v2:172.21.15.169:3300/0 conn(0x7f41b806d4a0 msgr2=0x7f41b8158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 --2- 172.21.15.26:0/1621853519 >> v2:172.21.15.169:3300/0 conn(0x7f41b806d4a0 0x7f41b8158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b8152e70 con 0x7f41b8152a90 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f41b0001a20 con 0x7f41b8152a90 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 >> v1:172.21.15.26:6789/0 conn(0x7f41b8152a90 legacy=0x7f41b80c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41a0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41a0004810 0x7f41a0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 0x7f41a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f41b80c71b0 con 0x7f41a00039c0 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41b8071d50 con 0x7f41a0004810 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41a000b9d0 con 0x7f41b80c8180 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41a0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b5d9b640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41a0004810 0x7f41a0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 -- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 msgr2=0x7f41a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b6d9d640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 0x7f41a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b80c8180 0x7f41a00051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 -- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41a0004810 msgr2=0x7f41a0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41a0004810 0x7f41a0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b659c640 1 -- 172.21.15.26:0/1621853519 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a0003530 con 0x7f41a00039c0 2024-04-21T08:57:53.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.558+0000 7f41b5d9b640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41a0004810 0x7f41a0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41b659c640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41a0003e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41b000a8a0 tx=0x7f41b001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9ab0f01b4232838 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b000a4c0 con 0x7f41a00039c0 2024-04-21T08:57:53.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00ad650 con 0x7f41a00039c0 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41b559a640 1 -- 172.21.15.26:0/1621853519 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00ada40 con 0x7f41a00039c0 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 -- 172.21.15.26:0/1621853519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 msgr2=0x7f41a0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 --2- 172.21.15.26:0/1621853519 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41a0003e00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f41b000a8a0 tx=0x7f41b001d360 comp rx=0 tx=0).stop 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41b6d9d640 1 -- 172.21.15.26:0/1621853519 reap_dead start 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 -- 172.21.15.26:0/1621853519 shutdown_connections 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 -- 172.21.15.26:0/1621853519 >> 172.21.15.26:0/1621853519 conn(0x7f41b80702c0 msgr2=0x7f41b80cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 -- 172.21.15.26:0/1621853519 shutdown_connections 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 -- 172.21.15.26:0/1621853519 wait complete. 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 Processor -- start 2024-04-21T08:57:53.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.562+0000 7f41bc9e3640 1 -- start start 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41b8159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41b814c790 0x7f41b8142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b8143120 0x7f41b80c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f41b806cf70 con 0x7f41a00039c0 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f41b8159520 con 0x7f41b814c790 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f41b8067cf0 con 0x7f41b8143120 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41b8159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41b8159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54300/0 (socket says 172.21.15.26:54300) 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 -- 172.21.15.26:0/3243403561 learned_addr learned my addr 172.21.15.26:0/3243403561 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b6d9d640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b8143120 0x7f41b80c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b5d9b640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41b814c790 0x7f41b8142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 -- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b8143120 msgr2=0x7f41b80c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b8143120 0x7f41b80c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 -- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41b814c790 msgr2=0x7f41b8142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41b814c790 0x7f41b8142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 -- 172.21.15.26:0/3243403561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b814b5f0 con 0x7f41a00039c0 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b5d9b640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41b814c790 0x7f41b8142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b659c640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41b8159bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41b000a8a0 tx=0x7f41a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41a6ffd640 1 -- 172.21.15.26:0/3243403561 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00ba020 con 0x7f41a00039c0 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41a6ffd640 1 -- 172.21.15.26:0/3243403561 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b00ad800 con 0x7f41a00039c0 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b814b8d0 con 0x7f41a00039c0 2024-04-21T08:57:53.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41a6ffd640 1 -- 172.21.15.26:0/3243403561 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b00017e0 con 0x7f41a00039c0 2024-04-21T08:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b814be90 con 0x7f41a00039c0 2024-04-21T08:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b8074320 con 0x7f41a00039c0 2024-04-21T08:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41a6ffd640 1 -- 172.21.15.26:0/3243403561 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f41b00bd070 con 0x7f41a00039c0 2024-04-21T08:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41a6ffd640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4198068380 0x7f419806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41a6ffd640 1 -- 172.21.15.26:0/3243403561 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f41b01208d0 con 0x7f41a00039c0 2024-04-21T08:57:53.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.566+0000 7f41b5d9b640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4198068380 0x7f419806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.570+0000 7f41b5d9b640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4198068380 0x7f419806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ccb10 tx=0x7f41ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.570+0000 7f41a6ffd640 1 -- 172.21.15.26:0/3243403561 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f41b0017070 con 0x7f41a00039c0 2024-04-21T08:57:53.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.726+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f41b815ae40 con 0x7f41a00039c0 2024-04-21T08:57:53.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.726+0000 7f41a6ffd640 1 -- 172.21.15.26:0/3243403561 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f41b00f0f20 con 0x7f41a00039c0 2024-04-21T08:57:53.730 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T08:57:53.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4198068380 msgr2=0x7f419806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4198068380 0x7f419806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f41b80ccb10 tx=0x7f41ac008040 comp rx=0 tx=0).stop 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 msgr2=0x7f41b8159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41b8159bb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f41b000a8a0 tx=0x7f41a0005840 comp rx=0 tx=0).stop 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 shutdown_connections 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41b8143120 0x7f41b80c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41b814c790 0x7f41b8142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4198068380 0x7f419806a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 --2- 172.21.15.26:0/3243403561 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f41a00039c0 0x7f41b8159bb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 >> 172.21.15.26:0/3243403561 conn(0x7f41b80702c0 msgr2=0x7f41b8157e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 shutdown_connections 2024-04-21T08:57:53.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.730+0000 7f41bc9e3640 1 -- 172.21.15.26:0/3243403561 wait complete. 2024-04-21T08:57:53.748 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T08:57:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.858+0000 7fe10290d640 1 Processor -- start 2024-04-21T08:57:53.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.858+0000 7fe10290d640 1 -- start start 2024-04-21T08:57:53.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0fc0ccba0 0x7fe0fc073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0fc153240 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe0fc158d10 con 0x7fe0fc0ccba0 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc0c6b60 con 0x7fe0fc152e60 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0f3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0fc0ccba0 0x7fe0fc073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe100eaa640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe0fc0c5e90 0x7fe0fc1591a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42470/0 (socket says 172.21.15.26:42470) 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0f3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe0fc0ccba0 0x7fe0fc073be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54302/0 (socket says 172.21.15.26:54302) 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe100eaa640 1 -- 172.21.15.26:0/1969800009 learned_addr learned my addr 172.21.15.26:0/1969800009 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0fbfff640 1 --2- 172.21.15.26:0/1969800009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0f3fff640 1 -- 172.21.15.26:0/1969800009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 msgr2=0x7fe0fc0736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0f3fff640 1 --2- 172.21.15.26:0/1969800009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc0736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0f3fff640 1 -- 172.21.15.26:0/1969800009 >> v1:172.21.15.26:6789/0 conn(0x7fe0fc0c5e90 legacy=0x7fe0fc1591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0f3fff640 1 -- 172.21.15.26:0/1969800009 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc0c3550 con 0x7fe0fc0ccba0 2024-04-21T08:57:53.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0fb7fe640 1 -- 172.21.15.26:0/1969800009 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730856367 0 0) 0x7fe0fc153240 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0f3fff640 1 --2- 172.21.15.26:0/1969800009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0ccba0 0x7fe0fc073be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40097c0 tx=0x7fe0e401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadc4361ba2a73c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0fb7fe640 1 -- 172.21.15.26:0/1969800009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40b5070 con 0x7fe0fc0ccba0 2024-04-21T08:57:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0fb7fe640 1 -- 172.21.15.26:0/1969800009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e40a8990 con 0x7fe0fc0ccba0 2024-04-21T08:57:53.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe0fb7fe640 1 -- 172.21.15.26:0/1969800009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40a8d60 con 0x7fe0fc0ccba0 2024-04-21T08:57:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- 172.21.15.26:0/1969800009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0ccba0 msgr2=0x7fe0fc073be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 --2- 172.21.15.26:0/1969800009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0ccba0 0x7fe0fc073be0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40097c0 tx=0x7fe0e401ec90 comp rx=0 tx=0).stop 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- 172.21.15.26:0/1969800009 shutdown_connections 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 --2- 172.21.15.26:0/1969800009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0ccba0 0x7fe0fc073be0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 --2- 172.21.15.26:0/1969800009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc0736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- 172.21.15.26:0/1969800009 >> 172.21.15.26:0/1969800009 conn(0x7fe0fc0cbef0 msgr2=0x7fe0fc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- 172.21.15.26:0/1969800009 shutdown_connections 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.862+0000 7fe10290d640 1 -- 172.21.15.26:0/1969800009 wait complete. 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 Processor -- start 2024-04-21T08:57:53.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 -- start start 2024-04-21T08:57:53.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0c5e90 0x7fe0fc151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0ccba0 0x7fe0fc14a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc14a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0c67b0 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc0c3b10 con 0x7fe0fc0ccba0 2024-04-21T08:57:53.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe0fc149c80 con 0x7fe0fc152e60 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0c5e90 0x7fe0fc151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0c5e90 0x7fe0fc151d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54312/0 (socket says 172.21.15.26:54312) 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 -- 172.21.15.26:0/1893543372 learned_addr learned my addr 172.21.15.26:0/1893543372 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe100eaa640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0f3fff640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0ccba0 0x7fe0fc14a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 -- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 msgr2=0x7fe0fc14a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc14a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 -- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0ccba0 msgr2=0x7fe0fc14a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0ccba0 0x7fe0fc14a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 -- 172.21.15.26:0/1893543372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc1589c0 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0fbfff640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0c5e90 0x7fe0fc151d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00d5f0 tx=0x7fe0ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0f97fa640 1 -- 172.21.15.26:0/1893543372 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0125f0 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0f97fa640 1 -- 172.21.15.26:0/1893543372 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ec019070 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc156cb0 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe0f97fa640 1 -- 172.21.15.26:0/1893543372 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ec0129d0 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc157270 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.866+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc074320 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.870+0000 7fe0f97fa640 1 -- 172.21.15.26:0/1893543372 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe0ec012b70 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.870+0000 7fe0f97fa640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0dc068380 0x7fe0dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.870+0000 7fe0f97fa640 1 -- 172.21.15.26:0/1893543372 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe0ec086eb0 con 0x7fe0fc0c5e90 2024-04-21T08:57:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.870+0000 7fe0f3fff640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0dc068380 0x7fe0dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:53.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.870+0000 7fe0f3fff640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0dc068380 0x7fe0dc06a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40b2000 tx=0x7fe0e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:53.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:53.874+0000 7fe0f97fa640 1 -- 172.21.15.26:0/1893543372 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe0ec057360 con 0x7fe0fc0c5e90 2024-04-21T08:57:54.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe0fc14bfe0 con 0x7fe0fc0c5e90 2024-04-21T08:57:54.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe0f97fa640 1 -- 172.21.15.26:0/1893543372 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fe0ec056c60 con 0x7fe0fc0c5e90 2024-04-21T08:57:54.032 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T08:57:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0dc068380 msgr2=0x7fe0dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0dc068380 0x7fe0dc06a840 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0e40b2000 tx=0x7fe0e4008040 comp rx=0 tx=0).stop 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0c5e90 msgr2=0x7fe0fc151d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0c5e90 0x7fe0fc151d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec00d5f0 tx=0x7fe0ec00dab0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 shutdown_connections 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe0fc152e60 0x7fe0fc14a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe0fc0ccba0 0x7fe0fc14a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0dc068380 0x7fe0dc06a840 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 --2- 172.21.15.26:0/1893543372 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe0fc0c5e90 0x7fe0fc151d20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 >> 172.21.15.26:0/1893543372 conn(0x7fe0fc0cbef0 msgr2=0x7fe0fc0c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.030+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 shutdown_connections 2024-04-21T08:57:54.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.034+0000 7fe10290d640 1 -- 172.21.15.26:0/1893543372 wait complete. 2024-04-21T08:57:54.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:57:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.170+0000 7fc219089640 1 Processor -- start 2024-04-21T08:57:54.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.170+0000 7fc219089640 1 -- start start 2024-04-21T08:57:54.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc219089640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc21406cd50 0x7fc2140ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc219089640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc21406d130 0x7fc21406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc219089640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc214158850 con 0x7fc2140c89d0 2024-04-21T08:57:54.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc219089640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc2140c0d80 con 0x7fc21406d130 2024-04-21T08:57:54.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc219089640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc2140c8540 con 0x7fc21406cd50 2024-04-21T08:57:54.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc20bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc21406d130 0x7fc21406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc212d9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc21406cd50 0x7fc2140ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc21359e640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc2140c89d0 0x7fc214151850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:38434/0 (socket says 172.21.15.26:38434) 2024-04-21T08:57:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc21359e640 1 -- 172.21.15.26:0/3207388481 learned_addr learned my addr 172.21.15.26:0/3207388481 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc20bfff640 1 -- 172.21.15.26:0/3207388481 >> v2:172.21.15.169:3300/0 conn(0x7fc21406cd50 msgr2=0x7fc2140ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc20bfff640 1 --2- 172.21.15.26:0/3207388481 >> v2:172.21.15.169:3300/0 conn(0x7fc21406cd50 0x7fc2140ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc20bfff640 1 -- 172.21.15.26:0/3207388481 >> v1:172.21.15.169:6789/0 conn(0x7fc2140c89d0 legacy=0x7fc214151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc20bfff640 1 -- 172.21.15.26:0/3207388481 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2140c7930 con 0x7fc21406d130 2024-04-21T08:57:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.174+0000 7fc20bfff640 1 --2- 172.21.15.26:0/3207388481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21406d130 0x7fc21406d570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc214071c90 tx=0x7fc1fc01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fe0eab7af5d19d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21259c640 1 -- 172.21.15.26:0/3207388481 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0b5070 con 0x7fc21406d130 2024-04-21T08:57:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21259c640 1 -- 172.21.15.26:0/3207388481 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1fc0a8970 con 0x7fc21406d130 2024-04-21T08:57:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21259c640 1 -- 172.21.15.26:0/3207388481 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1fc0a8d40 con 0x7fc21406d130 2024-04-21T08:57:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- 172.21.15.26:0/3207388481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21406d130 msgr2=0x7fc21406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 --2- 172.21.15.26:0/3207388481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21406d130 0x7fc21406d570 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc214071c90 tx=0x7fc1fc01ec70 comp rx=0 tx=0).stop 2024-04-21T08:57:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- 172.21.15.26:0/3207388481 shutdown_connections 2024-04-21T08:57:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 --2- 172.21.15.26:0/3207388481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc21406d130 0x7fc21406d570 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 --2- 172.21.15.26:0/3207388481 >> v2:172.21.15.169:3300/0 conn(0x7fc21406cd50 0x7fc2140ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- 172.21.15.26:0/3207388481 >> 172.21.15.26:0/3207388481 conn(0x7fc2140c9b50 msgr2=0x7fc2140c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:54.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- 172.21.15.26:0/3207388481 shutdown_connections 2024-04-21T08:57:54.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- 172.21.15.26:0/3207388481 wait complete. 2024-04-21T08:57:54.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 Processor -- start 2024-04-21T08:57:54.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- start start 2024-04-21T08:57:54.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc21406cd50 0x7fc21414d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc21406d130 0x7fc2141f4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2140c89d0 0x7fc2141436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140c81d0 con 0x7fc2140c89d0 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc2140c7ef0 con 0x7fc21406d130 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc214158450 con 0x7fc21406cd50 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2140c89d0 0x7fc2141436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2140c89d0 0x7fc2141436b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54320/0 (socket says 172.21.15.26:54320) 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 -- 172.21.15.26:0/1870978989 learned_addr learned my addr 172.21.15.26:0/1870978989 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc20bfff640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc21406d130 0x7fc2141f4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc212d9d640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc21406cd50 0x7fc21414d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 -- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc21406cd50 msgr2=0x7fc21414d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc21406cd50 0x7fc21414d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 -- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc21406d130 msgr2=0x7fc2141f4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc21406d130 0x7fc2141f4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 -- 172.21.15.26:0/1870978989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc214159680 con 0x7fc2140c89d0 2024-04-21T08:57:54.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc21359e640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2140c89d0 0x7fc2141436b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00cbf0 tx=0x7fc20c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc20b7fe640 1 -- 172.21.15.26:0/1870978989 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c017070 con 0x7fc2140c89d0 2024-04-21T08:57:54.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc20b7fe640 1 -- 172.21.15.26:0/1870978989 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc20c00ace0 con 0x7fc2140c89d0 2024-04-21T08:57:54.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc214143bf0 con 0x7fc2140c89d0 2024-04-21T08:57:54.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc20b7fe640 1 -- 172.21.15.26:0/1870978989 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc20c012600 con 0x7fc2140c89d0 2024-04-21T08:57:54.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.178+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc21414cb40 con 0x7fc2140c89d0 2024-04-21T08:57:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.182+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc214075ef0 con 0x7fc2140c89d0 2024-04-21T08:57:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.182+0000 7fc20b7fe640 1 -- 172.21.15.26:0/1870978989 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc20c01a070 con 0x7fc2140c89d0 2024-04-21T08:57:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.182+0000 7fc20b7fe640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc1f4068380 0x7fc1f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.182+0000 7fc20b7fe640 1 -- 172.21.15.26:0/1870978989 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc20c086530 con 0x7fc2140c89d0 2024-04-21T08:57:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.182+0000 7fc212d9d640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc1f4068380 0x7fc1f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.182+0000 7fc212d9d640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc1f4068380 0x7fc1f406a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc204009a50 tx=0x7fc204008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.186+0000 7fc20b7fe640 1 -- 172.21.15.26:0/1870978989 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc214159680 con 0x7fc2140c89d0 2024-04-21T08:57:54.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.378+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc21414e7a0 con 0x7fc2140c89d0 2024-04-21T08:57:54.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.378+0000 7fc20b7fe640 1 -- 172.21.15.26:0/1870978989 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fc20c056530 con 0x7fc2140c89d0 2024-04-21T08:57:54.381 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:54.381 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T08:57:54.381 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T08:57:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc1f4068380 msgr2=0x7fc1f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc1f4068380 0x7fc1f406a840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc204009a50 tx=0x7fc204008040 comp rx=0 tx=0).stop 2024-04-21T08:57:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2140c89d0 msgr2=0x7fc2141436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2140c89d0 0x7fc2141436b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00cbf0 tx=0x7fc20c00a430 comp rx=0 tx=0).stop 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 shutdown_connections 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc1f4068380 0x7fc1f406a840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc2140c89d0 0x7fc2141436b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc21406d130 0x7fc2141f4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 --2- 172.21.15.26:0/1870978989 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc21406cd50 0x7fc21414d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 >> 172.21.15.26:0/1870978989 conn(0x7fc2140c9b50 msgr2=0x7fc2140731b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 shutdown_connections 2024-04-21T08:57:54.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.382+0000 7fc219089640 1 -- 172.21.15.26:0/1870978989 wait complete. 2024-04-21T08:57:54.399 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:54.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.514+0000 7f31d4bf3640 1 Processor -- start 2024-04-21T08:57:54.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.514+0000 7f31d4bf3640 1 -- start start 2024-04-21T08:57:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f31d015b320 0x7f31d015b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31d015bc40 0x7f31d01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d00c5e30 0x7f31d0159600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f31d00c4c20 con 0x7f31d015bc40 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f31d00c4f00 con 0x7f31d015b320 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f31d00c51e0 con 0x7f31d00c5e30 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31d015bc40 0x7f31d01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f31d015bc40 0x7f31d01590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54328/0 (socket says 172.21.15.26:54328) 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 -- 172.21.15.26:0/4202712527 learned_addr learned my addr 172.21.15.26:0/4202712527 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31ced9d640 1 --2- 172.21.15.26:0/4202712527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d00c5e30 0x7f31d0159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31ce59c640 1 --2- 172.21.15.26:0/4202712527 >> v2:172.21.15.169:3300/0 conn(0x7f31d015b320 0x7f31d015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 -- 172.21.15.26:0/4202712527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d00c5e30 msgr2=0x7f31d0159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 --2- 172.21.15.26:0/4202712527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d00c5e30 0x7f31d0159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 -- 172.21.15.26:0/4202712527 >> v2:172.21.15.169:3300/0 conn(0x7f31d015b320 msgr2=0x7f31d015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 --2- 172.21.15.26:0/4202712527 >> v2:172.21.15.169:3300/0 conn(0x7f31d015b320 0x7f31d015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 -- 172.21.15.26:0/4202712527 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d00c54c0 con 0x7f31d015bc40 2024-04-21T08:57:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31ce59c640 1 --2- 172.21.15.26:0/4202712527 >> v2:172.21.15.169:3300/0 conn(0x7f31d015b320 0x7f31d015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cdd9b640 1 --2- 172.21.15.26:0/4202712527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d015bc40 0x7f31d01590c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31d0069590 tx=0x7f31b80213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4523f0d760a2f0aa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cd59a640 1 -- 172.21.15.26:0/4202712527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b80b6070 con 0x7f31d015bc40 2024-04-21T08:57:54.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cd59a640 1 -- 172.21.15.26:0/4202712527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31b80b1600 con 0x7f31d015bc40 2024-04-21T08:57:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31cd59a640 1 -- 172.21.15.26:0/4202712527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b80b19d0 con 0x7f31d015bc40 2024-04-21T08:57:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 -- 172.21.15.26:0/4202712527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d015bc40 msgr2=0x7f31d01590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/4202712527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d015bc40 0x7f31d01590c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f31d0069590 tx=0x7f31b80213e0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 -- 172.21.15.26:0/4202712527 shutdown_connections 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/4202712527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d015bc40 0x7f31d01590c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/4202712527 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d00c5e30 0x7f31d0159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/4202712527 >> v2:172.21.15.169:3300/0 conn(0x7f31d015b320 0x7f31d015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.518+0000 7f31d4bf3640 1 -- 172.21.15.26:0/4202712527 >> 172.21.15.26:0/4202712527 conn(0x7f31d00c8960 msgr2=0x7f31d00c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- 172.21.15.26:0/4202712527 shutdown_connections 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- 172.21.15.26:0/4202712527 wait complete. 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 Processor -- start 2024-04-21T08:57:54.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- start start 2024-04-21T08:57:54.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00c5e30 0x7f31d00729e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d015b320 0x7f31d015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d01f4140 0x7f31d01f45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f31d00c9710 con 0x7f31d00c5e30 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31d00bfa30 con 0x7f31d01f4140 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f31d00c9890 con 0x7f31d015b320 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00c5e30 0x7f31d00729e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00c5e30 0x7f31d00729e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54342/0 (socket says 172.21.15.26:54342) 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 -- 172.21.15.26:0/1108612020 learned_addr learned my addr 172.21.15.26:0/1108612020 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31cdd9b640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d015b320 0x7f31d015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 -- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d015b320 msgr2=0x7f31d015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d015b320 0x7f31d015a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 -- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d01f4140 msgr2=0x7f31d01f45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ced9d640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d01f4140 0x7f31d01f45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d01f4140 0x7f31d01f45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 -- 172.21.15.26:0/1108612020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d00cb400 con 0x7f31d00c5e30 2024-04-21T08:57:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31cdd9b640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d015b320 0x7f31d015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31ce59c640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00c5e30 0x7f31d00729e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f31c000cf60 tx=0x7f31c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31c6ffd640 1 -- 172.21.15.26:0/1108612020 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c001a070 con 0x7f31d00c5e30 2024-04-21T08:57:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31c6ffd640 1 -- 172.21.15.26:0/1108612020 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31c000d840 con 0x7f31d00c5e30 2024-04-21T08:57:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31c6ffd640 1 -- 172.21.15.26:0/1108612020 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c000dc10 con 0x7f31d00c5e30 2024-04-21T08:57:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d0150f20 con 0x7f31d00c5e30 2024-04-21T08:57:54.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.522+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d00cb800 con 0x7f31d00c5e30 2024-04-21T08:57:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.526+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0075ef0 con 0x7f31d00c5e30 2024-04-21T08:57:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.526+0000 7f31c6ffd640 1 -- 172.21.15.26:0/1108612020 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f31c001d070 con 0x7f31d00c5e30 2024-04-21T08:57:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.526+0000 7f31c6ffd640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31b00683b0 0x7f31b006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.526+0000 7f31c6ffd640 1 -- 172.21.15.26:0/1108612020 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f31c0087060 con 0x7f31d00c5e30 2024-04-21T08:57:54.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.526+0000 7f31cdd9b640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31b00683b0 0x7f31b006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.526+0000 7f31cdd9b640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31b00683b0 0x7f31b006a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b3000 tx=0x7f31b8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.530+0000 7f31c6ffd640 1 -- 172.21.15.26:0/1108612020 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f31c0057060 con 0x7f31d00c5e30 2024-04-21T08:57:54.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.694+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31d01510f0 con 0x7f31d00c5e30 2024-04-21T08:57:54.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.694+0000 7f31c6ffd640 1 -- 172.21.15.26:0/1108612020 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7f31c005b360 con 0x7f31d00c5e30 2024-04-21T08:57:54.697 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:54.697 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31b00683b0 msgr2=0x7f31b006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31b00683b0 0x7f31b006a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b3000 tx=0x7f31b8008040 comp rx=0 tx=0).stop 2024-04-21T08:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00c5e30 msgr2=0x7f31d00729e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00c5e30 0x7f31d00729e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f31c000cf60 tx=0x7f31c000cf90 comp rx=0 tx=0).stop 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 shutdown_connections 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31d01f4140 0x7f31d01f45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31d015b320 0x7f31d015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31b00683b0 0x7f31b006a870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 --2- 172.21.15.26:0/1108612020 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31d00c5e30 0x7f31d00729e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 >> 172.21.15.26:0/1108612020 conn(0x7f31d00c8960 msgr2=0x7f31d00c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 shutdown_connections 2024-04-21T08:57:54.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.698+0000 7f31d4bf3640 1 -- 172.21.15.26:0/1108612020 wait complete. 2024-04-21T08:57:54.716 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T08:57:54.716 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T08:57:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadd5d85640 1 Processor -- start 2024-04-21T08:57:54.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadd5d85640 1 -- start start 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadd5d85640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fadd00c8420 0x7fadd015f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadd5d85640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00cca10 0x7fadd015f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadd5d85640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd0071530 con 0x7fadd0159210 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadd5d85640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fadd006cb00 con 0x7fadd00c8420 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadd5d85640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fadd0071b40 con 0x7fadd00cca10 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadcf7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fadd0159210 0x7fadd0071fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42486/0 (socket says 172.21.15.26:42486) 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadcf7fe640 1 -- 172.21.15.26:0/3087844562 learned_addr learned my addr 172.21.15.26:0/3087844562 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadceffd640 1 --2- 172.21.15.26:0/3087844562 >> v2:172.21.15.26:3300/0 conn(0x7fadd00c8420 0x7fadd015f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadcffff640 1 --2- 172.21.15.26:0/3087844562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00cca10 0x7fadd015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadce7fc640 1 -- 172.21.15.26:0/3087844562 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016441718 0 0) 0x7fadd0071530 con 0x7fadd0159210 2024-04-21T08:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadce7fc640 1 -- 172.21.15.26:0/3087844562 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadbc003530 con 0x7fadd0159210 2024-04-21T08:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadceffd640 1 -- 172.21.15.26:0/3087844562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00cca10 msgr2=0x7fadd015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadceffd640 1 --2- 172.21.15.26:0/3087844562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00cca10 0x7fadd015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadceffd640 1 -- 172.21.15.26:0/3087844562 >> v1:172.21.15.26:6789/0 conn(0x7fadd0159210 legacy=0x7fadd0071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadceffd640 1 -- 172.21.15.26:0/3087844562 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd00c68e0 con 0x7fadd00c8420 2024-04-21T08:57:54.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.838+0000 7fadcffff640 1 --2- 172.21.15.26:0/3087844562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00cca10 0x7fadd015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:54.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadceffd640 1 --2- 172.21.15.26:0/3087844562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd00c8420 0x7fadd015f030 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadb80097c0 tx=0x7fadb801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acb1ccf7e74ae605 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadce7fc640 1 -- 172.21.15.26:0/3087844562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80b2070 con 0x7fadd00c8420 2024-04-21T08:57:54.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadce7fc640 1 -- 172.21.15.26:0/3087844562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadb80ad640 con 0x7fadd00c8420 2024-04-21T08:57:54.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadce7fc640 1 -- 172.21.15.26:0/3087844562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb80ada10 con 0x7fadd00c8420 2024-04-21T08:57:54.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 -- 172.21.15.26:0/3087844562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd00c8420 msgr2=0x7fadd015f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 --2- 172.21.15.26:0/3087844562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd00c8420 0x7fadd015f030 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fadb80097c0 tx=0x7fadb801c4a0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 -- 172.21.15.26:0/3087844562 shutdown_connections 2024-04-21T08:57:54.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 --2- 172.21.15.26:0/3087844562 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00cca10 0x7fadd015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 --2- 172.21.15.26:0/3087844562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd00c8420 0x7fadd015f030 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 -- 172.21.15.26:0/3087844562 >> 172.21.15.26:0/3087844562 conn(0x7fadd00cbef0 msgr2=0x7fadd00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:54.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 -- 172.21.15.26:0/3087844562 shutdown_connections 2024-04-21T08:57:54.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 -- 172.21.15.26:0/3087844562 wait complete. 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 Processor -- start 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.842+0000 7fadd5d85640 1 -- start start 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00c8420 0x7fadd00c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd00cca10 0x7fadd00bbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd0159210 0x7fadd00bc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fadd00726e0 con 0x7fadd0159210 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fadd015fec0 con 0x7fadd00cca10 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fadd0072860 con 0x7fadd00c8420 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd0159210 0x7fadd00bc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd0159210 0x7fadd00bc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54356/0 (socket says 172.21.15.26:54356) 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 -- 172.21.15.26:0/548013731 learned_addr learned my addr 172.21.15.26:0/548013731 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcf7fe640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00c8420 0x7fadd00c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadceffd640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd00cca10 0x7fadd00bbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 -- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00c8420 msgr2=0x7fadd00c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00c8420 0x7fadd00c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 -- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd00cca10 msgr2=0x7fadd00bbc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd00cca10 0x7fadd00bbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 -- 172.21.15.26:0/548013731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd00c0280 con 0x7fadd0159210 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcffff640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd0159210 0x7fadd00bc160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fadc000e840 tx=0x7fadc000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadc7fff640 1 -- 172.21.15.26:0/548013731 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0017070 con 0x7fadd0159210 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadc7fff640 1 -- 172.21.15.26:0/548013731 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fadc000c6d0 con 0x7fadd0159210 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadd00c0560 con 0x7fadd0159210 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadc7fff640 1 -- 172.21.15.26:0/548013731 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc000f040 con 0x7fadd0159210 2024-04-21T08:57:54.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadd00bb420 con 0x7fadd0159210 2024-04-21T08:57:54.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadd00c0a80 con 0x7fadd0159210 2024-04-21T08:57:54.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadc7fff640 1 -- 172.21.15.26:0/548013731 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fadc001a070 con 0x7fadd0159210 2024-04-21T08:57:54.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadc7fff640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fadb00683b0 0x7fadb006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadc7fff640 1 -- 172.21.15.26:0/548013731 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fadc0086510 con 0x7fadd0159210 2024-04-21T08:57:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.846+0000 7fadcf7fe640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fadb00683b0 0x7fadb006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:54.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.850+0000 7fadcf7fe640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fadb00683b0 0x7fadb006a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadc8005c10 tx=0x7fadc8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:54.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:54.854+0000 7fadc7fff640 1 -- 172.21.15.26:0/548013731 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fadd00c0a80 con 0x7fadd0159210 2024-04-21T08:57:55.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.014+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fadd0074320 con 0x7fadd0159210 2024-04-21T08:57:55.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.014+0000 7fadc7fff640 1 -- 172.21.15.26:0/548013731 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fadc0056b60 con 0x7fadd0159210 2024-04-21T08:57:55.017 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fadb00683b0 msgr2=0x7fadb006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fadb00683b0 0x7fadb006a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fadc8005c10 tx=0x7fadc8009040 comp rx=0 tx=0).stop 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd0159210 msgr2=0x7fadd00bc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd0159210 0x7fadd00bc160 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fadc000e840 tx=0x7fadc000ed00 comp rx=0 tx=0).stop 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 shutdown_connections 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fadb00683b0 0x7fadb006a870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fadd0159210 0x7fadd00bc160 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fadd00cca10 0x7fadd00bbc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 --2- 172.21.15.26:0/548013731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fadd00c8420 0x7fadd00c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 >> 172.21.15.26:0/548013731 conn(0x7fadd00cbef0 msgr2=0x7fadd00cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 shutdown_connections 2024-04-21T08:57:55.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.018+0000 7fadd5d85640 1 -- 172.21.15.26:0/548013731 wait complete. 2024-04-21T08:57:55.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T08:57:55.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.162+0000 7f153d4db640 1 Processor -- start 2024-04-21T08:57:55.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.162+0000 7f153d4db640 1 -- start start 2024-04-21T08:57:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f153d4db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1538152e60 0x7f15380736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f153d4db640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f15380c5e90 0x7f1538073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f153d4db640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1538153240 con 0x7f15380ccba0 2024-04-21T08:57:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f153d4db640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1538158d10 con 0x7f1538152e60 2024-04-21T08:57:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f153d4db640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f15380c6b60 con 0x7f15380c5e90 2024-04-21T08:57:55.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1538152e60 0x7f15380736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1538152e60 0x7f15380736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54358/0 (socket says 172.21.15.26:54358) 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 -- 172.21.15.26:0/1257743484 learned_addr learned my addr 172.21.15.26:0/1257743484 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f15377fe640 1 --2- 172.21.15.26:0/1257743484 >> v2:172.21.15.169:3300/0 conn(0x7f15380c5e90 0x7f1538073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 -- 172.21.15.26:0/1257743484 >> v2:172.21.15.169:3300/0 conn(0x7f15380c5e90 msgr2=0x7f1538073be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 --2- 172.21.15.26:0/1257743484 >> v2:172.21.15.169:3300/0 conn(0x7f15380c5e90 0x7f1538073be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 -- 172.21.15.26:0/1257743484 >> v1:172.21.15.169:6789/0 conn(0x7f15380ccba0 legacy=0x7f15381591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 -- 172.21.15.26:0/1257743484 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15380c3550 con 0x7f1538152e60 2024-04-21T08:57:55.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f15377fe640 1 --2- 172.21.15.26:0/1257743484 >> v2:172.21.15.169:3300/0 conn(0x7f15380c5e90 0x7f1538073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1536ffd640 1 --2- 172.21.15.26:0/1257743484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1538152e60 0x7f15380736a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15380bf6c0 tx=0x7f152801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca69cf1627917e79 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1535ffb640 1 -- 172.21.15.26:0/1257743484 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15280b5070 con 0x7f1538152e60 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1535ffb640 1 -- 172.21.15.26:0/1257743484 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15280a89d0 con 0x7f1538152e60 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.166+0000 7f1535ffb640 1 -- 172.21.15.26:0/1257743484 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15280a8da0 con 0x7f1538152e60 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- 172.21.15.26:0/1257743484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1538152e60 msgr2=0x7f15380736a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 --2- 172.21.15.26:0/1257743484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1538152e60 0x7f15380736a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f15380bf6c0 tx=0x7f152801ecd0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- 172.21.15.26:0/1257743484 shutdown_connections 2024-04-21T08:57:55.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 --2- 172.21.15.26:0/1257743484 >> v2:172.21.15.169:3300/0 conn(0x7f15380c5e90 0x7f1538073be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 --2- 172.21.15.26:0/1257743484 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1538152e60 0x7f15380736a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- 172.21.15.26:0/1257743484 >> 172.21.15.26:0/1257743484 conn(0x7f15380cbef0 msgr2=0x7f15380cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- 172.21.15.26:0/1257743484 shutdown_connections 2024-04-21T08:57:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- 172.21.15.26:0/1257743484 wait complete. 2024-04-21T08:57:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 Processor -- start 2024-04-21T08:57:55.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- start start 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15380c5e90 0x7f15381f29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15380ccba0 0x7f1538157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1538152e60 0x7f15381579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f15380c67b0 con 0x7f15380ccba0 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f15380c3b10 con 0x7f1538152e60 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f153d4db640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1538068d20 con 0x7f15380c5e90 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15380ccba0 0x7f1538157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15380ccba0 0x7f1538157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54366/0 (socket says 172.21.15.26:54366) 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 -- 172.21.15.26:0/4054554592 learned_addr learned my addr 172.21.15.26:0/4054554592 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f1536ffd640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15380c5e90 0x7f15381f29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15377fe640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1538152e60 0x7f15381579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 -- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15380c5e90 msgr2=0x7f15381f29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15380c5e90 0x7f15381f29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 -- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1538152e60 msgr2=0x7f15381579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1538152e60 0x7f15381579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 -- 172.21.15.26:0/4054554592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15381f2f10 con 0x7f15380ccba0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15377fe640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1538152e60 0x7f15381579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.170+0000 7f15367fc640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15380ccba0 0x7f1538157490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c440 tx=0x7f152c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f151f7fe640 1 -- 172.21.15.26:0/4054554592 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c016020 con 0x7f15380ccba0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f151f7fe640 1 -- 172.21.15.26:0/4054554592 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f152c012830 con 0x7f15380ccba0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15381eebb0 con 0x7f15380ccba0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f151f7fe640 1 -- 172.21.15.26:0/4054554592 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f152c012c20 con 0x7f15380ccba0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15381ef130 con 0x7f15380ccba0 2024-04-21T08:57:55.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1538074320 con 0x7f15380ccba0 2024-04-21T08:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f151f7fe640 1 -- 172.21.15.26:0/4054554592 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f152c019020 con 0x7f15380ccba0 2024-04-21T08:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f151f7fe640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f15240683b0 0x7f152406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f151f7fe640 1 -- 172.21.15.26:0/4054554592 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f152c086980 con 0x7f15380ccba0 2024-04-21T08:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f1536ffd640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f15240683b0 0x7f152406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.174+0000 7f1536ffd640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f15240683b0 0x7f152406a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f15280b2000 tx=0x7f1528008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.178+0000 7f151f7fe640 1 -- 172.21.15.26:0/4054554592 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f152c020020 con 0x7f15380ccba0 2024-04-21T08:57:55.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.342+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f153806e2f0 con 0x7f15380ccba0 2024-04-21T08:57:55.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.342+0000 7f151f7fe640 1 -- 172.21.15.26:0/4054554592 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f152c0182c0 con 0x7f15380ccba0 2024-04-21T08:57:55.346 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T08:57:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f15240683b0 msgr2=0x7f152406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f15240683b0 0x7f152406a870 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f15280b2000 tx=0x7f1528008040 comp rx=0 tx=0).stop 2024-04-21T08:57:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15380ccba0 msgr2=0x7f1538157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15380ccba0 0x7f1538157490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f152c00c440 tx=0x7f152c00c900 comp rx=0 tx=0).stop 2024-04-21T08:57:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 shutdown_connections 2024-04-21T08:57:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1538152e60 0x7f15381579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f15240683b0 0x7f152406a870 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f15380ccba0 0x7f1538157490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 --2- 172.21.15.26:0/4054554592 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f15380c5e90 0x7f15381f29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 >> 172.21.15.26:0/4054554592 conn(0x7f15380cbef0 msgr2=0x7f15380c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 shutdown_connections 2024-04-21T08:57:55.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.346+0000 7f153d4db640 1 -- 172.21.15.26:0/4054554592 wait complete. 2024-04-21T08:57:55.366 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T08:57:55.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec1104c640 1 Processor -- start 2024-04-21T08:57:55.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec1104c640 1 -- start start 2024-04-21T08:57:55.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec1104c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fec0c06caf0 0x7fec0c06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec1104c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0c0c3180 con 0x7fec0c157940 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec1104c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec0c0c3420 con 0x7fec0c151c10 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec1104c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fec0c0c6020 con 0x7fec0c06caf0 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fec0c157940 0x7fec0c162260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42490/0 (socket says 172.21.15.26:42490) 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 -- 172.21.15.26:0/2467583888 learned_addr learned my addr 172.21.15.26:0/2467583888 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0a59c640 1 --2- 172.21.15.26:0/2467583888 >> v2:172.21.15.169:3300/0 conn(0x7fec0c06caf0 0x7fec0c06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288785898 0 0) 0x7fec0c0c3180 con 0x7fec0c157940 2024-04-21T08:57:55.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7febf4003530 con 0x7fec0c157940 2024-04-21T08:57:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3195040832 0 0) 0x7febf4003530 con 0x7fec0c157940 2024-04-21T08:57:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 >> v2:172.21.15.169:3300/0 conn(0x7fec0c06caf0 msgr2=0x7fec0c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 --2- 172.21.15.26:0/2467583888 >> v2:172.21.15.169:3300/0 conn(0x7fec0c06caf0 0x7fec0c06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 >> v1:172.21.15.169:6789/0 conn(0x7fec0c151c10 legacy=0x7fec0c0c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c0c3700 con 0x7fec0c157940 2024-04-21T08:57:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fec04001a00 con 0x7fec0c157940 2024-04-21T08:57:55.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 >> v1:172.21.15.26:6789/0 conn(0x7fec0c157940 legacy=0x7fec0c162260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febf4003a10 0x7febf4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febf4004810 0x7febf4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7febf400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c0c6020 con 0x7febf40051d0 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7febf400c0b0 con 0x7febf4003a10 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7febf400c2b0 con 0x7febf4004810 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7febf400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0ad9d640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febf4003a10 0x7febf4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0a59c640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febf4004810 0x7febf4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 -- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febf4004810 msgr2=0x7febf4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:55.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7febf4004810 0x7febf4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 -- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febf4003a10 msgr2=0x7febf4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:55.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7febf4003a10 0x7febf4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.490+0000 7fec0b59e640 1 -- 172.21.15.26:0/2467583888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febf4003530 con 0x7febf40051d0 2024-04-21T08:57:55.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec0b59e640 1 -- 172.21.15.26:0/2467583888 reap_dead start 2024-04-21T08:57:55.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec0b59e640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7febf400b9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec0400a770 tx=0x7fec0401d2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba82149a7a5ff9b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0400a390 con 0x7febf40051d0 2024-04-21T08:57:55.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec040ac640 con 0x7febf40051d0 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec09d9b640 1 -- 172.21.15.26:0/2467583888 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec040aca30 con 0x7febf40051d0 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 -- 172.21.15.26:0/2467583888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 msgr2=0x7febf400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7febf400b9d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec0400a770 tx=0x7fec0401d2a0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 -- 172.21.15.26:0/2467583888 shutdown_connections 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 --2- 172.21.15.26:0/2467583888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7febf400b9d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 -- 172.21.15.26:0/2467583888 >> 172.21.15.26:0/2467583888 conn(0x7fec0c0702c0 msgr2=0x7fec0c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 -- 172.21.15.26:0/2467583888 shutdown_connections 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 -- 172.21.15.26:0/2467583888 wait complete. 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 Processor -- start 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.494+0000 7fec1104c640 1 -- start start 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7fec0c1eed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec0c14e090 0x7fec0c0c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec0c14c1d0 0x7fec0c14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c0c89d0 con 0x7febf40051d0 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c0c5cb0 con 0x7fec0c14e090 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fec0c151ff0 con 0x7fec0c14c1d0 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7fec0c1eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7fec0c1eed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54382/0 (socket says 172.21.15.26:54382) 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 -- 172.21.15.26:0/2205476687 learned_addr learned my addr 172.21.15.26:0/2205476687 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0a59c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec0c14e090 0x7fec0c0c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0b59e640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec0c14c1d0 0x7fec0c14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 -- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec0c14c1d0 msgr2=0x7fec0c14c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec0c14c1d0 0x7fec0c14c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 -- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec0c14e090 msgr2=0x7fec0c0c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec0c14e090 0x7fec0c0c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 -- 172.21.15.26:0/2205476687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c14d050 con 0x7febf40051d0 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec0ad9d640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7fec0c1eed40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febfc00e4b0 tx=0x7febfc00e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7febf37fe640 1 -- 172.21.15.26:0/2205476687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc0052e0 con 0x7febf40051d0 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7febf37fe640 1 -- 172.21.15.26:0/2205476687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7febfc018070 con 0x7febf40051d0 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7febf37fe640 1 -- 172.21.15.26:0/2205476687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febfc005480 con 0x7febf40051d0 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0c14d330 con 0x7febf40051d0 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0c14d8f0 con 0x7febf40051d0 2024-04-21T08:57:55.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0c074320 con 0x7febf40051d0 2024-04-21T08:57:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.498+0000 7febf37fe640 1 -- 172.21.15.26:0/2205476687 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7febfc003840 con 0x7febf40051d0 2024-04-21T08:57:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.502+0000 7febf37fe640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7febf80683b0 0x7febf806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.502+0000 7febf37fe640 1 -- 172.21.15.26:0/2205476687 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7febfc087120 con 0x7febf40051d0 2024-04-21T08:57:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.502+0000 7fec0a59c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7febf80683b0 0x7febf806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.502+0000 7fec0a59c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7febf80683b0 0x7febf806a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec0c14cfe0 tx=0x7fec00008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.506+0000 7febf37fe640 1 -- 172.21.15.26:0/2205476687 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7febfc057730 con 0x7febf40051d0 2024-04-21T08:57:55.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.666+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fec0c0c8c70 con 0x7febf40051d0 2024-04-21T08:57:55.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.666+0000 7febf37fe640 1 -- 172.21.15.26:0/2205476687 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7febfc057030 con 0x7febf40051d0 2024-04-21T08:57:55.670 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T08:57:55.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7febf80683b0 msgr2=0x7febf806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7febf80683b0 0x7febf806a870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fec0c14cfe0 tx=0x7fec00008040 comp rx=0 tx=0).stop 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 msgr2=0x7fec0c1eed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7fec0c1eed40 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7febfc00e4b0 tx=0x7febfc00e970 comp rx=0 tx=0).stop 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 shutdown_connections 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fec0c14c1d0 0x7fec0c14c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fec0c14e090 0x7fec0c0c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7febf80683b0 0x7febf806a870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 --2- 172.21.15.26:0/2205476687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7febf40051d0 0x7fec0c1eed40 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 >> 172.21.15.26:0/2205476687 conn(0x7fec0c0702c0 msgr2=0x7fec0c072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 shutdown_connections 2024-04-21T08:57:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.670+0000 7fec1104c640 1 -- 172.21.15.26:0/2205476687 wait complete. 2024-04-21T08:57:55.689 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:57:55.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd97cb16640 1 Processor -- start 2024-04-21T08:57:55.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd97cb16640 1 -- start start 2024-04-21T08:57:55.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd97cb16640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9780c5e30 0x7fd9781590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd97cb16640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd978159600 0x7fd978157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd97cb16640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd97815be10 con 0x7fd97815b320 2024-04-21T08:57:55.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd97cb16640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780c4c20 con 0x7fd9780c5e30 2024-04-21T08:57:55.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd97cb16640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fd9780c4f00 con 0x7fd978159600 2024-04-21T08:57:55.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd975d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9780c5e30 0x7fd9781590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd975d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd9780c5e30 0x7fd9781590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54390/0 (socket says 172.21.15.26:54390) 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd975d9b640 1 -- 172.21.15.26:0/3552419132 learned_addr learned my addr 172.21.15.26:0/3552419132 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd976d9d640 1 --2- 172.21.15.26:0/3552419132 >> v2:172.21.15.169:3300/0 conn(0x7fd978159600 0x7fd978157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd975d9b640 1 -- 172.21.15.26:0/3552419132 >> v2:172.21.15.169:3300/0 conn(0x7fd978159600 msgr2=0x7fd978157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd975d9b640 1 --2- 172.21.15.26:0/3552419132 >> v2:172.21.15.169:3300/0 conn(0x7fd978159600 0x7fd978157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd975d9b640 1 -- 172.21.15.26:0/3552419132 >> v1:172.21.15.169:6789/0 conn(0x7fd97815b320 legacy=0x7fd97815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd975d9b640 1 -- 172.21.15.26:0/3552419132 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9780c51e0 con 0x7fd9780c5e30 2024-04-21T08:57:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.806+0000 7fd976d9d640 1 --2- 172.21.15.26:0/3552419132 >> v2:172.21.15.169:3300/0 conn(0x7fd978159600 0x7fd978157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:55.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd975d9b640 1 --2- 172.21.15.26:0/3552419132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9781590c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd97806cbd0 tx=0x7fd96c0213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05488b01a644486 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97559a640 1 -- 172.21.15.26:0/3552419132 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0b6070 con 0x7fd9780c5e30 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97559a640 1 -- 172.21.15.26:0/3552419132 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd96c0b1600 con 0x7fd9780c5e30 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97559a640 1 -- 172.21.15.26:0/3552419132 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c0b19d0 con 0x7fd9780c5e30 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 -- 172.21.15.26:0/3552419132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 msgr2=0x7fd9781590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 --2- 172.21.15.26:0/3552419132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9781590c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd97806cbd0 tx=0x7fd96c0213a0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 -- 172.21.15.26:0/3552419132 shutdown_connections 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 --2- 172.21.15.26:0/3552419132 >> v2:172.21.15.169:3300/0 conn(0x7fd978159600 0x7fd978157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 --2- 172.21.15.26:0/3552419132 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9781590c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 -- 172.21.15.26:0/3552419132 >> 172.21.15.26:0/3552419132 conn(0x7fd9780c8960 msgr2=0x7fd9780c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:55.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 -- 172.21.15.26:0/3552419132 shutdown_connections 2024-04-21T08:57:55.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 -- 172.21.15.26:0/3552419132 wait complete. 2024-04-21T08:57:55.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.810+0000 7fd97cb16640 1 Processor -- start 2024-04-21T08:57:55.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 -- start start 2024-04-21T08:57:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9780714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd978159600 0x7fd978073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd97815b320 0x7fd97814c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd978159a10 con 0x7fd9780c5e30 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd9780c57a0 con 0x7fd97815b320 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd9780bfa30 con 0x7fd978159600 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9780714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9780714b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54400/0 (socket says 172.21.15.26:54400) 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 -- 172.21.15.26:0/538174547 learned_addr learned my addr 172.21.15.26:0/538174547 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd976d9d640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd97815b320 0x7fd97814c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd975d9b640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd978159600 0x7fd978073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 -- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd978159600 msgr2=0x7fd978073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd978159600 0x7fd978073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 -- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd97815b320 msgr2=0x7fd97814c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd97815b320 0x7fd97814c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 -- 172.21.15.26:0/538174547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97814e200 con 0x7fd9780c5e30 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd976d9d640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd97815b320 0x7fd97814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd975d9b640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd978159600 0x7fd978073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97659c640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9780714b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd96800b440 tx=0x7fd96800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd966ffd640 1 -- 172.21.15.26:0/538174547 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968015020 con 0x7fd9780c5e30 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd966ffd640 1 -- 172.21.15.26:0/538174547 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd968011890 con 0x7fd9780c5e30 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97814d6a0 con 0x7fd9780c5e30 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd966ffd640 1 -- 172.21.15.26:0/538174547 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd968011c80 con 0x7fd9780c5e30 2024-04-21T08:57:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97814dc40 con 0x7fd9780c5e30 2024-04-21T08:57:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd978075ef0 con 0x7fd9780c5e30 2024-04-21T08:57:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd966ffd640 1 -- 172.21.15.26:0/538174547 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd968018020 con 0x7fd9780c5e30 2024-04-21T08:57:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd966ffd640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd958068380 0x7fd95806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:55.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd966ffd640 1 -- 172.21.15.26:0/538174547 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd968086850 con 0x7fd9780c5e30 2024-04-21T08:57:55.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.814+0000 7fd975d9b640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd958068380 0x7fd95806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:55.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.818+0000 7fd975d9b640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd958068380 0x7fd95806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0b3000 tx=0x7fd96c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:55.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:55.822+0000 7fd966ffd640 1 -- 172.21.15.26:0/538174547 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd96801f030 con 0x7fd9780c5e30 2024-04-21T08:57:56.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.018+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd97806dfe0 con 0x7fd9780c5e30 2024-04-21T08:57:56.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.018+0000 7fd966ffd640 1 -- 172.21.15.26:0/538174547 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fd96800d040 con 0x7fd9780c5e30 2024-04-21T08:57:56.021 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:56.022 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T08:57:56.022 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd958068380 msgr2=0x7fd95806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd958068380 0x7fd95806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0b3000 tx=0x7fd96c008040 comp rx=0 tx=0).stop 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 msgr2=0x7fd9780714b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9780714b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd96800b440 tx=0x7fd96800b900 comp rx=0 tx=0).stop 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 shutdown_connections 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd97815b320 0x7fd97814c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd978159600 0x7fd978073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd958068380 0x7fd95806a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 --2- 172.21.15.26:0/538174547 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd9780c5e30 0x7fd9780714b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 >> 172.21.15.26:0/538174547 conn(0x7fd9780c8960 msgr2=0x7fd9780c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 shutdown_connections 2024-04-21T08:57:56.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.022+0000 7fd97cb16640 1 -- 172.21.15.26:0/538174547 wait complete. 2024-04-21T08:57:56.040 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:57:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 Processor -- start 2024-04-21T08:57:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 -- start start 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1aa0154eb0 0x7f1aa015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00c7680 0x7f1aa015ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1aa00cb120 0x7f1aa00d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa015e130 con 0x7f1aa00cb120 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa015f0c0 con 0x7f1aa0154eb0 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa8659640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa015b3a0 con 0x7f1aa00c7680 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1aa00cb120 0x7f1aa00d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1aa00cb120 0x7f1aa00d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54416/0 (socket says 172.21.15.26:54416) 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 -- 172.21.15.26:0/4212362959 learned_addr learned my addr 172.21.15.26:0/4212362959 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa5bf4640 1 --2- 172.21.15.26:0/4212362959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00c7680 0x7f1aa015ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa63f5640 1 --2- 172.21.15.26:0/4212362959 >> v2:172.21.15.169:3300/0 conn(0x7f1aa0154eb0 0x7f1aa015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 -- 172.21.15.26:0/4212362959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00c7680 msgr2=0x7f1aa015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:56.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 --2- 172.21.15.26:0/4212362959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00c7680 0x7f1aa015ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 -- 172.21.15.26:0/4212362959 >> v2:172.21.15.169:3300/0 conn(0x7f1aa0154eb0 msgr2=0x7f1aa015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:56.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 --2- 172.21.15.26:0/4212362959 >> v2:172.21.15.169:3300/0 conn(0x7f1aa0154eb0 0x7f1aa015eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.166+0000 7f1aa6bf6640 1 -- 172.21.15.26:0/4212362959 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa015b680 con 0x7f1aa00cb120 2024-04-21T08:57:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa6bf6640 1 --2- 172.21.15.26:0/4212362959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00cb120 0x7f1aa00d01e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00d1380 tx=0x7f1a9801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e19457161d8f0e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa53f3640 1 -- 172.21.15.26:0/4212362959 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a980a5670 con 0x7f1aa00cb120 2024-04-21T08:57:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa53f3640 1 -- 172.21.15.26:0/4212362959 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a980a5810 con 0x7f1aa00cb120 2024-04-21T08:57:56.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa53f3640 1 -- 172.21.15.26:0/4212362959 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a980a5be0 con 0x7f1aa00cb120 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 -- 172.21.15.26:0/4212362959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00cb120 msgr2=0x7f1aa00d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 --2- 172.21.15.26:0/4212362959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00cb120 0x7f1aa00d01e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00d1380 tx=0x7f1a9801c9f0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 -- 172.21.15.26:0/4212362959 shutdown_connections 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 --2- 172.21.15.26:0/4212362959 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00cb120 0x7f1aa00d01e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 --2- 172.21.15.26:0/4212362959 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00c7680 0x7f1aa015ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 --2- 172.21.15.26:0/4212362959 >> v2:172.21.15.169:3300/0 conn(0x7f1aa0154eb0 0x7f1aa015eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 -- 172.21.15.26:0/4212362959 >> 172.21.15.26:0/4212362959 conn(0x7f1aa006dea0 msgr2=0x7f1aa006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 -- 172.21.15.26:0/4212362959 shutdown_connections 2024-04-21T08:57:56.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.170+0000 7f1aa8659640 1 -- 172.21.15.26:0/4212362959 wait complete. 2024-04-21T08:57:56.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 Processor -- start 2024-04-21T08:57:56.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 -- start start 2024-04-21T08:57:56.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00c7680 0x7f1aa00c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00cb120 0x7f1aa0159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0154eb0 0x7f1aa0159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa0155290 con 0x7f1aa00c7680 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa015b0c0 con 0x7f1aa0154eb0 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa00cb970 con 0x7f1aa00cb120 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00c7680 0x7f1aa00c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00c7680 0x7f1aa00c5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54422/0 (socket says 172.21.15.26:54422) 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 -- 172.21.15.26:0/1606174720 learned_addr learned my addr 172.21.15.26:0/1606174720 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa6bf6640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0154eb0 0x7f1aa0159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa5bf4640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00cb120 0x7f1aa0159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 -- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00cb120 msgr2=0x7f1aa0159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00cb120 0x7f1aa0159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 -- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0154eb0 msgr2=0x7f1aa0159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0154eb0 0x7f1aa0159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 -- 172.21.15.26:0/1606174720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa015ae10 con 0x7f1aa00c7680 2024-04-21T08:57:56.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa63f5640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00c7680 0x7f1aa00c5f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00d620 tx=0x7f1a9c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:56.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1a96ffd640 1 -- 172.21.15.26:0/1606174720 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00b620 con 0x7f1aa00c7680 2024-04-21T08:57:56.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1a96ffd640 1 -- 172.21.15.26:0/1606174720 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a9c019070 con 0x7f1aa00c7680 2024-04-21T08:57:56.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa01541a0 con 0x7f1aa00c7680 2024-04-21T08:57:56.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1a96ffd640 1 -- 172.21.15.26:0/1606174720 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00b9e0 con 0x7f1aa00c7680 2024-04-21T08:57:56.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa0149e70 con 0x7f1aa00c7680 2024-04-21T08:57:56.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa0075ef0 con 0x7f1aa00c7680 2024-04-21T08:57:56.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1a96ffd640 1 -- 172.21.15.26:0/1606174720 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a9c00bb80 con 0x7f1aa00c7680 2024-04-21T08:57:56.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1a96ffd640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a84068380 0x7f1a8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.174+0000 7f1a96ffd640 1 -- 172.21.15.26:0/1606174720 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1a9c086d50 con 0x7f1aa00c7680 2024-04-21T08:57:56.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.178+0000 7f1aa5bf4640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a84068380 0x7f1a8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.178+0000 7f1aa5bf4640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a84068380 0x7f1a8406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1aa015a580 tx=0x7f1a90008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:56.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.182+0000 7f1a96ffd640 1 -- 172.21.15.26:0/1606174720 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1a9c08a030 con 0x7f1aa00c7680 2024-04-21T08:57:56.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.338+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1aa00b5e40 con 0x7f1aa00c7680 2024-04-21T08:57:56.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1a96ffd640 1 -- 172.21.15.26:0/1606174720 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7f1a9c057310 con 0x7f1aa00c7680 2024-04-21T08:57:56.343 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:56.343 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a84068380 msgr2=0x7f1a8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a84068380 0x7f1a8406a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1aa015a580 tx=0x7f1a90008040 comp rx=0 tx=0).stop 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00c7680 msgr2=0x7f1aa00c5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00c7680 0x7f1aa00c5f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c00d620 tx=0x7f1a9c00dae0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 shutdown_connections 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aa0154eb0 0x7f1aa0159f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aa00cb120 0x7f1aa0159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a84068380 0x7f1a8406a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 --2- 172.21.15.26:0/1606174720 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1aa00c7680 0x7f1aa00c5f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 >> 172.21.15.26:0/1606174720 conn(0x7f1aa006dea0 msgr2=0x7f1aa0151320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 shutdown_connections 2024-04-21T08:57:56.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.342+0000 7f1aa8659640 1 -- 172.21.15.26:0/1606174720 wait complete. 2024-04-21T08:57:56.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.478+0000 7f4d13737640 1 Processor -- start 2024-04-21T08:57:56.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d13737640 1 -- start start 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d13737640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 0x7f4d0c0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d13737640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4d0c0c5bc0 0x7f4d0c0c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d13737640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0c0c96e0 con 0x7f4d0c154e90 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d13737640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0c0c9980 con 0x7f4d0c0c5bc0 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d13737640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c6050 con 0x7f4d0c0c6260 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d114d3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d0c154e90 0x7f4d0c0c67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42504/0 (socket says 172.21.15.26:42504) 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d114d3640 1 -- 172.21.15.26:0/3379020731 learned_addr learned my addr 172.21.15.26:0/3379020731 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:57:56.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d10cd2640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 0x7f4d0c0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d11cd4640 1 --2- 172.21.15.26:0/3379020731 >> v2:172.21.15.169:3300/0 conn(0x7f4d0c0c5bc0 0x7f4d0c0c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502915860 0 0) 0x7f4d0c0c96e0 con 0x7f4d0c154e90 2024-04-21T08:57:56.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf8003530 con 0x7f4d0c154e90 2024-04-21T08:57:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4197625567 0 0) 0x7f4cf8003530 con 0x7f4d0c154e90 2024-04-21T08:57:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 msgr2=0x7f4d0c0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:56.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 0x7f4d0c0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 >> v2:172.21.15.169:3300/0 conn(0x7f4d0c0c5bc0 msgr2=0x7f4d0c0c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 --2- 172.21.15.26:0/3379020731 >> v2:172.21.15.169:3300/0 conn(0x7f4d0c0c5bc0 0x7f4d0c0c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c15b7b0 con 0x7f4d0c154e90 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f4d08001a00 con 0x7f4d0c154e90 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 >> v1:172.21.15.26:6789/0 conn(0x7f4d0c154e90 legacy=0x7f4d0c0c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 0x7f4cf80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cf8003f40 0x7f4cf8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf8004d50 0x7f4cf80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf800b9d0 con 0x7f4cf8004d50 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf800bb50 con 0x7f4cf8003f40 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf800bcd0 con 0x7f4d0c0c6260 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d11cd4640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf8004d50 0x7f4cf80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d10cd2640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cf8003f40 0x7f4cf8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d114d3640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 0x7f4cf80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d11cd4640 1 -- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 msgr2=0x7f4cf80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d11cd4640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c0c6260 0x7f4cf80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d11cd4640 1 -- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cf8003f40 msgr2=0x7f4cf8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d11cd4640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4cf8003f40 0x7f4cf8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.482+0000 7f4d11cd4640 1 -- 172.21.15.26:0/3379020731 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf8003530 con 0x7f4cf8004d50 2024-04-21T08:57:56.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d11cd4640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf8004d50 0x7f4cf80051d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009ae0 tx=0x7f4d0401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120621b25904693d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040b2070 con 0x7f4cf8004d50 2024-04-21T08:57:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d040a56a0 con 0x7f4cf8004d50 2024-04-21T08:57:56.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d03fff640 1 -- 172.21.15.26:0/3379020731 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d040096b0 con 0x7f4cf8004d50 2024-04-21T08:57:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d13737640 1 -- 172.21.15.26:0/3379020731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf8004d50 msgr2=0x7f4cf80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d13737640 1 --2- 172.21.15.26:0/3379020731 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4cf8004d50 0x7f4cf80051d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009ae0 tx=0x7f4d0401ca50 comp rx=0 tx=0).stop 2024-04-21T08:57:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d11cd4640 1 -- 172.21.15.26:0/3379020731 reap_dead start 2024-04-21T08:57:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d13737640 1 -- 172.21.15.26:0/3379020731 shutdown_connections 2024-04-21T08:57:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d13737640 1 -- 172.21.15.26:0/3379020731 >> 172.21.15.26:0/3379020731 conn(0x7f4d0c0725c0 msgr2=0x7f4d0c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d13737640 1 -- 172.21.15.26:0/3379020731 shutdown_connections 2024-04-21T08:57:56.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.486+0000 7f4d13737640 1 -- 172.21.15.26:0/3379020731 wait complete. 2024-04-21T08:57:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 Processor -- start 2024-04-21T08:57:56.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 -- start start 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c157ea0 0x7f4d0c1f0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c155570 0x7f4d0c1f15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d0c158280 0x7f4d0c154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c53c0 con 0x7f4d0c155570 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c50e0 con 0x7f4d0c158280 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0c0c56a0 con 0x7f4d0c157ea0 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c155570 0x7f4d0c1f15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c155570 0x7f4d0c1f15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54434/0 (socket says 172.21.15.26:54434) 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 -- 172.21.15.26:0/4046150680 learned_addr learned my addr 172.21.15.26:0/4046150680 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d114d3640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c157ea0 0x7f4d0c1f0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d11cd4640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d0c158280 0x7f4d0c154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 -- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c157ea0 msgr2=0x7f4d0c1f0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c157ea0 0x7f4d0c1f0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 -- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d0c158280 msgr2=0x7f4d0c154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d0c158280 0x7f4d0c154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 -- 172.21.15.26:0/4046150680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0c1f1b20 con 0x7f4d0c155570 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d10cd2640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c155570 0x7f4d0c1f15e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc011a00 tx=0x7f4cfc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d01ffb640 1 -- 172.21.15.26:0/4046150680 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00fb50 con 0x7f4d0c155570 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d01ffb640 1 -- 172.21.15.26:0/4046150680 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc00fcf0 con 0x7f4d0c155570 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d0c155a20 con 0x7f4d0c155570 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d01ffb640 1 -- 172.21.15.26:0/4046150680 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc00fea0 con 0x7f4d0c155570 2024-04-21T08:57:56.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0c155fe0 con 0x7f4d0c155570 2024-04-21T08:57:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0c075ef0 con 0x7f4d0c155570 2024-04-21T08:57:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.490+0000 7f4d01ffb640 1 -- 172.21.15.26:0/4046150680 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4cfc012040 con 0x7f4d0c155570 2024-04-21T08:57:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.494+0000 7f4d01ffb640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4cf00683b0 0x7f4cf006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.494+0000 7f4d01ffb640 1 -- 172.21.15.26:0/4046150680 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4cfc087080 con 0x7f4d0c155570 2024-04-21T08:57:56.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.494+0000 7f4d114d3640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4cf00683b0 0x7f4cf006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:56.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.494+0000 7f4d114d3640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4cf00683b0 0x7f4cf006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d080072b0 tx=0x7f4d08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:56.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.498+0000 7f4d01ffb640 1 -- 172.21.15.26:0/4046150680 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4cfc019030 con 0x7f4d0c155570 2024-04-21T08:57:56.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.686+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d0c0c4b60 con 0x7f4d0c155570 2024-04-21T08:57:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.686+0000 7f4d01ffb640 1 -- 172.21.15.26:0/4046150680 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f4cfc057700 con 0x7f4d0c155570 2024-04-21T08:57:56.690 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:57:56.690 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T08:57:56.690 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4cf00683b0 msgr2=0x7f4cf006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4cf00683b0 0x7f4cf006a870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4d080072b0 tx=0x7f4d08009040 comp rx=0 tx=0).stop 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c155570 msgr2=0x7f4d0c1f15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c155570 0x7f4d0c1f15e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc011a00 tx=0x7f4cfc011ec0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 shutdown_connections 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d0c158280 0x7f4d0c154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4cf00683b0 0x7f4cf006a870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d0c155570 0x7f4d0c1f15e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 --2- 172.21.15.26:0/4046150680 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d0c157ea0 0x7f4d0c1f0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 >> 172.21.15.26:0/4046150680 conn(0x7f4d0c0725c0 msgr2=0x7f4d0c0cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 shutdown_connections 2024-04-21T08:57:56.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:56.690+0000 7f4d13737640 1 -- 172.21.15.26:0/4046150680 wait complete. 2024-04-21T08:57:57.312 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-21T08:57:43.594557+0000', 'modified': '2024-04-21T08:57:50.320200+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.169:6839/4294502436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6837', 'nonce': 4294502436}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 4294502436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-04-21T08:57:57.312 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-21T08:57:57.313 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-21T08:57:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.442+0000 7fe021457640 1 Processor -- start 2024-04-21T08:57:57.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.442+0000 7fe021457640 1 -- start start 2024-04-21T08:57:57.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe01c158810 0x7fe01c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe01c0c71d0 0x7fe01c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe01c0c9980 con 0x7fe01c158810 2024-04-21T08:57:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fe01c0c6f90 con 0x7fe01c0c71d0 2024-04-21T08:57:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe01c0c6cb0 con 0x7fe01c0c4510 2024-04-21T08:57:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe01c158810 0x7fe01c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe01c158810 0x7fe01c158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54440/0 (socket says 172.21.15.26:54440) 2024-04-21T08:57:57.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 -- 172.21.15.26:0/1313713567 learned_addr learned my addr 172.21.15.26:0/1313713567 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/1313713567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/1313713567 >> v2:172.21.15.169:3300/0 conn(0x7fe01c0c71d0 0x7fe01c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 -- 172.21.15.26:0/1313713567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 msgr2=0x7fe01c0c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 --2- 172.21.15.26:0/1313713567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c0c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 -- 172.21.15.26:0/1313713567 >> v2:172.21.15.169:3300/0 conn(0x7fe01c0c71d0 msgr2=0x7fe01c0c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 --2- 172.21.15.26:0/1313713567 >> v2:172.21.15.169:3300/0 conn(0x7fe01c0c71d0 0x7fe01c0c5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 -- 172.21.15.26:0/1313713567 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c0c83c0 con 0x7fe01c158810 2024-04-21T08:57:57.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/1313713567 >> v2:172.21.15.169:3300/0 conn(0x7fe01c0c71d0 0x7fe01c0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe01affd640 1 --2- 172.21.15.26:0/1313713567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c158810 0x7fe01c158fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00d150 tx=0x7fe00c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b616c3de48db3b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe019ffb640 1 -- 172.21.15.26:0/1313713567 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00b2d0 con 0x7fe01c158810 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe019ffb640 1 -- 172.21.15.26:0/1313713567 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c00b470 con 0x7fe01c158810 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe019ffb640 1 -- 172.21.15.26:0/1313713567 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0a7aa0 con 0x7fe01c158810 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- 172.21.15.26:0/1313713567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c158810 msgr2=0x7fe01c158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 --2- 172.21.15.26:0/1313713567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c158810 0x7fe01c158fd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00d150 tx=0x7fe00c01ebf0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- 172.21.15.26:0/1313713567 shutdown_connections 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 --2- 172.21.15.26:0/1313713567 >> v2:172.21.15.169:3300/0 conn(0x7fe01c0c71d0 0x7fe01c0c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 --2- 172.21.15.26:0/1313713567 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c0c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 --2- 172.21.15.26:0/1313713567 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c158810 0x7fe01c158fd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- 172.21.15.26:0/1313713567 >> 172.21.15.26:0/1313713567 conn(0x7fe01c0725c0 msgr2=0x7fe01c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- 172.21.15.26:0/1313713567 shutdown_connections 2024-04-21T08:57:57.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.446+0000 7fe021457640 1 -- 172.21.15.26:0/1313713567 wait complete. 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 Processor -- start 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 -- start start 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c073430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c0c71d0 0x7fe01c14d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe01c158810 0x7fe01c1f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c06cdc0 con 0x7fe01c0c71d0 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c06cc40 con 0x7fe01c158810 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe01c0c9560 con 0x7fe01c0c4510 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c0c71d0 0x7fe01c14d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c0c71d0 0x7fe01c14d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54450/0 (socket says 172.21.15.26:54450) 2024-04-21T08:57:57.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3813467360 learned_addr learned my addr 172.21.15.26:0/3813467360 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe01c158810 0x7fe01c1f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01affd640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 msgr2=0x7fe01c073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c073430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe01c158810 msgr2=0x7fe01c1f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe01c158810 0x7fe01c1f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3813467360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe01c14df90 con 0x7fe01c0c71d0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c0c71d0 0x7fe01c14d500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe01000d800 tx=0x7fe01000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe0037fe640 1 -- 172.21.15.26:0/3813467360 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010004030 con 0x7fe01c0c71d0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe0037fe640 1 -- 172.21.15.26:0/3813467360 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0100041d0 con 0x7fe01c0c71d0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe01c14e270 con 0x7fe01c0c71d0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe0037fe640 1 -- 172.21.15.26:0/3813467360 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0100096a0 con 0x7fe01c0c71d0 2024-04-21T08:57:57.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.450+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe01c14e830 con 0x7fe01c0c71d0 2024-04-21T08:57:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0037fe640 1 -- 172.21.15.26:0/3813467360 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe010009840 con 0x7fe01c0c71d0 2024-04-21T08:57:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0037fe640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0080683b0 0x7fe00806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0037fe640 1 -- 172.21.15.26:0/3813467360 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe010086c20 con 0x7fe01c0c71d0 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0080683b0 0x7fe00806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 Processor -- start 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- start start 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0080683b0 0x7fe00806a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0b0000 tx=0x7fe00c0a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87190 0x558a6aa87570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aac2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aac25c0 0x558a6aac29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558a6a8d0420 con 0x558a6aa87190 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558a6a86abf0 con 0x558a6aac25c0 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558a6a8cc3e0 con 0x558a6aa87ab0 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87190 0x558a6aa87570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87190 0x558a6aa87570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54460/0 (socket says 172.21.15.26:54460) 2024-04-21T08:57:57.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 -- 172.21.15.26:0/374910413 learned_addr learned my addr 172.21.15.26:0/374910413 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aac25c0 0x558a6aac29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aac2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 -- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 msgr2=0x558a6aac2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aac2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 -- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aac25c0 msgr2=0x558a6aac29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aac25c0 0x558a6aac29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 -- 172.21.15.26:0/374910413 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6a978450 con 0x558a6aa87190 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aac25c0 0x558a6aac29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aac2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe01affd640 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87190 0x558a6aa87570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00bea0 tx=0x7fe00c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be6b3dc9eba7328 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe000ff9640 1 -- 172.21.15.26:0/374910413 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0c9070 con 0x558a6aa87190 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe000ff9640 1 -- 172.21.15.26:0/374910413 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0a7a80 con 0x558a6aa87190 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe000ff9640 1 -- 172.21.15.26:0/374910413 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0a7e30 con 0x558a6aa87190 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- 172.21.15.26:0/374910413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87190 msgr2=0x558a6aa87570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87190 0x558a6aa87570 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00bea0 tx=0x7fe00c004ac0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- 172.21.15.26:0/374910413 shutdown_connections 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aac25c0 0x558a6aac29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aac2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 --2- 172.21.15.26:0/374910413 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87190 0x558a6aa87570 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- 172.21.15.26:0/374910413 >> 172.21.15.26:0/374910413 conn(0x558a6aabee40 msgr2=0x558a6aac1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- 172.21.15.26:0/374910413 shutdown_connections 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.454+0000 7fe0245d9000 1 -- 172.21.15.26:0/374910413 wait complete. 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 -- start start 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 Processor -- start 2024-04-21T08:57:57.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aa83ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87ab0 0x558a6aa840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aac25c0 0x558a6aa84620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558a6a870ec0 con 0x558a6aa87ab0 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558a6a951120 con 0x558a6aa87190 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558a6a8db350 con 0x558a6aac25c0 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 10 client.0 _ll_register_callbacks cb 0x558a6a8ad4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87ab0 0x558a6aa840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87ab0 0x558a6aa840e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54476/0 (socket says 172.21.15.26:54476) 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3406486283 learned_addr learned my addr 172.21.15.26:0/3406486283 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01affd640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aa83ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aac25c0 0x558a6aa84620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aac25c0 msgr2=0x558a6aa84620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aac25c0 0x558a6aa84620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 msgr2=0x558a6aa83ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aa83ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 -- 172.21.15.26:0/3406486283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6a915f80 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01affd640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aa83ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87ab0 0x558a6aa840e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe01000d7d0 tx=0x7fe010056cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77db4a4ddc6b27bc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fdff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fdff9ffb640 1 -- 172.21.15.26:0/3406486283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe010083060 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe00c0a7a80 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fdff9ffb640 1 -- 172.21.15.26:0/3406486283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe01007eb40 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fdff9ffb640 1 -- 172.21.15.26:0/3406486283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fe01006f070 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 10 client.4626 fetch_fsmap learned FSMap version 8 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558a6a8a9f00 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fdff9ffb640 1 -- 172.21.15.26:0/3406486283 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe00c0a7a80 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fdff9ffb640 1 -- 172.21.15.26:0/3406486283 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fe010013070 con 0x558a6aa87ab0 2024-04-21T08:57:57.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 10 client.4626 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 20 client.4626 populate_metadata read hostname 'smithi026' 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6aad6d90 0x558a6aad9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 4 client.4626 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558a6a869bc0 con 0x558a6aad6d90 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01affd640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6aad6d90 0x558a6aad9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fe01affd640 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6aad6d90 0x558a6aad9180 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27fd92d8d171e866 server_cookie=7181e8194953e08c in_seq=0 out_seq=0 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.458+0000 7fdff9ffb640 10 client.4626 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fdff9ffb640 1 -- 172.21.15.26:0/3406486283 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558a6a869bc0 con 0x558a6aad6d90 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fdff9ffb640 10 client.4626 handle_command_reply: tid=0 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 client.4626 shutdown 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87ab0 msgr2=0x558a6aa840e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87ab0 0x558a6aa840e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe01000d7d0 tx=0x7fe010056cb0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 shutdown_connections 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6aad6d90 0x558a6aad9180 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aac25c0 0x558a6aa84620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aa87ab0 0x558a6aa840e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 --2- 172.21.15.26:0/3406486283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aa83ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fdff9ffb640 0 client.4626 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 >> 172.21.15.26:0/3406486283 conn(0x558a6aabee40 msgr2=0x558a6aac01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 shutdown_connections 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 1 -- 172.21.15.26:0/3406486283 wait complete. 2024-04-21T08:57:57.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.462+0000 7fe0245d9000 20 client.4626 trim_cache size 0 max 16384 2024-04-21T08:57:57.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 Processor -- start 2024-04-21T08:57:57.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- start start 2024-04-21T08:57:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aabce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aabd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6aad9180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1ff6b0 con 0x558a6aac25c0 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe01c1574a0 con 0x558a6aa87190 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe01c157af0 con 0x558a6aa87ab0 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6aad9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6aad9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54488/0 (socket says 172.21.15.26:54488) 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 -- 172.21.15.26:0/2426525290 learned_addr learned my addr 172.21.15.26:0/2426525290 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aabd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01affd640 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aabce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 -- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 msgr2=0x558a6aabd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aabd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 -- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 msgr2=0x558a6aabce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aabce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 -- 172.21.15.26:0/2426525290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558a6a856e80 con 0x558a6aac25c0 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aabd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6aad9180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe01400e9f0 tx=0x7fe01400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c12571fbfe3502b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fdffbfff640 1 -- 172.21.15.26:0/2426525290 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014010b00 con 0x558a6aac25c0 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fdffbfff640 1 -- 172.21.15.26:0/2426525290 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe014010cc0 con 0x558a6aac25c0 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fdffbfff640 1 -- 172.21.15.26:0/2426525290 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014014690 con 0x558a6aac25c0 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- 172.21.15.26:0/2426525290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 msgr2=0x558a6aad9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6aad9180 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe01400e9f0 tx=0x7fe01400eeb0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- 172.21.15.26:0/2426525290 shutdown_connections 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6aad9180 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6aabd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 --2- 172.21.15.26:0/2426525290 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aabce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- 172.21.15.26:0/2426525290 >> 172.21.15.26:0/2426525290 conn(0x558a6aabee40 msgr2=0x558a6aa80cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- 172.21.15.26:0/2426525290 shutdown_connections 2024-04-21T08:57:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- 172.21.15.26:0/2426525290 wait complete. 2024-04-21T08:57:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 -- start start 2024-04-21T08:57:57.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.482+0000 7fe0245d9000 1 Processor -- start 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aadb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6ab00590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6ab00ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558a6a8cf730 con 0x558a6aac25c0 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558a6a89c9e0 con 0x558a6aa87190 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558a6a8d4a50 con 0x558a6aa87ab0 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 10 client.0 _ll_register_callbacks cb 0x7fe010057300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6ab00ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6ab00ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54490/0 (socket says 172.21.15.26:54490) 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 -- 172.21.15.26:0/495567513 learned_addr learned my addr 172.21.15.26:0/495567513 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01a7fc640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6ab00590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01affd640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aadb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 -- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 msgr2=0x558a6ab00590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6ab00590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 -- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 msgr2=0x558a6aadb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aadb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 -- 172.21.15.26:0/495567513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558a6a898b30 con 0x558a6aac25c0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01affd640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aadb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01b7fe640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6ab00ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe01400eef0 tx=0x7fe014004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c073665a2ebef9e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 1 -- 172.21.15.26:0/495567513 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe014003a30 con 0x558a6aac25c0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 1 -- 172.21.15.26:0/495567513 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe014003bd0 con 0x558a6aac25c0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe014010cc0 con 0x558a6aac25c0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 1 -- 172.21.15.26:0/495567513 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fe01402f050 con 0x558a6aac25c0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 10 client.4632 fetch_fsmap learned FSMap version 8 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558a6a9515b0 con 0x558a6aac25c0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 1 -- 172.21.15.26:0/495567513 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe014010cc0 con 0x558a6aac25c0 2024-04-21T08:57:57.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 1 -- 172.21.15.26:0/495567513 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fe014032020 con 0x558a6aac25c0 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 10 client.4632 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 20 client.4632 populate_metadata read hostname 'smithi026' 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6ab3f980 0x558a6ab3fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 4 client.4632 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "status"}) -- 0x558a6a8dde40 con 0x558a6ab3f980 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01affd640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6ab3f980 0x558a6ab3fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe01affd640 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6ab3f980 0x558a6ab3fd60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89adcb59bb4ded23 server_cookie=80d8dece38b62141 in_seq=0 out_seq=0 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 10 client.4632 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 1 -- 172.21.15.26:0/495567513 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x558a6a8dde40 con 0x558a6ab3f980 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 10 client.4632 handle_command_reply: tid=0 2024-04-21T08:57:57.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 client.4632 shutdown 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 msgr2=0x558a6ab00ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6ab00ad0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe01400eef0 tx=0x7fe014004740 comp rx=0 tx=0).stop 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 shutdown_connections 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558a6ab3f980 0x558a6ab3fd60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558a6aac25c0 0x558a6ab00ad0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558a6aa87ab0 0x558a6ab00590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 --2- 172.21.15.26:0/495567513 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558a6aa87190 0x558a6aadb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 >> 172.21.15.26:0/495567513 conn(0x558a6aabee40 msgr2=0x558a6aabc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fdff9ffb640 0 client.4632 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 shutdown_connections 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 1 -- 172.21.15.26:0/495567513 wait complete. 2024-04-21T08:57:57.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe0245d9000 20 client.4632 trim_cache size 0 max 16384 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "c3cab1f1-d502-48e1-871b-caee77004426", 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4279, 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 13.190781109, 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 21, 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 21, 2024-04-21T08:57:57.496 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 20.084502412999999 2024-04-21T08:57:57.497 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T08:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0080683b0 msgr2=0x7fe00806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0080683b0 0x7fe00806a870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe00c0b0000 tx=0x7fe00c0a9070 comp rx=0 tx=0).stop 2024-04-21T08:57:57.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c0c71d0 msgr2=0x7fe01c14d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c0c71d0 0x7fe01c14d500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe01000d800 tx=0x7fe01000dcc0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 shutdown_connections 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe01c158810 0x7fe01c1f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe0080683b0 0x7fe00806a870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe01c0c71d0 0x7fe01c14d500 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 --2- 172.21.15.26:0/3813467360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe01c0c4510 0x7fe01c073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 >> 172.21.15.26:0/3813467360 conn(0x7fe01c0725c0 msgr2=0x7fe01c15a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.486+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 shutdown_connections 2024-04-21T08:57:57.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.490+0000 7fe021457640 1 -- 172.21.15.26:0/3813467360 wait complete. 2024-04-21T08:57:57.506 INFO:teuthology.run_tasks:Running task sequential... 2024-04-21T08:57:57.517 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-21T08:57:57.518 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-21T08:57:57.518 INFO:teuthology.task.print:Enabling mgr modules 2024-04-21T08:57:57.518 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-21T08:57:57.541 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-21T08:57:57.541 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-21T08:57:57.541 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-21T08:57:57.541 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-21T08:57:57.542 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-21T08:57:57.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:57.542 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-21T08:57:57.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:57.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-04-21T08:57:57.604 INFO:teuthology.orchestra.run.smithi026.stderr:Cannot find device "ceph-brx" 2024-04-21T08:57:57.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T08:57:57.606 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-21T08:57:57.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-21T08:57:57.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f68bb8640 1 Processor -- start 2024-04-21T08:57:57.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f68bb8640 1 -- start start 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f68bb8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f64154eb0 0x7f0f6415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f68bb8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f640cb120 0x7f0f640d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f68bb8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f6415b3a0 con 0x7f0f640c7680 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f68bb8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f0f6415e130 con 0x7f0f640cb120 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f68bb8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6415f0c0 con 0x7f0f64154eb0 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f640cb120 0x7f0f640d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f640cb120 0x7f0f640d01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56960/0 (socket says 172.21.15.26:56960) 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 -- 172.21.15.26:0/486613887 learned_addr learned my addr 172.21.15.26:0/486613887 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f6259c640 1 --2- 172.21.15.26:0/486613887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f64154eb0 0x7f0f6415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 -- 172.21.15.26:0/486613887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f64154eb0 msgr2=0x7f0f6415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 --2- 172.21.15.26:0/486613887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f64154eb0 0x7f0f6415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 -- 172.21.15.26:0/486613887 >> v1:172.21.15.169:6789/0 conn(0x7f0f640c7680 legacy=0x7f0f6415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:57:57.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 -- 172.21.15.26:0/486613887 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6415b680 con 0x7f0f640cb120 2024-04-21T08:57:57.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f62d9d640 1 --2- 172.21.15.26:0/486613887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f640cb120 0x7f0f640d01e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009e50 tx=0x7f0f5c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69902c424a54459a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f6159a640 1 -- 172.21.15.26:0/486613887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a5670 con 0x7f0f640cb120 2024-04-21T08:57:57.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f6159a640 1 -- 172.21.15.26:0/486613887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0a5810 con 0x7f0f640cb120 2024-04-21T08:57:57.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.774+0000 7f0f6159a640 1 -- 172.21.15.26:0/486613887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a5be0 con 0x7f0f640cb120 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- 172.21.15.26:0/486613887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f640cb120 msgr2=0x7f0f640d01e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/486613887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f640cb120 0x7f0f640d01e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009e50 tx=0x7f0f5c01c9f0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- 172.21.15.26:0/486613887 shutdown_connections 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/486613887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f640cb120 0x7f0f640d01e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/486613887 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f64154eb0 0x7f0f6415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- 172.21.15.26:0/486613887 >> 172.21.15.26:0/486613887 conn(0x7f0f6406dea0 msgr2=0x7f0f6406e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- 172.21.15.26:0/486613887 shutdown_connections 2024-04-21T08:57:57.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- 172.21.15.26:0/486613887 wait complete. 2024-04-21T08:57:57.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 Processor -- start 2024-04-21T08:57:57.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- start start 2024-04-21T08:57:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f640c7680 0x7f0f6415d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640cb120 0x7f0f641f3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f64154eb0 0x7f0f6415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0f640cb970 con 0x7f0f64154eb0 2024-04-21T08:57:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0f64155290 con 0x7f0f640c7680 2024-04-21T08:57:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0f640cbaf0 con 0x7f0f640cb120 2024-04-21T08:57:57.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f64154eb0 0x7f0f6415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f64154eb0 0x7f0f6415bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56968/0 (socket says 172.21.15.26:56968) 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 -- 172.21.15.26:0/773098079 learned_addr learned my addr 172.21.15.26:0/773098079 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f61d9b640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640cb120 0x7f0f641f3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f6259c640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f640c7680 0x7f0f6415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 -- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640cb120 msgr2=0x7f0f641f3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640cb120 0x7f0f641f3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 -- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f640c7680 msgr2=0x7f0f6415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f640c7680 0x7f0f6415d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 -- 172.21.15.26:0/773098079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f640d0fc0 con 0x7f0f64154eb0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f6259c640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f640c7680 0x7f0f6415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f62d9d640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f64154eb0 0x7f0f6415bd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0af040 tx=0x7f0f5c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f52ffd640 1 -- 172.21.15.26:0/773098079 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c009510 con 0x7f0f64154eb0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f52ffd640 1 -- 172.21.15.26:0/773098079 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0be070 con 0x7f0f64154eb0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f64159400 con 0x7f0f64154eb0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f52ffd640 1 -- 172.21.15.26:0/773098079 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0b8890 con 0x7f0f64154eb0 2024-04-21T08:57:57.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.778+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6415d470 con 0x7f0f64154eb0 2024-04-21T08:57:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.782+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f64075ef0 con 0x7f0f64154eb0 2024-04-21T08:57:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.782+0000 7f0f52ffd640 1 -- 172.21.15.26:0/773098079 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f5c0b8a30 con 0x7f0f64154eb0 2024-04-21T08:57:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.782+0000 7f0f52ffd640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0f44068380 0x7f0f4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:57:57.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.782+0000 7f0f52ffd640 1 -- 172.21.15.26:0/773098079 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f5c1219c0 con 0x7f0f64154eb0 2024-04-21T08:57:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.782+0000 7f0f6259c640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0f44068380 0x7f0f4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:57:57.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.782+0000 7f0f6259c640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0f44068380 0x7f0f4406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400b9f0 tx=0x7f0f54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:57:57.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.786+0000 7f0f52ffd640 1 -- 172.21.15.26:0/773098079 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0f5c123e20 con 0x7f0f64154eb0 2024-04-21T08:57:57.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.986+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0f640cf350 con 0x7f0f64154eb0 2024-04-21T08:57:57.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.986+0000 7f0f52ffd640 1 -- 172.21.15.26:0/773098079 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+73 (secure 0 0 0) 0x7f0f5c0165e0 con 0x7f0f64154eb0 2024-04-21T08:57:57.989 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-21T08:57:57.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0f44068380 msgr2=0x7f0f4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0f44068380 0x7f0f4406a840 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400b9f0 tx=0x7f0f54008040 comp rx=0 tx=0).stop 2024-04-21T08:57:57.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f64154eb0 msgr2=0x7f0f6415bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f64154eb0 0x7f0f6415bd00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c0af040 tx=0x7f0f5c019790 comp rx=0 tx=0).stop 2024-04-21T08:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 shutdown_connections 2024-04-21T08:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0f44068380 0x7f0f4406a840 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f64154eb0 0x7f0f6415bd00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0f640cb120 0x7f0f641f3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 --2- 172.21.15.26:0/773098079 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0f640c7680 0x7f0f6415d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 >> 172.21.15.26:0/773098079 conn(0x7f0f6406dea0 msgr2=0x7f0f640ccc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 shutdown_connections 2024-04-21T08:57:57.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:57.990+0000 7f0f68bb8640 1 -- 172.21.15.26:0/773098079 wait complete. 2024-04-21T08:57:58.009 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-21T08:57:58.009 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-21T08:57:58.009 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-04-21T08:57:58.010 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-21T08:57:58.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-21T08:57:58.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-21T08:57:58.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-21T08:57:58.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-21T08:57:58.010 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-21T08:57:58.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:58.011 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-04-21T08:57:58.018 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-21T08:57:58.018 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-21T08:57:58.018 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-04-21T08:57:58.018 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-21T08:57:58.018 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-04-21T08:57:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-21T08:57:58.019 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-21T08:57:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-04-21T08:57:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-04-21T08:57:58.019 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-21T08:57:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-04-21T08:57:58.019 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-04-21T08:57:58.020 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-21T08:57:58.020 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-04-21T08:57:58.020 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-04-21T08:57:58.020 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-21T08:57:58.020 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42476sec preferred_lft 42476sec 2024-04-21T08:57:58.021 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2024-04-21T08:57:58.021 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-21T08:57:58.021 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-21T08:57:58.021 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-04-21T08:57:58.021 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-04-21T08:57:58.021 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-21T08:57:58.021 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:03:63:6f:e7 brd ff:ff:ff:ff:ff:ff 2024-04-21T08:57:58.022 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-21T08:57:58.022 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-21T08:57:58.022 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-21T08:57:58.023 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T08:57:58.023 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-21T08:57:58.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2024-04-21T08:57:58.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2024-04-21T08:57:58.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2024-04-21T08:57:58.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-21T08:57:58.024 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-21T08:57:58.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T08:57:58.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T08:57:58.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:58.146 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-21T08:57:58.156 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-04-21T08:57:58.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:58.158 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-04-21T08:57:58.224 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-04-21T08:57:58.224 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-21T08:57:58.224 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-21T08:57:58.224 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-21T08:57:58.225 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-21T08:57:58.225 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-21T08:57:58.225 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T08:57:58.225 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-21T08:57:58.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-21T08:57:58.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-21T08:57:58.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-21T08:57:58.225 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-21T08:57:58.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T08:57:58.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T08:57:58.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:58.352 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-21T08:57:58.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:58.358 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-04-21T08:57:58.403 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T08:57:58.403 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-21T08:57:58.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T08:57:58.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-21T08:57:58.403 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-21T08:57:58.435 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-04-21T08:57:58.431+0000 7fe70669f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-21T08:57:58.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T08:57:58.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T08:57:58.524 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-21T08:57:58.524 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-21T08:57:58.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T08:57:58.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T08:57:58.628 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-21T08:57:58.628 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-21T08:57:58.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-04-21T08:57:58.628 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2024-04-21T08:57:58.628 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-21T08:57:58.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-21T08:57:58.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:57:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T08:57:58.731 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-21T08:57:58.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T08:57:58.731 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-21T08:57:58.779 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-21T08:57:58.779 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-21T08:57:58.779 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-21T08:57:58.826 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-21T08:57:58.880 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T08:57:58.927 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-21T08:57:58.927 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-21T08:57:58.927 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-21T08:57:58.928 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T08:57:58.929 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T08:57:58.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:58.930 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-21T08:57:58.978 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-21T08:57:58.978 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-21T08:57:59.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-21T08:57:59.038 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-21T08:57:59.087 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T08:57:59.088 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T08:57:59.089 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T08:57:59.089 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T08:57:59.089 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-21T08:57:59.089 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T08:57:59.089 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T08:57:59.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:57:59.090 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-21T08:57:59.105 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2024-04-21T08:57:59.102+0000 7f9debe18580 -1 init, newargv = 0x5606607afd90 newargc=15 2024-04-21T08:57:59.105 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[32802]: starting ceph client 2024-04-21T08:57:59.112 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[32802]: starting fuse 2024-04-21T08:58:00.211 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-21T08:58:00.225 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-21T08:58:00.272 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-21T08:58:00.273 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-21T08:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-21T08:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-21T08:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-21T08:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T08:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-21T08:58:00.274 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-21T08:58:00.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:58:00.275 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-21T08:58:00.323 INFO:teuthology.orchestra.run.smithi026.stdout:45 2024-04-21T08:58:00.323 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-21T08:58:00.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2024-04-21T08:58:00.323 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2024-04-21T08:58:00.323 DEBUG:teuthology.orchestra.run.smithi026:> import re 2024-04-21T08:58:00.323 DEBUG:teuthology.orchestra.run.smithi026:> import os 2024-04-21T08:58:00.323 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2024-04-21T08:58:00.323 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-21T08:58:00.324 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2024-04-21T08:58:00.325 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2024-04-21T08:58:00.325 DEBUG:teuthology.orchestra.run.smithi026:> return f 2024-04-21T08:58:00.325 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-21T08:58:00.325 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-21T08:58:00.325 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2024-04-21T08:58:00.325 DEBUG:teuthology.orchestra.run.smithi026:> ' 2024-04-21T08:58:00.453 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.32802.asok 2024-04-21T08:58:00.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-21T08:58:00.467 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32802.asok 2024-04-21T08:58:00.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:58:00.467 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32802.asok status 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "a630765c1f93c6e61d9b40c4b76437611d5ef29e", 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 19.0.0-3154-ga630765c (a630765c1f93c6e61d9b40c4b76437611d5ef29e) squid (dev)", 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "32802", 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2024-04-21T08:58:00.620 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4647, 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4647 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1670486302 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T08:58:00.621 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 1670486302 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4647 192.168.0.1:0/1670486302", 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/1670486302", 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 8, 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 21, 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2024-04-21T08:58:00.622 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T08:58:00.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:58:00.634 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2024-04-21T08:58:00.635 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-21T08:58:00.641 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2024-04-21T08:58:00.641 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-21T08:58:00.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T08:58:00.641 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-21T08:58:00.698 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-21T08:58:00.710 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:58:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2feb423640 1 Processor -- start 2024-04-21T08:58:00.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2feb423640 1 -- start start 2024-04-21T08:58:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2feb423640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2fe40cb120 0x7f2fe415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2feb423640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe415b3a0 con 0x7f2fe40c7680 2024-04-21T08:58:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2feb423640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe415b680 con 0x7f2fe4154eb0 2024-04-21T08:58:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2feb423640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe415e130 con 0x7f2fe40cb120 2024-04-21T08:58:00.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2fe89be640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2fe40c7680 0x7f2fe40d01e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43208/0 (socket says 172.21.15.26:43208) 2024-04-21T08:58:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2fe89be640 1 -- 172.21.15.26:0/46941605 learned_addr learned my addr 172.21.15.26:0/46941605 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:58:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2fe99c0640 1 --2- 172.21.15.26:0/46941605 >> v2:172.21.15.26:3300/0 conn(0x7f2fe40cb120 0x7f2fe415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2fe99c0640 1 -- 172.21.15.26:0/46941605 >> v1:172.21.15.169:6789/0 conn(0x7f2fe4154eb0 legacy=0x7f2fe415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2fe99c0640 1 -- 172.21.15.26:0/46941605 >> v1:172.21.15.26:6789/0 conn(0x7f2fe40c7680 legacy=0x7f2fe40d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2fdbfff640 1 -- 172.21.15.26:0/46941605 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935546259 0 0) 0x7f2fe415b3a0 con 0x7f2fe40c7680 2024-04-21T08:58:00.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.870+0000 7f2fe99c0640 1 -- 172.21.15.26:0/46941605 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe415b960 con 0x7f2fe40cb120 2024-04-21T08:58:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe99c0640 1 --2- 172.21.15.26:0/46941605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415eb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009d90 tx=0x7f2fdc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24c73ba0954556f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fdbfff640 1 -- 172.21.15.26:0/46941605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0b2070 con 0x7f2fe40cb120 2024-04-21T08:58:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fdbfff640 1 -- 172.21.15.26:0/46941605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0a57a0 con 0x7f2fe40cb120 2024-04-21T08:58:00.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fdbfff640 1 -- 172.21.15.26:0/46941605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc0a5b70 con 0x7f2fe40cb120 2024-04-21T08:58:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- 172.21.15.26:0/46941605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 msgr2=0x7f2fe415eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 --2- 172.21.15.26:0/46941605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415eb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009d90 tx=0x7f2fdc01c8e0 comp rx=0 tx=0).stop 2024-04-21T08:58:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- 172.21.15.26:0/46941605 shutdown_connections 2024-04-21T08:58:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 --2- 172.21.15.26:0/46941605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415eb80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- 172.21.15.26:0/46941605 >> 172.21.15.26:0/46941605 conn(0x7f2fe406dea0 msgr2=0x7f2fe406e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- 172.21.15.26:0/46941605 shutdown_connections 2024-04-21T08:58:00.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- 172.21.15.26:0/46941605 wait complete. 2024-04-21T08:58:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 Processor -- start 2024-04-21T08:58:00.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- start start 2024-04-21T08:58:00.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40c7680 0x7f2fe414bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:00.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe4154eb0 0x7f2fe40ce120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40cbaf0 con 0x7f2fe40cb120 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40cb970 con 0x7f2fe40c7680 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2feb423640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40d08f0 con 0x7f2fe4154eb0 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56990/0 (socket says 172.21.15.26:56990) 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 -- 172.21.15.26:0/3752744414 learned_addr learned my addr 172.21.15.26:0/3752744414 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:00.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe99c0640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe4154eb0 0x7f2fe40ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe91bf640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40c7680 0x7f2fe414bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 -- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe4154eb0 msgr2=0x7f2fe40ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe4154eb0 0x7f2fe40ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 -- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40c7680 msgr2=0x7f2fe414bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40c7680 0x7f2fe414bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe89be640 1 -- 172.21.15.26:0/3752744414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40d0370 con 0x7f2fe40cb120 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.874+0000 7f2fe91bf640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40c7680 0x7f2fe414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fe89be640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415a580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c410 tx=0x7f2fd400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fd9ffb640 1 -- 172.21.15.26:0/3752744414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd40074e0 con 0x7f2fe40cb120 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fd9ffb640 1 -- 172.21.15.26:0/3752744414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd40047f0 con 0x7f2fe40cb120 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe415ae80 con 0x7f2fe40cb120 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fd9ffb640 1 -- 172.21.15.26:0/3752744414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4007680 con 0x7f2fe40cb120 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe41f6c40 con 0x7f2fe40cb120 2024-04-21T08:58:00.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe4075ef0 con 0x7f2fe40cb120 2024-04-21T08:58:00.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fd9ffb640 1 -- 172.21.15.26:0/3752744414 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2fd4011070 con 0x7f2fe40cb120 2024-04-21T08:58:00.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fd9ffb640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:00.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fd9ffb640 1 -- 172.21.15.26:0/3752744414 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2fd4086540 con 0x7f2fe40cb120 2024-04-21T08:58:00.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fe91bf640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:00.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.878+0000 7f2fe91bf640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2fc8068380 0x7f2fc806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0000f70 tx=0x7f2fe0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:00.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:00.882+0000 7f2fd9ffb640 1 -- 172.21.15.26:0/3752744414 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2fd4056b70 con 0x7f2fe40cb120 2024-04-21T08:58:01.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.046+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fe40b5e40 con 0x7f2fe40cb120 2024-04-21T08:58:01.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2fd9ffb640 1 -- 172.21.15.26:0/3752744414 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7f2fd4056470 con 0x7f2fe40cb120 2024-04-21T08:58:01.051 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:01.051 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:58:01.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2fc8068380 msgr2=0x7f2fc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2fc8068380 0x7f2fc806a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0000f70 tx=0x7f2fe0009040 comp rx=0 tx=0).stop 2024-04-21T08:58:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 msgr2=0x7f2fe415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415a580 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400c410 tx=0x7f2fd400c8d0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 shutdown_connections 2024-04-21T08:58:01.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fe4154eb0 0x7f2fe40ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2fc8068380 0x7f2fc806a840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2fe40cb120 0x7f2fe415a580 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 --2- 172.21.15.26:0/3752744414 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fe40c7680 0x7f2fe414bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 >> 172.21.15.26:0/3752744414 conn(0x7f2fe406dea0 msgr2=0x7f2fe4153a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 shutdown_connections 2024-04-21T08:58:01.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.050+0000 7f2feb423640 1 -- 172.21.15.26:0/3752744414 wait complete. 2024-04-21T08:58:01.071 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T08:58:01.072 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T08:58:01.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0ab10a1640 1 Processor -- start 2024-04-21T08:58:01.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0ab10a1640 1 -- start start 2024-04-21T08:58:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0ab10a1640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0aac0ce3b0 0x7f0aac157f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0ab10a1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0708c0 0x7f0aac158470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0ab10a1640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0aac06cb90 con 0x7f0aac0ce790 2024-04-21T08:58:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0ab10a1640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac15ae30 con 0x7f0aac0ce3b0 2024-04-21T08:58:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0ab10a1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac0c9620 con 0x7f0aac0708c0 2024-04-21T08:58:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aab59e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0aac0ce790 0x7f0aac15b330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43210/0 (socket says 172.21.15.26:43210) 2024-04-21T08:58:01.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aab59e640 1 -- 172.21.15.26:0/3985910065 learned_addr learned my addr 172.21.15.26:0/3985910065 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aaa59c640 1 --2- 172.21.15.26:0/3985910065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0708c0 0x7f0aac158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aaad9d640 1 --2- 172.21.15.26:0/3985910065 >> v2:172.21.15.169:3300/0 conn(0x7f0aac0ce3b0 0x7f0aac157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aa9d9b640 1 -- 172.21.15.26:0/3985910065 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1837076510 0 0) 0x7f0aac06cb90 con 0x7f0aac0ce790 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aa9d9b640 1 -- 172.21.15.26:0/3985910065 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a98003530 con 0x7f0aac0ce790 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aaa59c640 1 -- 172.21.15.26:0/3985910065 >> v2:172.21.15.169:3300/0 conn(0x7f0aac0ce3b0 msgr2=0x7f0aac157f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aaa59c640 1 --2- 172.21.15.26:0/3985910065 >> v2:172.21.15.169:3300/0 conn(0x7f0aac0ce3b0 0x7f0aac157f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aaa59c640 1 -- 172.21.15.26:0/3985910065 >> v1:172.21.15.26:6789/0 conn(0x7f0aac0ce790 legacy=0x7f0aac15b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.202+0000 7f0aaa59c640 1 -- 172.21.15.26:0/3985910065 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac06ce30 con 0x7f0aac0708c0 2024-04-21T08:58:01.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0aaa59c640 1 --2- 172.21.15.26:0/3985910065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0708c0 0x7f0aac158470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097f0 tx=0x7f0a9401ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a1fc9a4d1611bbd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0aa9d9b640 1 -- 172.21.15.26:0/3985910065 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a940b5070 con 0x7f0aac0708c0 2024-04-21T08:58:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0aa9d9b640 1 -- 172.21.15.26:0/3985910065 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a940a8990 con 0x7f0aac0708c0 2024-04-21T08:58:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0aa9d9b640 1 -- 172.21.15.26:0/3985910065 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a940a8d40 con 0x7f0aac0708c0 2024-04-21T08:58:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3985910065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0708c0 msgr2=0x7f0aac158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3985910065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0708c0 0x7f0aac158470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0a940097f0 tx=0x7f0a9401ec90 comp rx=0 tx=0).stop 2024-04-21T08:58:01.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3985910065 shutdown_connections 2024-04-21T08:58:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3985910065 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0708c0 0x7f0aac158470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3985910065 >> v2:172.21.15.169:3300/0 conn(0x7f0aac0ce3b0 0x7f0aac157f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3985910065 >> 172.21.15.26:0/3985910065 conn(0x7f0aac067760 msgr2=0x7f0aac067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3985910065 shutdown_connections 2024-04-21T08:58:01.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3985910065 wait complete. 2024-04-21T08:58:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 Processor -- start 2024-04-21T08:58:01.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.206+0000 7f0ab10a1640 1 -- start start 2024-04-21T08:58:01.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0aac0708c0 0x7f0aac152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0ce3b0 0x7f0aac1f02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0ce790 0x7f0aac1f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac0c9900 con 0x7f0aac0ce790 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac0c9330 con 0x7f0aac0708c0 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac15ba40 con 0x7f0aac0ce3b0 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0ce790 0x7f0aac1f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0ce790 0x7f0aac1f3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56998/0 (socket says 172.21.15.26:56998) 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 -- 172.21.15.26:0/3517438344 learned_addr learned my addr 172.21.15.26:0/3517438344 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aaa59c640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0ce3b0 0x7f0aac1f02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aaad9d640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0aac0708c0 0x7f0aac152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 -- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0ce3b0 msgr2=0x7f0aac1f02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0ce3b0 0x7f0aac1f02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 -- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0aac0708c0 msgr2=0x7f0aac152f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0aac0708c0 0x7f0aac152f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 -- 172.21.15.26:0/3517438344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac15c030 con 0x7f0aac0ce790 2024-04-21T08:58:01.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aab59e640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0ce790 0x7f0aac1f3840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00cad0 tx=0x7f0a9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aa37fe640 1 -- 172.21.15.26:0/3517438344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c017070 con 0x7f0aac0ce790 2024-04-21T08:58:01.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aa37fe640 1 -- 172.21.15.26:0/3517438344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9c00abd0 con 0x7f0aac0ce790 2024-04-21T08:58:01.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac15a050 con 0x7f0aac0ce790 2024-04-21T08:58:01.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aa37fe640 1 -- 172.21.15.26:0/3517438344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c012400 con 0x7f0aac0ce790 2024-04-21T08:58:01.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac15a330 con 0x7f0aac0ce790 2024-04-21T08:58:01.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac074320 con 0x7f0aac0ce790 2024-04-21T08:58:01.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aa37fe640 1 -- 172.21.15.26:0/3517438344 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0a9c01a070 con 0x7f0aac0ce790 2024-04-21T08:58:01.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aa37fe640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0a8c0683b0 0x7f0a8c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aa37fe640 1 -- 172.21.15.26:0/3517438344 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0a9c0866c0 con 0x7f0aac0ce790 2024-04-21T08:58:01.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.210+0000 7f0aaad9d640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0a8c0683b0 0x7f0a8c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.214+0000 7f0aaad9d640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0a8c0683b0 0x7f0a8c06a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009af0 tx=0x7f0aa4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.214+0000 7f0aa37fe640 1 -- 172.21.15.26:0/3517438344 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0a9c0565b0 con 0x7f0aac0ce790 2024-04-21T08:58:01.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0aac0c8670 con 0x7f0aac0ce790 2024-04-21T08:58:01.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0aa37fe640 1 -- 172.21.15.26:0/3517438344 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f0a9c05a8b0 con 0x7f0aac0ce790 2024-04-21T08:58:01.384 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T08:58:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0a8c0683b0 msgr2=0x7f0a8c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0a8c0683b0 0x7f0a8c06a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4009af0 tx=0x7f0aa4008040 comp rx=0 tx=0).stop 2024-04-21T08:58:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0ce790 msgr2=0x7f0aac1f3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0ce790 0x7f0aac1f3840 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c00cad0 tx=0x7f0a9c00cf90 comp rx=0 tx=0).stop 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 shutdown_connections 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0a8c0683b0 0x7f0a8c06a870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0aac0ce790 0x7f0aac1f3840 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0aac0ce3b0 0x7f0aac1f02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 --2- 172.21.15.26:0/3517438344 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0aac0708c0 0x7f0aac152f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 >> 172.21.15.26:0/3517438344 conn(0x7f0aac067760 msgr2=0x7f0aac071000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 shutdown_connections 2024-04-21T08:58:01.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.382+0000 7f0ab10a1640 1 -- 172.21.15.26:0/3517438344 wait complete. 2024-04-21T08:58:01.404 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T08:58:01.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9aee52640 1 Processor -- start 2024-04-21T08:58:01.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9aee52640 1 -- start start 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9aee52640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9a8153010 0x7fc9a815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9aee52640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a815c6f0 0x7fc9a80c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9aee52640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a80c94f0 con 0x7fc9a80c8590 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9aee52640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a80740c0 con 0x7fc9a8153010 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9aee52640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a81533f0 con 0x7fc9a815c6f0 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9acbee640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9a8153010 0x7fc9a815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9acbee640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9a8153010 0x7fc9a815c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57014/0 (socket says 172.21.15.26:57014) 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9acbee640 1 -- 172.21.15.26:0/2943304293 learned_addr learned my addr 172.21.15.26:0/2943304293 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:01.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9a7fff640 1 --2- 172.21.15.26:0/2943304293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a815c6f0 0x7fc9a80c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9acbee640 1 -- 172.21.15.26:0/2943304293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a815c6f0 msgr2=0x7fc9a80c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:01.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9acbee640 1 --2- 172.21.15.26:0/2943304293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a815c6f0 0x7fc9a80c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9acbee640 1 -- 172.21.15.26:0/2943304293 >> v1:172.21.15.169:6789/0 conn(0x7fc9a80c8590 legacy=0x7fc9a80725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:01.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.534+0000 7fc9acbee640 1 -- 172.21.15.26:0/2943304293 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a80c9790 con 0x7fc9a8153010 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9acbee640 1 --2- 172.21.15.26:0/2943304293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a8153010 0x7fc9a815c1b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e50 tx=0x7fc99801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2809316049cb00 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9a77fe640 1 -- 172.21.15.26:0/2943304293 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980a56f0 con 0x7fc9a8153010 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9a77fe640 1 -- 172.21.15.26:0/2943304293 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9980a5890 con 0x7fc9a8153010 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9a77fe640 1 -- 172.21.15.26:0/2943304293 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9980a5c60 con 0x7fc9a8153010 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 -- 172.21.15.26:0/2943304293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a8153010 msgr2=0x7fc9a815c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 --2- 172.21.15.26:0/2943304293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a8153010 0x7fc9a815c1b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e50 tx=0x7fc99801c960 comp rx=0 tx=0).stop 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 -- 172.21.15.26:0/2943304293 shutdown_connections 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 --2- 172.21.15.26:0/2943304293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a815c6f0 0x7fc9a80c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 --2- 172.21.15.26:0/2943304293 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a8153010 0x7fc9a815c1b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 -- 172.21.15.26:0/2943304293 >> 172.21.15.26:0/2943304293 conn(0x7fc9a80c9b50 msgr2=0x7fc9a80c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 -- 172.21.15.26:0/2943304293 shutdown_connections 2024-04-21T08:58:01.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 -- 172.21.15.26:0/2943304293 wait complete. 2024-04-21T08:58:01.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 Processor -- start 2024-04-21T08:58:01.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.538+0000 7fc9aee52640 1 -- start start 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9a80c8590 0x7fc9a806db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a8153010 0x7fc9a815b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a815c6f0 0x7fc9a815b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80c7bf0 con 0x7fc9a815c6f0 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80ca950 con 0x7fc9a80c8590 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a8166500 con 0x7fc9a8153010 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a815c6f0 0x7fc9a815b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a815c6f0 0x7fc9a815b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57016/0 (socket says 172.21.15.26:57016) 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 -- 172.21.15.26:0/684254727 learned_addr learned my addr 172.21.15.26:0/684254727 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9acbee640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9a80c8590 0x7fc9a806db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9a7fff640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a8153010 0x7fc9a815b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 -- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a8153010 msgr2=0x7fc9a815b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a8153010 0x7fc9a815b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 -- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9a80c8590 msgr2=0x7fc9a806db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9a80c8590 0x7fc9a806db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 -- 172.21.15.26:0/684254727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a814a660 con 0x7fc9a815c6f0 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9acbee640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9a80c8590 0x7fc9a806db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9ad3ef640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a815c6f0 0x7fc9a815b6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000c3f0 tx=0x7fc9a000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9a57fa640 1 -- 172.21.15.26:0/684254727 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0011790 con 0x7fc9a815c6f0 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9a57fa640 1 -- 172.21.15.26:0/684254727 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a0017070 con 0x7fc9a815c6f0 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a8158b40 con 0x7fc9a815c6f0 2024-04-21T08:58:01.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9a57fa640 1 -- 172.21.15.26:0/684254727 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0011b70 con 0x7fc9a815c6f0 2024-04-21T08:58:01.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a81590e0 con 0x7fc9a815c6f0 2024-04-21T08:58:01.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a81596d0 con 0x7fc9a815c6f0 2024-04-21T08:58:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9a57fa640 1 -- 172.21.15.26:0/684254727 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9a0011d10 con 0x7fc9a815c6f0 2024-04-21T08:58:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9a57fa640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9940683b0 0x7fc99406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9a57fa640 1 -- 172.21.15.26:0/684254727 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc9a0086740 con 0x7fc9a815c6f0 2024-04-21T08:58:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.542+0000 7fc9acbee640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9940683b0 0x7fc99406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.546+0000 7fc9acbee640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9940683b0 0x7fc99406a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9980ae000 tx=0x7fc9980a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.546+0000 7fc9a57fa640 1 -- 172.21.15.26:0/684254727 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc9a0056d90 con 0x7fc9a815c6f0 2024-04-21T08:58:01.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.710+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc9a8074320 con 0x7fc9a815c6f0 2024-04-21T08:58:01.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9a57fa640 1 -- 172.21.15.26:0/684254727 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fc9a0056690 con 0x7fc9a815c6f0 2024-04-21T08:58:01.715 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T08:58:01.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9940683b0 msgr2=0x7fc99406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9940683b0 0x7fc99406a870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc9980ae000 tx=0x7fc9980a7070 comp rx=0 tx=0).stop 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a815c6f0 msgr2=0x7fc9a815b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a815c6f0 0x7fc9a815b6b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc9a000c3f0 tx=0x7fc9a000c8b0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 shutdown_connections 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9940683b0 0x7fc99406a870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9a815c6f0 0x7fc9a815b6b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9a8153010 0x7fc9a815b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 --2- 172.21.15.26:0/684254727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9a80c8590 0x7fc9a806db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 >> 172.21.15.26:0/684254727 conn(0x7fc9a80c9b50 msgr2=0x7fc9a80caf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 shutdown_connections 2024-04-21T08:58:01.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.714+0000 7fc9aee52640 1 -- 172.21.15.26:0/684254727 wait complete. 2024-04-21T08:58:01.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T08:58:01.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff70cee8640 1 Processor -- start 2024-04-21T08:58:01.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff70cee8640 1 -- start start 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff70cee8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7080c5e90 0x7ff7081643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff70cee8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff708153240 con 0x7ff7080ccba0 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff70cee8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7080c6b60 con 0x7ff708152e60 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff70cee8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff708158d10 con 0x7ff7080c5e90 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff706d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7080c5e90 0x7ff7081643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff706d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff7080c5e90 0x7ff7081643b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57030/0 (socket says 172.21.15.26:57030) 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff705d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff7080ccba0 0x7ff7081591a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43214/0 (socket says 172.21.15.26:43214) 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff706d9d640 1 -- 172.21.15.26:0/2837757586 learned_addr learned my addr 172.21.15.26:0/2837757586 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff706d9d640 1 -- 172.21.15.26:0/2837757586 >> v1:172.21.15.169:6789/0 conn(0x7ff708152e60 legacy=0x7ff7080736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff706d9d640 1 -- 172.21.15.26:0/2837757586 >> v1:172.21.15.26:6789/0 conn(0x7ff7080ccba0 legacy=0x7ff7081591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff70559a640 1 -- 172.21.15.26:0/2837757586 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1265282816 0 0) 0x7ff708153240 con 0x7ff7080ccba0 2024-04-21T08:58:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.862+0000 7ff706d9d640 1 -- 172.21.15.26:0/2837757586 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7080c3550 con 0x7ff7080c5e90 2024-04-21T08:58:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff706d9d640 1 --2- 172.21.15.26:0/2837757586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080c5e90 0x7ff7081643b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff700009e50 tx=0x7ff70001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1749845b5a2fbed server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70559a640 1 -- 172.21.15.26:0/2837757586 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b4070 con 0x7ff7080c5e90 2024-04-21T08:58:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70559a640 1 -- 172.21.15.26:0/2837757586 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7000af400 con 0x7ff7080c5e90 2024-04-21T08:58:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70559a640 1 -- 172.21.15.26:0/2837757586 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000af7d0 con 0x7ff7080c5e90 2024-04-21T08:58:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- 172.21.15.26:0/2837757586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080c5e90 msgr2=0x7ff7081643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 --2- 172.21.15.26:0/2837757586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080c5e90 0x7ff7081643b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff700009e50 tx=0x7ff70001f1e0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- 172.21.15.26:0/2837757586 shutdown_connections 2024-04-21T08:58:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 --2- 172.21.15.26:0/2837757586 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff7080c5e90 0x7ff7081643b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- 172.21.15.26:0/2837757586 >> 172.21.15.26:0/2837757586 conn(0x7ff7080cbef0 msgr2=0x7ff7080cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- 172.21.15.26:0/2837757586 shutdown_connections 2024-04-21T08:58:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- 172.21.15.26:0/2837757586 wait complete. 2024-04-21T08:58:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 Processor -- start 2024-04-21T08:58:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- start start 2024-04-21T08:58:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7080c5e90 0x7ff70814d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7080ccba0 0x7ff70814c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff708152e60 0x7ff708151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff7080c67b0 con 0x7ff708152e60 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff7080c3b10 con 0x7ff7080c5e90 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff70cee8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff708156000 con 0x7ff7080ccba0 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff706d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff708152e60 0x7ff708151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff706d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff708152e60 0x7ff708151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57042/0 (socket says 172.21.15.26:57042) 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.866+0000 7ff706d9d640 1 -- 172.21.15.26:0/3895779616 learned_addr learned my addr 172.21.15.26:0/3895779616 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff705d9b640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7080ccba0 0x7ff70814c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff70659c640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7080c5e90 0x7ff70814d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff706d9d640 1 -- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7080ccba0 msgr2=0x7ff70814c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff706d9d640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7080ccba0 0x7ff70814c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff706d9d640 1 -- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7080c5e90 msgr2=0x7ff70814d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff706d9d640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7080c5e90 0x7ff70814d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff706d9d640 1 -- 172.21.15.26:0/3895779616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7081562a0 con 0x7ff708152e60 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff705d9b640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7080ccba0 0x7ff70814c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff70659c640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7080c5e90 0x7ff70814d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff706d9d640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff708152e60 0x7ff708151620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff700009e50 tx=0x7ff70001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff6f6ffd640 1 -- 172.21.15.26:0/3895779616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b4040 con 0x7ff708152e60 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff6f6ffd640 1 -- 172.21.15.26:0/3895779616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7000c1070 con 0x7ff708152e60 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7081ee9c0 con 0x7ff708152e60 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff6f6ffd640 1 -- 172.21.15.26:0/3895779616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7000b9460 con 0x7ff708152e60 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff70814d650 con 0x7ff708152e60 2024-04-21T08:58:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7081ee7b0 con 0x7ff708152e60 2024-04-21T08:58:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff6f6ffd640 1 -- 172.21.15.26:0/3895779616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff7000b7070 con 0x7ff708152e60 2024-04-21T08:58:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff6f6ffd640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6e80683b0 0x7ff6e806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff6f6ffd640 1 -- 172.21.15.26:0/3895779616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff700124b50 con 0x7ff708152e60 2024-04-21T08:58:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff70659c640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6e80683b0 0x7ff6e806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.870+0000 7ff70659c640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6e80683b0 0x7ff6e806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800a850 tx=0x7ff6f8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:01.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:01.874+0000 7ff6f6ffd640 1 -- 172.21.15.26:0/3895779616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff700018d40 con 0x7ff708152e60 2024-04-21T08:58:02.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.038+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff708074320 con 0x7ff708152e60 2024-04-21T08:58:02.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.038+0000 7ff6f6ffd640 1 -- 172.21.15.26:0/3895779616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7ff7000c4360 con 0x7ff708152e60 2024-04-21T08:58:02.042 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T08:58:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6e80683b0 msgr2=0x7ff6e806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6e80683b0 0x7ff6e806a870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800a850 tx=0x7ff6f8008040 comp rx=0 tx=0).stop 2024-04-21T08:58:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff708152e60 msgr2=0x7ff708151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff708152e60 0x7ff708151620 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ff700009e50 tx=0x7ff70001bf80 comp rx=0 tx=0).stop 2024-04-21T08:58:02.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 shutdown_connections 2024-04-21T08:58:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6e80683b0 0x7ff6e806a870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff708152e60 0x7ff708151620 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff7080ccba0 0x7ff70814c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 --2- 172.21.15.26:0/3895779616 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff7080c5e90 0x7ff70814d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 >> 172.21.15.26:0/3895779616 conn(0x7ff7080cbef0 msgr2=0x7ff7080c9cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 shutdown_connections 2024-04-21T08:58:02.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.042+0000 7ff70cee8640 1 -- 172.21.15.26:0/3895779616 wait complete. 2024-04-21T08:58:02.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb236d79640 1 Processor -- start 2024-04-21T08:58:02.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb236d79640 1 -- start start 2024-04-21T08:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb236d79640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb230073b50 0x7fb2300c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb236d79640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2300c6050 con 0x7fb2300c5690 2024-04-21T08:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb236d79640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2300c3470 con 0x7fb2300c52b0 2024-04-21T08:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb236d79640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb2300c5e00 con 0x7fb230073b50 2024-04-21T08:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb235316640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb2300c5690 0x7fb23006ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43224/0 (socket says 172.21.15.26:43224) 2024-04-21T08:58:02.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb235316640 1 -- 172.21.15.26:0/108300244 learned_addr learned my addr 172.21.15.26:0/108300244 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb22ffff640 1 --2- 172.21.15.26:0/108300244 >> v2:172.21.15.169:3300/0 conn(0x7fb230073b50 0x7fb2300c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068596964 0 0) 0x7fb2300c3470 con 0x7fb2300c52b0 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb21c003530 con 0x7fb2300c52b0 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2519712168 0 0) 0x7fb2300c6050 con 0x7fb2300c5690 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.186+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2300c3470 con 0x7fb2300c5690 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 317853082 0 0) 0x7fb2300c3470 con 0x7fb2300c5690 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22ffff640 1 -- 172.21.15.26:0/108300244 >> v1:172.21.15.169:6789/0 conn(0x7fb2300c52b0 legacy=0x7fb2301529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22ffff640 1 -- 172.21.15.26:0/108300244 >> v1:172.21.15.26:6789/0 conn(0x7fb2300c5690 legacy=0x7fb23006ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22ffff640 1 -- 172.21.15.26:0/108300244 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2300c3750 con 0x7fb230073b50 2024-04-21T08:58:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22ffff640 1 --2- 172.21.15.26:0/108300244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 0x7fb2300c9450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb220009d90 tx=0x7fb22001c770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed359c9f00aa340 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb228001680 con 0x7fb230073b50 2024-04-21T08:58:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200a64d0 con 0x7fb230073b50 2024-04-21T08:58:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb22f7fe640 1 -- 172.21.15.26:0/108300244 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2200a6880 con 0x7fb230073b50 2024-04-21T08:58:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb236d79640 1 -- 172.21.15.26:0/108300244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 msgr2=0x7fb2300c9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb236d79640 1 --2- 172.21.15.26:0/108300244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 0x7fb2300c9450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb220009d90 tx=0x7fb22001c770 comp rx=0 tx=0).stop 2024-04-21T08:58:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb236d79640 1 -- 172.21.15.26:0/108300244 shutdown_connections 2024-04-21T08:58:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb236d79640 1 --2- 172.21.15.26:0/108300244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 0x7fb2300c9450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb236d79640 1 -- 172.21.15.26:0/108300244 >> 172.21.15.26:0/108300244 conn(0x7fb2300c8960 msgr2=0x7fb2300c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb236d79640 1 -- 172.21.15.26:0/108300244 shutdown_connections 2024-04-21T08:58:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.190+0000 7fb236d79640 1 -- 172.21.15.26:0/108300244 wait complete. 2024-04-21T08:58:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 Processor -- start 2024-04-21T08:58:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 -- start start 2024-04-21T08:58:02.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 0x7fb23014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2300c52b0 0x7fb2301f15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2300c5690 0x7fb230144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb230166f10 con 0x7fb2300c52b0 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb2300c6330 con 0x7fb230073b50 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb230167090 con 0x7fb2300c5690 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2300c52b0 0x7fb2301f15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2300c52b0 0x7fb2301f15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57046/0 (socket says 172.21.15.26:57046) 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 -- 172.21.15.26:0/2636656332 learned_addr learned my addr 172.21.15.26:0/2636656332 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb235316640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2300c5690 0x7fb230144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb234b15640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 0x7fb23014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 -- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2300c5690 msgr2=0x7fb230144d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2300c5690 0x7fb230144d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 -- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 msgr2=0x7fb23014c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 0x7fb23014c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 -- 172.21.15.26:0/2636656332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2300c7b90 con 0x7fb2300c52b0 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22ffff640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2300c52b0 0x7fb2301f15b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb22001ae20 tx=0x7fb220019510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22d7fa640 1 -- 172.21.15.26:0/2636656332 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220009450 con 0x7fb2300c52b0 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22d7fa640 1 -- 172.21.15.26:0/2636656332 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200c0070 con 0x7fb2300c52b0 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23014c060 con 0x7fb2300c52b0 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb22d7fa640 1 -- 172.21.15.26:0/2636656332 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220004040 con 0x7fb2300c52b0 2024-04-21T08:58:02.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23014a640 con 0x7fb2300c52b0 2024-04-21T08:58:02.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.194+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb230075ef0 con 0x7fb2300c52b0 2024-04-21T08:58:02.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.198+0000 7fb22d7fa640 1 -- 172.21.15.26:0/2636656332 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2200b7040 con 0x7fb2300c52b0 2024-04-21T08:58:02.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.198+0000 7fb22d7fa640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb210068380 0x7fb21006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.198+0000 7fb22d7fa640 1 -- 172.21.15.26:0/2636656332 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb2201218d0 con 0x7fb2300c52b0 2024-04-21T08:58:02.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.198+0000 7fb234b15640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb210068380 0x7fb21006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.198+0000 7fb234b15640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb210068380 0x7fb21006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2180011f0 tx=0x7fb218009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.202+0000 7fb22d7fa640 1 -- 172.21.15.26:0/2636656332 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb2301599e0 con 0x7fb2300c52b0 2024-04-21T08:58:02.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.366+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb230143320 con 0x7fb2300c52b0 2024-04-21T08:58:02.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.366+0000 7fb22d7fa640 1 -- 172.21.15.26:0/2636656332 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7fb220016480 con 0x7fb2300c52b0 2024-04-21T08:58:02.370 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:02.370 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb210068380 msgr2=0x7fb21006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb210068380 0x7fb21006a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb2180011f0 tx=0x7fb218009040 comp rx=0 tx=0).stop 2024-04-21T08:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2300c52b0 msgr2=0x7fb2301f15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2300c52b0 0x7fb2301f15b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb22001ae20 tx=0x7fb220019510 comp rx=0 tx=0).stop 2024-04-21T08:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 shutdown_connections 2024-04-21T08:58:02.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2300c5690 0x7fb230144d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb210068380 0x7fb21006a840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2300c52b0 0x7fb2301f15b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 --2- 172.21.15.26:0/2636656332 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb230073b50 0x7fb23014c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 >> 172.21.15.26:0/2636656332 conn(0x7fb2300c8960 msgr2=0x7fb2301514a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 shutdown_connections 2024-04-21T08:58:02.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.370+0000 7fb236d79640 1 -- 172.21.15.26:0/2636656332 wait complete. 2024-04-21T08:58:02.390 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T08:58:02.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T08:58:02.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61ab37e640 1 Processor -- start 2024-04-21T08:58:02.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61ab37e640 1 -- start start 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61ab37e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61a4159e60 0x7f61a4070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61ab37e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f61a41594e0 0x7f61a40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61ab37e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61a40c3320 con 0x7f61a4152bf0 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61ab37e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f61a40c5250 con 0x7f61a4159e60 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61ab37e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f61a40c38e0 con 0x7f61a41594e0 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a8919640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61a4159e60 0x7f61a4070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a8919640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f61a4159e60 0x7f61a4070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57062/0 (socket says 172.21.15.26:57062) 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a8919640 1 -- 172.21.15.26:0/2251832535 learned_addr learned my addr 172.21.15.26:0/2251832535 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:02.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a911a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f61a4152bf0 0x7f61a40c8bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43232/0 (socket says 172.21.15.26:43232) 2024-04-21T08:58:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a991b640 1 --2- 172.21.15.26:0/2251832535 >> v2:172.21.15.169:3300/0 conn(0x7f61a41594e0 0x7f61a40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a8919640 1 -- 172.21.15.26:0/2251832535 >> v2:172.21.15.169:3300/0 conn(0x7f61a41594e0 msgr2=0x7f61a40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a8919640 1 --2- 172.21.15.26:0/2251832535 >> v2:172.21.15.169:3300/0 conn(0x7f61a41594e0 0x7f61a40ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a8919640 1 -- 172.21.15.26:0/2251832535 >> v1:172.21.15.26:6789/0 conn(0x7f61a4152bf0 legacy=0x7f61a40c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f619bfff640 1 -- 172.21.15.26:0/2251832535 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689269544 0 0) 0x7f61a40c3320 con 0x7f61a4152bf0 2024-04-21T08:58:02.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.518+0000 7f61a8919640 1 -- 172.21.15.26:0/2251832535 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a40c3600 con 0x7f61a4159e60 2024-04-21T08:58:02.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61a8919640 1 --2- 172.21.15.26:0/2251832535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a4070870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f61a40cbd30 tx=0x7f619401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51da00a237586f62 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f619bfff640 1 -- 172.21.15.26:0/2251832535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940b0070 con 0x7f61a4159e60 2024-04-21T08:58:02.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f619bfff640 1 -- 172.21.15.26:0/2251832535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61940ab600 con 0x7f61a4159e60 2024-04-21T08:58:02.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f619bfff640 1 -- 172.21.15.26:0/2251832535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940ab9d0 con 0x7f61a4159e60 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- 172.21.15.26:0/2251832535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 msgr2=0x7f61a4070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 --2- 172.21.15.26:0/2251832535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a4070870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f61a40cbd30 tx=0x7f619401c520 comp rx=0 tx=0).stop 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- 172.21.15.26:0/2251832535 shutdown_connections 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 --2- 172.21.15.26:0/2251832535 >> v2:172.21.15.169:3300/0 conn(0x7f61a41594e0 0x7f61a40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 --2- 172.21.15.26:0/2251832535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a4070870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- 172.21.15.26:0/2251832535 >> 172.21.15.26:0/2251832535 conn(0x7f61a4067760 msgr2=0x7f61a4067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- 172.21.15.26:0/2251832535 shutdown_connections 2024-04-21T08:58:02.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- 172.21.15.26:0/2251832535 wait complete. 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 Processor -- start 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- start start 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61a4152bf0 0x7f61a41f5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61a41594e0 0x7f61a40caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a414a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4152fd0 con 0x7f61a4159e60 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f61a40703e0 con 0x7f61a4152bf0 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.522+0000 7f61ab37e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f61a4153150 con 0x7f61a41594e0 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a414a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a414a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57066/0 (socket says 172.21.15.26:57066) 2024-04-21T08:58:02.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 -- 172.21.15.26:0/3493360600 learned_addr learned my addr 172.21.15.26:0/3493360600 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a8919640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61a41594e0 0x7f61a40caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a911a640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61a4152bf0 0x7f61a41f5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 -- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61a41594e0 msgr2=0x7f61a40caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61a41594e0 0x7f61a40caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 -- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61a4152bf0 msgr2=0x7f61a41f5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61a4152bf0 0x7f61a41f5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 -- 172.21.15.26:0/3493360600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a41f12d0 con 0x7f61a4159e60 2024-04-21T08:58:02.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a8919640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61a41594e0 0x7f61a40caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a911a640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61a4152bf0 0x7f61a41f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a991b640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a414a310 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f619c007e90 tx=0x7f619c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f6199ffb640 1 -- 172.21.15.26:0/3493360600 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c014420 con 0x7f61a4159e60 2024-04-21T08:58:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f6199ffb640 1 -- 172.21.15.26:0/3493360600 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f619c019070 con 0x7f61a4159e60 2024-04-21T08:58:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a40caf50 con 0x7f61a4159e60 2024-04-21T08:58:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f6199ffb640 1 -- 172.21.15.26:0/3493360600 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c014800 con 0x7f61a4159e60 2024-04-21T08:58:02.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a40ca730 con 0x7f61a4159e60 2024-04-21T08:58:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61a4074320 con 0x7f61a4159e60 2024-04-21T08:58:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f6199ffb640 1 -- 172.21.15.26:0/3493360600 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f619c0149a0 con 0x7f61a4159e60 2024-04-21T08:58:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f6199ffb640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6188068380 0x7f618806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f6199ffb640 1 -- 172.21.15.26:0/3493360600 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f619c0872b0 con 0x7f61a4159e60 2024-04-21T08:58:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.526+0000 7f61a911a640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6188068380 0x7f618806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.530+0000 7f61a911a640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6188068380 0x7f618806a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.530+0000 7f6199ffb640 1 -- 172.21.15.26:0/3493360600 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f619c011260 con 0x7f61a4159e60 2024-04-21T08:58:02.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.690+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f61a40c8670 con 0x7f61a4159e60 2024-04-21T08:58:02.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.690+0000 7f6199ffb640 1 -- 172.21.15.26:0/3493360600 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7f619c0577e0 con 0x7f61a4159e60 2024-04-21T08:58:02.694 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6188068380 msgr2=0x7f618806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6188068380 0x7f618806a840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f61a0007fd0 tx=0x7f61a0009040 comp rx=0 tx=0).stop 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 msgr2=0x7f61a414a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a414a310 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f619c007e90 tx=0x7f619c00e4b0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 shutdown_connections 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6188068380 0x7f618806a840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f61a4159e60 0x7f61a414a310 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61a41594e0 0x7f61a40caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 --2- 172.21.15.26:0/3493360600 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61a4152bf0 0x7f61a41f5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 >> 172.21.15.26:0/3493360600 conn(0x7f61a4067760 msgr2=0x7f61a415abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 shutdown_connections 2024-04-21T08:58:02.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.694+0000 7f61ab37e640 1 -- 172.21.15.26:0/3493360600 wait complete. 2024-04-21T08:58:02.711 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T08:58:02.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.834+0000 7fa8bdd19640 1 Processor -- start 2024-04-21T08:58:02.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.834+0000 7fa8bdd19640 1 -- start start 2024-04-21T08:58:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8bdd19640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa8b8154f90 0x7fa8b80cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8bdd19640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8b815e0f0 0x7fa8b80c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8bdd19640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b80cc600 con 0x7fa8b815e510 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8bdd19640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b8155370 con 0x7fa8b815e0f0 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8bdd19640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b80cc3e0 con 0x7fa8b8154f90 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8b815e0f0 0x7fa8b80c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa8b815e0f0 0x7fa8b80c7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57068/0 (socket says 172.21.15.26:57068) 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 -- 172.21.15.26:0/2743645993 learned_addr learned my addr 172.21.15.26:0/2743645993 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b77fe640 1 --2- 172.21.15.26:0/2743645993 >> v2:172.21.15.169:3300/0 conn(0x7fa8b8154f90 0x7fa8b80cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 -- 172.21.15.26:0/2743645993 >> v2:172.21.15.169:3300/0 conn(0x7fa8b8154f90 msgr2=0x7fa8b80cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 --2- 172.21.15.26:0/2743645993 >> v2:172.21.15.169:3300/0 conn(0x7fa8b8154f90 0x7fa8b80cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 -- 172.21.15.26:0/2743645993 >> v1:172.21.15.26:6789/0 conn(0x7fa8b815e510 legacy=0x7fa8b80cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 -- 172.21.15.26:0/2743645993 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b80cc8e0 con 0x7fa8b815e0f0 2024-04-21T08:58:02.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b6ffd640 1 --2- 172.21.15.26:0/2743645993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e0f0 0x7fa8b80c7680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8b808e0c0 tx=0x7fa8a801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4ebb5a82a54da0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b67fc640 1 -- 172.21.15.26:0/2743645993 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80b5070 con 0x7fa8b815e0f0 2024-04-21T08:58:02.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b67fc640 1 -- 172.21.15.26:0/2743645993 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a80a8a10 con 0x7fa8b815e0f0 2024-04-21T08:58:02.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8b67fc640 1 -- 172.21.15.26:0/2743645993 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80a8de0 con 0x7fa8b815e0f0 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8bdd19640 1 -- 172.21.15.26:0/2743645993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e0f0 msgr2=0x7fa8b80c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.838+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/2743645993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e0f0 0x7fa8b80c7680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8b808e0c0 tx=0x7fa8a801ed10 comp rx=0 tx=0).stop 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- 172.21.15.26:0/2743645993 shutdown_connections 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/2743645993 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e0f0 0x7fa8b80c7680 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/2743645993 >> v2:172.21.15.169:3300/0 conn(0x7fa8b8154f90 0x7fa8b80cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- 172.21.15.26:0/2743645993 >> 172.21.15.26:0/2743645993 conn(0x7fa8b806dea0 msgr2=0x7fa8b806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- 172.21.15.26:0/2743645993 shutdown_connections 2024-04-21T08:58:02.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- 172.21.15.26:0/2743645993 wait complete. 2024-04-21T08:58:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 Processor -- start 2024-04-21T08:58:02.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- start start 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8b8154f90 0x7fa8b814dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8b815e0f0 0x7fa8b8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e510 0x7fa8b814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b815b1b0 con 0x7fa8b815e510 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b815b520 con 0x7fa8b815e0f0 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b815ab80 con 0x7fa8b8154f90 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e510 0x7fa8b814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e510 0x7fa8b814cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57080/0 (socket says 172.21.15.26:57080) 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 -- 172.21.15.26:0/573674840 learned_addr learned my addr 172.21.15.26:0/573674840 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b77fe640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8b8154f90 0x7fa8b814dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b6ffd640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8b815e0f0 0x7fa8b8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 -- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8b8154f90 msgr2=0x7fa8b814dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8b8154f90 0x7fa8b814dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 -- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8b815e0f0 msgr2=0x7fa8b8156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8b815e0f0 0x7fa8b8156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 -- 172.21.15.26:0/573674840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b814e930 con 0x7fa8b815e510 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8b7fff640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e510 0x7fa8b814cde0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000c7a0 tx=0x7fa8b000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa89ffff640 1 -- 172.21.15.26:0/573674840 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b0003b80 con 0x7fa8b815e510 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa89ffff640 1 -- 172.21.15.26:0/573674840 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8b0003d20 con 0x7fa8b815e510 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b81f1430 con 0x7fa8b815e510 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa89ffff640 1 -- 172.21.15.26:0/573674840 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8b000aa90 con 0x7fa8b815e510 2024-04-21T08:58:02.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b81f0670 con 0x7fa8b815e510 2024-04-21T08:58:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.842+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b81f1100 con 0x7fa8b815e510 2024-04-21T08:58:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.846+0000 7fa89ffff640 1 -- 172.21.15.26:0/573674840 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8b000ac30 con 0x7fa8b815e510 2024-04-21T08:58:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.846+0000 7fa89ffff640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa8a4068380 0x7fa8a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.846+0000 7fa89ffff640 1 -- 172.21.15.26:0/573674840 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa8b00868d0 con 0x7fa8b815e510 2024-04-21T08:58:02.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.846+0000 7fa8b77fe640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa8a4068380 0x7fa8a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:02.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.846+0000 7fa8b77fe640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa8a4068380 0x7fa8a406a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00b930 tx=0x7fa8ac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:02.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:02.850+0000 7fa89ffff640 1 -- 172.21.15.26:0/573674840 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa8b0056e80 con 0x7fa8b815e510 2024-04-21T08:58:03.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa8b8074320 con 0x7fa8b815e510 2024-04-21T08:58:03.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa89ffff640 1 -- 172.21.15.26:0/573674840 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7fa8b0056780 con 0x7fa8b815e510 2024-04-21T08:58:03.016 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T08:58:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa8a4068380 msgr2=0x7fa8a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa8a4068380 0x7fa8a406a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00b930 tx=0x7fa8ac008040 comp rx=0 tx=0).stop 2024-04-21T08:58:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e510 msgr2=0x7fa8b814cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e510 0x7fa8b814cde0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa8b000c7a0 tx=0x7fa8b000cc60 comp rx=0 tx=0).stop 2024-04-21T08:58:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 shutdown_connections 2024-04-21T08:58:03.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa8a4068380 0x7fa8a406a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa8b815e510 0x7fa8b814cde0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa8b815e0f0 0x7fa8b8156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 --2- 172.21.15.26:0/573674840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa8b8154f90 0x7fa8b814dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 >> 172.21.15.26:0/573674840 conn(0x7fa8b806dea0 msgr2=0x7fa8b80ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 shutdown_connections 2024-04-21T08:58:03.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.014+0000 7fa8bdd19640 1 -- 172.21.15.26:0/573674840 wait complete. 2024-04-21T08:58:03.034 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T08:58:03.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.146+0000 7f88a49f9640 1 Processor -- start 2024-04-21T08:58:03.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.146+0000 7f88a49f9640 1 -- start start 2024-04-21T08:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f88a49f9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88a00cc8d0 0x7f88a015b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f88a49f9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a015e260 con 0x7f88a0154e70 2024-04-21T08:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f88a49f9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88a015e540 con 0x7f88a00cb340 2024-04-21T08:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f88a49f9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f88a015e820 con 0x7f88a00cc8d0 2024-04-21T08:58:03.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f8897fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88a00cc8d0 0x7f88a015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f889e59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f88a0154e70 0x7f88a00d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43252/0 (socket says 172.21.15.26:43252) 2024-04-21T08:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f889e59c640 1 -- 172.21.15.26:0/1635827690 learned_addr learned my addr 172.21.15.26:0/1635827690 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f8897fff640 1 -- 172.21.15.26:0/1635827690 >> v1:172.21.15.169:6789/0 conn(0x7f88a00cb340 legacy=0x7f88a00c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f8897fff640 1 -- 172.21.15.26:0/1635827690 >> v1:172.21.15.26:6789/0 conn(0x7f88a0154e70 legacy=0x7f88a00d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f8897fff640 1 -- 172.21.15.26:0/1635827690 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a015eb00 con 0x7f88a00cc8d0 2024-04-21T08:58:03.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f889dd9b640 1 -- 172.21.15.26:0/1635827690 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893196165 0 0) 0x7f88a015e260 con 0x7f88a0154e70 2024-04-21T08:58:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f8897fff640 1 --2- 172.21.15.26:0/1635827690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a00cc8d0 0x7f88a015b650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f88880097c0 tx=0x7f888801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d70488a3f93ed873 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f889dd9b640 1 -- 172.21.15.26:0/1635827690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880b0070 con 0x7f88a00cc8d0 2024-04-21T08:58:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f889dd9b640 1 -- 172.21.15.26:0/1635827690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88880ab600 con 0x7f88a00cc8d0 2024-04-21T08:58:03.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.150+0000 7f889dd9b640 1 -- 172.21.15.26:0/1635827690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88880ab9d0 con 0x7f88a00cc8d0 2024-04-21T08:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- 172.21.15.26:0/1635827690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a00cc8d0 msgr2=0x7f88a015b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 --2- 172.21.15.26:0/1635827690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a00cc8d0 0x7f88a015b650 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f88880097c0 tx=0x7f888801c460 comp rx=0 tx=0).stop 2024-04-21T08:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- 172.21.15.26:0/1635827690 shutdown_connections 2024-04-21T08:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 --2- 172.21.15.26:0/1635827690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a00cc8d0 0x7f88a015b650 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- 172.21.15.26:0/1635827690 >> 172.21.15.26:0/1635827690 conn(0x7f88a006de70 msgr2=0x7f88a006e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:03.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- 172.21.15.26:0/1635827690 shutdown_connections 2024-04-21T08:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- 172.21.15.26:0/1635827690 wait complete. 2024-04-21T08:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 Processor -- start 2024-04-21T08:58:03.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- start start 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00cb340 0x7f88a014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a00cc8d0 0x7f88a0149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a0154e70 0x7f88a0149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0168f00 con 0x7f88a0154e70 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f88a0168d80 con 0x7f88a00cb340 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f88a0169080 con 0x7f88a00cc8d0 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a0154e70 0x7f88a0149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a0154e70 0x7f88a0149590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57100/0 (socket says 172.21.15.26:57100) 2024-04-21T08:58:03.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 -- 172.21.15.26:0/2008193021 learned_addr learned my addr 172.21.15.26:0/2008193021 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f8897fff640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a00cc8d0 0x7f88a0149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889e59c640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00cb340 0x7f88a014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 -- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a00cc8d0 msgr2=0x7f88a0149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a00cc8d0 0x7f88a0149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 -- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00cb340 msgr2=0x7f88a014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00cb340 0x7f88a014f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 -- 172.21.15.26:0/2008193021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88a01f7080 con 0x7f88a0154e70 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f889ed9d640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a0154e70 0x7f88a0149590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f889800b9c0 tx=0x7f889800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f8896ffd640 1 -- 172.21.15.26:0/2008193021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898019070 con 0x7f88a0154e70 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f8896ffd640 1 -- 172.21.15.26:0/2008193021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889800cba0 con 0x7f88a0154e70 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f8896ffd640 1 -- 172.21.15.26:0/2008193021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8898014440 con 0x7f88a0154e70 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88a01f7340 con 0x7f88a0154e70 2024-04-21T08:58:03.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.154+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88a01f7900 con 0x7f88a0154e70 2024-04-21T08:58:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.158+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a0074320 con 0x7f88a0154e70 2024-04-21T08:58:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.158+0000 7f8896ffd640 1 -- 172.21.15.26:0/2008193021 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8898007370 con 0x7f88a0154e70 2024-04-21T08:58:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.158+0000 7f8896ffd640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f88800683b0 0x7f888006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.158+0000 7f8896ffd640 1 -- 172.21.15.26:0/2008193021 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f88980865a0 con 0x7f88a0154e70 2024-04-21T08:58:03.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.158+0000 7f889e59c640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f88800683b0 0x7f888006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.158+0000 7f889e59c640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f88800683b0 0x7f888006a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8890000f70 tx=0x7f8890009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.162+0000 7f8896ffd640 1 -- 172.21.15.26:0/2008193021 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8898056b60 con 0x7f88a0154e70 2024-04-21T08:58:03.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.322+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f88a00cbea0 con 0x7f88a0154e70 2024-04-21T08:58:03.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f8896ffd640 1 -- 172.21.15.26:0/2008193021 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f8898056460 con 0x7f88a0154e70 2024-04-21T08:58:03.327 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f88800683b0 msgr2=0x7f888006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f88800683b0 0x7f888006a870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8890000f70 tx=0x7f8890009040 comp rx=0 tx=0).stop 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a0154e70 msgr2=0x7f88a0149590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a0154e70 0x7f88a0149590 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f889800b9c0 tx=0x7f889800be80 comp rx=0 tx=0).stop 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 shutdown_connections 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f88800683b0 0x7f888006a870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88a0154e70 0x7f88a0149590 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88a00cc8d0 0x7f88a0149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 --2- 172.21.15.26:0/2008193021 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88a00cb340 0x7f88a014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 >> 172.21.15.26:0/2008193021 conn(0x7f88a006de70 msgr2=0x7f88a015d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 shutdown_connections 2024-04-21T08:58:03.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.326+0000 7f88a49f9640 1 -- 172.21.15.26:0/2008193021 wait complete. 2024-04-21T08:58:03.347 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-21T08:58:03.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T08:58:03.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f800a5c8640 1 Processor -- start 2024-04-21T08:58:03.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f800a5c8640 1 -- start start 2024-04-21T08:58:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f800a5c8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f800415b320 0x7f800415b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f800a5c8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041597d0 0x7f8004157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f800a5c8640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80040c4c20 con 0x7f800415bc40 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f800a5c8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f80040c4f00 con 0x7f800415b320 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f800a5c8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f80040c51e0 con 0x7f80041597d0 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8003fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f800415b320 0x7f800415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8003fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f800415b320 0x7f800415b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57106/0 (socket says 172.21.15.26:57106) 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8003fff640 1 -- 172.21.15.26:0/2066603976 learned_addr learned my addr 172.21.15.26:0/2066603976 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8008b65640 1 --2- 172.21.15.26:0/2066603976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041597d0 0x7f8004157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8003fff640 1 -- 172.21.15.26:0/2066603976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041597d0 msgr2=0x7f8004157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8003fff640 1 --2- 172.21.15.26:0/2066603976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041597d0 0x7f8004157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8003fff640 1 -- 172.21.15.26:0/2066603976 >> v1:172.21.15.169:6789/0 conn(0x7f800415bc40 legacy=0x7f80041590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:03.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.466+0000 7f8003fff640 1 -- 172.21.15.26:0/2066603976 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80040c54c0 con 0x7f800415b320 2024-04-21T08:58:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f8003fff640 1 --2- 172.21.15.26:0/2066603976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f800415b320 0x7f800415b700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009870 tx=0x7f7ff401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad714d979d77b364 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f8002ffd640 1 -- 172.21.15.26:0/2066603976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40b5070 con 0x7f800415b320 2024-04-21T08:58:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f8002ffd640 1 -- 172.21.15.26:0/2066603976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff40a89d0 con 0x7f800415b320 2024-04-21T08:58:03.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f8002ffd640 1 -- 172.21.15.26:0/2066603976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40a8da0 con 0x7f800415b320 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- 172.21.15.26:0/2066603976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f800415b320 msgr2=0x7f800415b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 --2- 172.21.15.26:0/2066603976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f800415b320 0x7f800415b700 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009870 tx=0x7f7ff401ed10 comp rx=0 tx=0).stop 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- 172.21.15.26:0/2066603976 shutdown_connections 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 --2- 172.21.15.26:0/2066603976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041597d0 0x7f8004157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 --2- 172.21.15.26:0/2066603976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f800415b320 0x7f800415b700 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- 172.21.15.26:0/2066603976 >> 172.21.15.26:0/2066603976 conn(0x7f80040c8960 msgr2=0x7f80040c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- 172.21.15.26:0/2066603976 shutdown_connections 2024-04-21T08:58:03.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- 172.21.15.26:0/2066603976 wait complete. 2024-04-21T08:58:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 Processor -- start 2024-04-21T08:58:03.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- start start 2024-04-21T08:58:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80041597d0 0x7f8004152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f800415b320 0x7f8004157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041eeb10 0x7f80041eefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f80040c9710 con 0x7f80041597d0 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f80040bfa30 con 0x7f800415b320 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.470+0000 7f800a5c8640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f80040c9890 con 0x7f80041eeb10 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80041597d0 0x7f8004152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80041597d0 0x7f8004152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57108/0 (socket says 172.21.15.26:57108) 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 -- 172.21.15.26:0/1719998870 learned_addr learned my addr 172.21.15.26:0/1719998870 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8008b65640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041eeb10 0x7f80041eefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f80037fe640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f800415b320 0x7f8004157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 -- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041eeb10 msgr2=0x7f80041eefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041eeb10 0x7f80041eefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 -- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f800415b320 msgr2=0x7f8004157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f800415b320 0x7f8004157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 -- 172.21.15.26:0/1719998870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8004156e40 con 0x7f80041597d0 2024-04-21T08:58:03.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8003fff640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80041597d0 0x7f8004152780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40b3040 tx=0x7f7ff401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8000ff9640 1 -- 172.21.15.26:0/1719998870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40c0070 con 0x7f80041597d0 2024-04-21T08:58:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8000ff9640 1 -- 172.21.15.26:0/1719998870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ff40b0a50 con 0x7f80041597d0 2024-04-21T08:58:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8004157120 con 0x7f80041597d0 2024-04-21T08:58:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8000ff9640 1 -- 172.21.15.26:0/1719998870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40b5070 con 0x7f80041597d0 2024-04-21T08:58:03.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80041576e0 con 0x7f80041597d0 2024-04-21T08:58:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8004157920 con 0x7f80041597d0 2024-04-21T08:58:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8000ff9640 1 -- 172.21.15.26:0/1719998870 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ff40c3070 con 0x7f80041597d0 2024-04-21T08:58:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8000ff9640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ff0068380 0x7f7ff006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f8000ff9640 1 -- 172.21.15.26:0/1719998870 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7ff4123af0 con 0x7f80041597d0 2024-04-21T08:58:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.474+0000 7f80037fe640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ff0068380 0x7f7ff006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.478+0000 7f80037fe640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ff0068380 0x7f7ff006a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80041ec380 tx=0x7f7ff8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.478+0000 7f8000ff9640 1 -- 172.21.15.26:0/1719998870 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8004157920 con 0x7f80041597d0 2024-04-21T08:58:03.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.638+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8004068260 con 0x7f7ff0068380 2024-04-21T08:58:03.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.658+0000 7f8000ff9640 1 -- 172.21.15.26:0/1719998870 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251925 (secure 0 0 0) 0x7f8004068260 con 0x7f7ff0068380 2024-04-21T08:58:03.662 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:03.664 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T08:58:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ff0068380 msgr2=0x7f7ff006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ff0068380 0x7f7ff006a840 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80041ec380 tx=0x7f7ff8008040 comp rx=0 tx=0).stop 2024-04-21T08:58:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80041597d0 msgr2=0x7f8004152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80041597d0 0x7f8004152780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40b3040 tx=0x7f7ff401bab0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 shutdown_connections 2024-04-21T08:58:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80041eeb10 0x7f80041eefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f800415b320 0x7f8004157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ff0068380 0x7f7ff006a840 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 --2- 172.21.15.26:0/1719998870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80041597d0 0x7f8004152780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 >> 172.21.15.26:0/1719998870 conn(0x7f80040c8960 msgr2=0x7f800415a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 shutdown_connections 2024-04-21T08:58:03.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.662+0000 7f800a5c8640 1 -- 172.21.15.26:0/1719998870 wait complete. 2024-04-21T08:58:03.682 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-21T08:58:03.129982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234600,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740120,"statfs":{"total":773094113280,"available":772853882880,"internally_reserved":0,"allocated":1867776,"data_stored":1773845,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478008+0000","last_change":"2024-04-21T08:57:44.312400+0000","last_active":"2024-04-21T08:57:45.478008+0000","last_peered":"2024-04-21T08:57:45.478008+0000","last_clean":"2024-04-21T08:57:45.478008+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T08:57:45.478008+0000","last_undegraded":"2024-04-21T08:57:45.478008+0000","last_fullsized":"2024-04-21T08:57:45.478008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302244+0000","last_change":"2024-04-21T08:57:44.307469+0000","last_active":"2024-04-21T08:57:45.302244+0000","last_peered":"2024-04-21T08:57:45.302244+0000","last_clean":"2024-04-21T08:57:45.302244+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T08:57:45.302244+0000","last_undegraded":"2024-04-21T08:57:45.302244+0000","last_fullsized":"2024-04-21T08:57:45.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301915+0000","last_change":"2024-04-21T08:57:44.283704+0000","last_active":"2024-04-21T08:57:45.301915+0000","last_peered":"2024-04-21T08:57:45.301915+0000","last_clean":"2024-04-21T08:57:45.301915+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T08:57:45.301915+0000","last_undegraded":"2024-04-21T08:57:45.301915+0000","last_fullsized":"2024-04-21T08:57:45.301915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:22:29.477559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474882+0000","last_change":"2024-04-21T08:57:44.297940+0000","last_active":"2024-04-21T08:57:45.474882+0000","last_peered":"2024-04-21T08:57:45.474882+0000","last_clean":"2024-04-21T08:57:45.474882+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T08:57:45.474882+0000","last_undegraded":"2024-04-21T08:57:45.474882+0000","last_fullsized":"2024-04-21T08:57:45.474882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477621+0000","last_change":"2024-04-21T08:57:44.319147+0000","last_active":"2024-04-21T08:57:45.477621+0000","last_peered":"2024-04-21T08:57:45.477621+0000","last_clean":"2024-04-21T08:57:45.477621+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T08:57:45.477621+0000","last_undegraded":"2024-04-21T08:57:45.477621+0000","last_fullsized":"2024-04-21T08:57:45.477621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475406+0000","last_change":"2024-04-21T08:57:44.292228+0000","last_active":"2024-04-21T08:57:45.475406+0000","last_peered":"2024-04-21T08:57:45.475406+0000","last_clean":"2024-04-21T08:57:45.475406+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T08:57:45.475406+0000","last_undegraded":"2024-04-21T08:57:45.475406+0000","last_fullsized":"2024-04-21T08:57:45.475406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476097+0000","last_change":"2024-04-21T08:57:44.307483+0000","last_active":"2024-04-21T08:57:45.476097+0000","last_peered":"2024-04-21T08:57:45.476097+0000","last_clean":"2024-04-21T08:57:45.476097+0000","last_became_active":"2024-04-21T08:57:44.307147+0000","last_became_peered":"2024-04-21T08:57:44.307147+0000","last_unstale":"2024-04-21T08:57:45.476097+0000","last_undegraded":"2024-04-21T08:57:45.476097+0000","last_fullsized":"2024-04-21T08:57:45.476097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301538+0000","last_change":"2024-04-21T08:57:44.316305+0000","last_active":"2024-04-21T08:57:45.301538+0000","last_peered":"2024-04-21T08:57:45.301538+0000","last_clean":"2024-04-21T08:57:45.301538+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T08:57:45.301538+0000","last_undegraded":"2024-04-21T08:57:45.301538+0000","last_fullsized":"2024-04-21T08:57:45.301538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:02.718251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296716+0000","last_change":"2024-04-21T08:57:44.306928+0000","last_active":"2024-04-21T08:57:45.296716+0000","last_peered":"2024-04-21T08:57:45.296716+0000","last_clean":"2024-04-21T08:57:45.296716+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T08:57:45.296716+0000","last_undegraded":"2024-04-21T08:57:45.296716+0000","last_fullsized":"2024-04-21T08:57:45.296716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:47.382588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477106+0000","last_change":"2024-04-21T08:57:44.307925+0000","last_active":"2024-04-21T08:57:45.477106+0000","last_peered":"2024-04-21T08:57:45.477106+0000","last_clean":"2024-04-21T08:57:45.477106+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T08:57:45.477106+0000","last_undegraded":"2024-04-21T08:57:45.477106+0000","last_fullsized":"2024-04-21T08:57:45.477106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475344+0000","last_change":"2024-04-21T08:57:44.312289+0000","last_active":"2024-04-21T08:57:45.475344+0000","last_peered":"2024-04-21T08:57:45.475344+0000","last_clean":"2024-04-21T08:57:45.475344+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T08:57:45.475344+0000","last_undegraded":"2024-04-21T08:57:45.475344+0000","last_fullsized":"2024-04-21T08:57:45.475344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477952+0000","last_change":"2024-04-21T08:57:44.315406+0000","last_active":"2024-04-21T08:57:45.477952+0000","last_peered":"2024-04-21T08:57:45.477952+0000","last_clean":"2024-04-21T08:57:45.477952+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T08:57:45.477952+0000","last_undegraded":"2024-04-21T08:57:45.477952+0000","last_fullsized":"2024-04-21T08:57:45.477952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475316+0000","last_change":"2024-04-21T08:57:44.321357+0000","last_active":"2024-04-21T08:57:45.475316+0000","last_peered":"2024-04-21T08:57:45.475316+0000","last_clean":"2024-04-21T08:57:45.475316+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T08:57:45.475316+0000","last_undegraded":"2024-04-21T08:57:45.475316+0000","last_fullsized":"2024-04-21T08:57:45.475316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:01:59.921966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475445+0000","last_change":"2024-04-21T08:57:44.315428+0000","last_active":"2024-04-21T08:57:45.475445+0000","last_peered":"2024-04-21T08:57:45.475445+0000","last_clean":"2024-04-21T08:57:45.475445+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T08:57:45.475445+0000","last_undegraded":"2024-04-21T08:57:45.475445+0000","last_fullsized":"2024-04-21T08:57:45.475445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301076+0000","last_change":"2024-04-21T08:57:44.285663+0000","last_active":"2024-04-21T08:57:45.301076+0000","last_peered":"2024-04-21T08:57:45.301076+0000","last_clean":"2024-04-21T08:57:45.301076+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T08:57:45.301076+0000","last_undegraded":"2024-04-21T08:57:45.301076+0000","last_fullsized":"2024-04-21T08:57:45.301076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:54:18.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474994+0000","last_change":"2024-04-21T08:57:44.288842+0000","last_active":"2024-04-21T08:57:45.474994+0000","last_peered":"2024-04-21T08:57:45.474994+0000","last_clean":"2024-04-21T08:57:45.474994+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T08:57:45.474994+0000","last_undegraded":"2024-04-21T08:57:45.474994+0000","last_fullsized":"2024-04-21T08:57:45.474994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479022+0000","last_change":"2024-04-21T08:57:44.320371+0000","last_active":"2024-04-21T08:57:45.479022+0000","last_peered":"2024-04-21T08:57:45.479022+0000","last_clean":"2024-04-21T08:57:45.479022+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T08:57:45.479022+0000","last_undegraded":"2024-04-21T08:57:45.479022+0000","last_fullsized":"2024-04-21T08:57:45.479022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:37:23.456724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474849+0000","last_change":"2024-04-21T08:57:44.302161+0000","last_active":"2024-04-21T08:57:45.474849+0000","last_peered":"2024-04-21T08:57:45.474849+0000","last_clean":"2024-04-21T08:57:45.474849+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T08:57:45.474849+0000","last_undegraded":"2024-04-21T08:57:45.474849+0000","last_fullsized":"2024-04-21T08:57:45.474849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478601+0000","last_change":"2024-04-21T08:57:44.289531+0000","last_active":"2024-04-21T08:57:45.478601+0000","last_peered":"2024-04-21T08:57:45.478601+0000","last_clean":"2024-04-21T08:57:45.478601+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T08:57:45.478601+0000","last_undegraded":"2024-04-21T08:57:45.478601+0000","last_fullsized":"2024-04-21T08:57:45.478601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:42:25.869615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477213+0000","last_change":"2024-04-21T08:57:44.315116+0000","last_active":"2024-04-21T08:57:45.477213+0000","last_peered":"2024-04-21T08:57:45.477213+0000","last_clean":"2024-04-21T08:57:45.477213+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T08:57:45.477213+0000","last_undegraded":"2024-04-21T08:57:45.477213+0000","last_fullsized":"2024-04-21T08:57:45.477213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300338+0000","last_change":"2024-04-21T08:57:44.299295+0000","last_active":"2024-04-21T08:57:45.300338+0000","last_peered":"2024-04-21T08:57:45.300338+0000","last_clean":"2024-04-21T08:57:45.300338+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T08:57:45.300338+0000","last_undegraded":"2024-04-21T08:57:45.300338+0000","last_fullsized":"2024-04-21T08:57:45.300338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:32:23.460346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296074+0000","last_change":"2024-04-21T08:57:44.293141+0000","last_active":"2024-04-21T08:57:45.296074+0000","last_peered":"2024-04-21T08:57:45.296074+0000","last_clean":"2024-04-21T08:57:45.296074+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T08:57:45.296074+0000","last_undegraded":"2024-04-21T08:57:45.296074+0000","last_fullsized":"2024-04-21T08:57:45.296074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301628+0000","last_change":"2024-04-21T08:57:44.291347+0000","last_active":"2024-04-21T08:57:45.301628+0000","last_peered":"2024-04-21T08:57:45.301628+0000","last_clean":"2024-04-21T08:57:45.301628+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T08:57:45.301628+0000","last_undegraded":"2024-04-21T08:57:45.301628+0000","last_fullsized":"2024-04-21T08:57:45.301628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:29.349924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475426+0000","last_change":"2024-04-21T08:57:44.283481+0000","last_active":"2024-04-21T08:57:45.475426+0000","last_peered":"2024-04-21T08:57:45.475426+0000","last_clean":"2024-04-21T08:57:45.475426+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T08:57:45.475426+0000","last_undegraded":"2024-04-21T08:57:45.475426+0000","last_fullsized":"2024-04-21T08:57:45.475426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302199+0000","last_change":"2024-04-21T08:57:44.304218+0000","last_active":"2024-04-21T08:57:45.302199+0000","last_peered":"2024-04-21T08:57:45.302199+0000","last_clean":"2024-04-21T08:57:45.302199+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T08:57:45.302199+0000","last_undegraded":"2024-04-21T08:57:45.302199+0000","last_fullsized":"2024-04-21T08:57:45.302199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476814+0000","last_change":"2024-04-21T08:57:44.305569+0000","last_active":"2024-04-21T08:57:45.476814+0000","last_peered":"2024-04-21T08:57:45.476814+0000","last_clean":"2024-04-21T08:57:45.476814+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T08:57:45.476814+0000","last_undegraded":"2024-04-21T08:57:45.476814+0000","last_fullsized":"2024-04-21T08:57:45.476814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476147+0000","last_change":"2024-04-21T08:57:44.314872+0000","last_active":"2024-04-21T08:57:45.476147+0000","last_peered":"2024-04-21T08:57:45.476147+0000","last_clean":"2024-04-21T08:57:45.476147+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T08:57:45.476147+0000","last_undegraded":"2024-04-21T08:57:45.476147+0000","last_fullsized":"2024-04-21T08:57:45.476147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475471+0000","last_change":"2024-04-21T08:57:44.320786+0000","last_active":"2024-04-21T08:57:45.475471+0000","last_peered":"2024-04-21T08:57:45.475471+0000","last_clean":"2024-04-21T08:57:45.475471+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T08:57:45.475471+0000","last_undegraded":"2024-04-21T08:57:45.475471+0000","last_fullsized":"2024-04-21T08:57:45.475471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301360+0000","last_change":"2024-04-21T08:57:44.292576+0000","last_active":"2024-04-21T08:57:45.301360+0000","last_peered":"2024-04-21T08:57:45.301360+0000","last_clean":"2024-04-21T08:57:45.301360+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T08:57:45.301360+0000","last_undegraded":"2024-04-21T08:57:45.301360+0000","last_fullsized":"2024-04-21T08:57:45.301360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:41:15.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476800+0000","last_change":"2024-04-21T08:57:44.301159+0000","last_active":"2024-04-21T08:57:45.476800+0000","last_peered":"2024-04-21T08:57:45.476800+0000","last_clean":"2024-04-21T08:57:45.476800+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T08:57:45.476800+0000","last_undegraded":"2024-04-21T08:57:45.476800+0000","last_fullsized":"2024-04-21T08:57:45.476800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473997+0000","last_change":"2024-04-21T08:57:44.295923+0000","last_active":"2024-04-21T08:57:45.473997+0000","last_peered":"2024-04-21T08:57:45.473997+0000","last_clean":"2024-04-21T08:57:45.473997+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T08:57:45.473997+0000","last_undegraded":"2024-04-21T08:57:45.473997+0000","last_fullsized":"2024-04-21T08:57:45.473997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474254+0000","last_change":"2024-04-21T08:57:44.317457+0000","last_active":"2024-04-21T08:57:45.474254+0000","last_peered":"2024-04-21T08:57:45.474254+0000","last_clean":"2024-04-21T08:57:45.474254+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T08:57:45.474254+0000","last_undegraded":"2024-04-21T08:57:45.474254+0000","last_fullsized":"2024-04-21T08:57:45.474254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:17.843858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296164+0000","last_change":"2024-04-21T08:57:44.293278+0000","last_active":"2024-04-21T08:57:45.296164+0000","last_peered":"2024-04-21T08:57:45.296164+0000","last_clean":"2024-04-21T08:57:45.296164+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T08:57:45.296164+0000","last_undegraded":"2024-04-21T08:57:45.296164+0000","last_fullsized":"2024-04-21T08:57:45.296164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162151+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T08:57:47.162151+0000","last_peered":"2024-04-21T08:57:47.162151+0000","last_clean":"2024-04-21T08:57:47.162151+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T08:57:47.162151+0000","last_undegraded":"2024-04-21T08:57:47.162151+0000","last_fullsized":"2024-04-21T08:57:47.162151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300238+0000","last_change":"2024-04-21T08:57:44.308011+0000","last_active":"2024-04-21T08:57:45.300238+0000","last_peered":"2024-04-21T08:57:45.300238+0000","last_clean":"2024-04-21T08:57:45.300238+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T08:57:45.300238+0000","last_undegraded":"2024-04-21T08:57:45.300238+0000","last_fullsized":"2024-04-21T08:57:45.300238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:45.396672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478237+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T08:57:45.478237+0000","last_peered":"2024-04-21T08:57:45.478237+0000","last_clean":"2024-04-21T08:57:45.478237+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T08:57:45.478237+0000","last_undegraded":"2024-04-21T08:57:45.478237+0000","last_fullsized":"2024-04-21T08:57:45.478237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475213+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T08:57:45.475213+0000","last_peered":"2024-04-21T08:57:45.475213+0000","last_clean":"2024-04-21T08:57:45.475213+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T08:57:45.475213+0000","last_undegraded":"2024-04-21T08:57:45.475213+0000","last_fullsized":"2024-04-21T08:57:45.475213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302334+0000","last_change":"2024-04-21T08:57:44.307616+0000","last_active":"2024-04-21T08:57:45.302334+0000","last_peered":"2024-04-21T08:57:45.302334+0000","last_clean":"2024-04-21T08:57:45.302334+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T08:57:45.302334+0000","last_undegraded":"2024-04-21T08:57:45.302334+0000","last_fullsized":"2024-04-21T08:57:45.302334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475348+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T08:57:45.475348+0000","last_peered":"2024-04-21T08:57:45.475348+0000","last_clean":"2024-04-21T08:57:45.475348+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T08:57:45.475348+0000","last_undegraded":"2024-04-21T08:57:45.475348+0000","last_fullsized":"2024-04-21T08:57:45.475348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300102+0000","last_change":"2024-04-21T08:57:44.285516+0000","last_active":"2024-04-21T08:57:45.300102+0000","last_peered":"2024-04-21T08:57:45.300102+0000","last_clean":"2024-04-21T08:57:45.300102+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T08:57:45.300102+0000","last_undegraded":"2024-04-21T08:57:45.300102+0000","last_fullsized":"2024-04-21T08:57:45.300102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296625+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T08:57:45.296625+0000","last_peered":"2024-04-21T08:57:45.296625+0000","last_clean":"2024-04-21T08:57:45.296625+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T08:57:45.296625+0000","last_undegraded":"2024-04-21T08:57:45.296625+0000","last_fullsized":"2024-04-21T08:57:45.296625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477228+0000","last_change":"2024-04-21T08:57:44.305837+0000","last_active":"2024-04-21T08:57:45.477228+0000","last_peered":"2024-04-21T08:57:45.477228+0000","last_clean":"2024-04-21T08:57:45.477228+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T08:57:45.477228+0000","last_undegraded":"2024-04-21T08:57:45.477228+0000","last_fullsized":"2024-04-21T08:57:45.477228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477323+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T08:57:45.477323+0000","last_peered":"2024-04-21T08:57:45.477323+0000","last_clean":"2024-04-21T08:57:45.477323+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T08:57:45.477323+0000","last_undegraded":"2024-04-21T08:57:45.477323+0000","last_fullsized":"2024-04-21T08:57:45.477323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302616+0000","last_change":"2024-04-21T08:57:44.305156+0000","last_active":"2024-04-21T08:57:45.302616+0000","last_peered":"2024-04-21T08:57:45.302616+0000","last_clean":"2024-04-21T08:57:45.302616+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T08:57:45.302616+0000","last_undegraded":"2024-04-21T08:57:45.302616+0000","last_fullsized":"2024-04-21T08:57:45.302616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.320749+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T08:57:49.320749+0000","last_peered":"2024-04-21T08:57:49.320749+0000","last_clean":"2024-04-21T08:57:49.320749+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T08:57:49.320749+0000","last_undegraded":"2024-04-21T08:57:49.320749+0000","last_fullsized":"2024-04-21T08:57:49.320749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476386+0000","last_change":"2024-04-21T08:57:44.296804+0000","last_active":"2024-04-21T08:57:45.476386+0000","last_peered":"2024-04-21T08:57:45.476386+0000","last_clean":"2024-04-21T08:57:45.476386+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T08:57:45.476386+0000","last_undegraded":"2024-04-21T08:57:45.476386+0000","last_fullsized":"2024-04-21T08:57:45.476386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319718+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T08:57:49.319718+0000","last_peered":"2024-04-21T08:57:49.319718+0000","last_clean":"2024-04-21T08:57:49.319718+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T08:57:49.319718+0000","last_undegraded":"2024-04-21T08:57:49.319718+0000","last_fullsized":"2024-04-21T08:57:49.319718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475742+0000","last_change":"2024-04-21T08:57:44.323678+0000","last_active":"2024-04-21T08:57:45.475742+0000","last_peered":"2024-04-21T08:57:45.475742+0000","last_clean":"2024-04-21T08:57:45.475742+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T08:57:45.475742+0000","last_undegraded":"2024-04-21T08:57:45.475742+0000","last_fullsized":"2024-04-21T08:57:45.475742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318895+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T08:57:49.318895+0000","last_peered":"2024-04-21T08:57:49.318895+0000","last_clean":"2024-04-21T08:57:49.318895+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T08:57:49.318895+0000","last_undegraded":"2024-04-21T08:57:49.318895+0000","last_fullsized":"2024-04-21T08:57:49.318895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475320+0000","last_change":"2024-04-21T08:57:44.310092+0000","last_active":"2024-04-21T08:57:45.475320+0000","last_peered":"2024-04-21T08:57:45.475320+0000","last_clean":"2024-04-21T08:57:45.475320+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T08:57:45.475320+0000","last_undegraded":"2024-04-21T08:57:45.475320+0000","last_fullsized":"2024-04-21T08:57:45.475320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:03.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478308+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T08:57:45.478308+0000","last_peered":"2024-04-21T08:57:45.478308+0000","last_clean":"2024-04-21T08:57:45.478308+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T08:57:45.478308+0000","last_undegraded":"2024-04-21T08:57:45.478308+0000","last_fullsized":"2024-04-21T08:57:45.478308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477225+0000","last_change":"2024-04-21T08:57:44.320598+0000","last_active":"2024-04-21T08:57:45.477225+0000","last_peered":"2024-04-21T08:57:45.477225+0000","last_clean":"2024-04-21T08:57:45.477225+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T08:57:45.477225+0000","last_undegraded":"2024-04-21T08:57:45.477225+0000","last_fullsized":"2024-04-21T08:57:45.477225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:51.743927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476234+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T08:57:45.476234+0000","last_peered":"2024-04-21T08:57:45.476234+0000","last_clean":"2024-04-21T08:57:45.476234+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T08:57:45.476234+0000","last_undegraded":"2024-04-21T08:57:45.476234+0000","last_fullsized":"2024-04-21T08:57:45.476234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295791+0000","last_change":"2024-04-21T08:57:44.292658+0000","last_active":"2024-04-21T08:57:45.295791+0000","last_peered":"2024-04-21T08:57:45.295791+0000","last_clean":"2024-04-21T08:57:45.295791+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T08:57:45.295791+0000","last_undegraded":"2024-04-21T08:57:45.295791+0000","last_fullsized":"2024-04-21T08:57:45.295791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.321102+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T08:57:49.321102+0000","last_peered":"2024-04-21T08:57:49.321102+0000","last_clean":"2024-04-21T08:57:49.321102+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T08:57:49.321102+0000","last_undegraded":"2024-04-21T08:57:49.321102+0000","last_fullsized":"2024-04-21T08:57:49.321102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475925+0000","last_change":"2024-04-21T08:57:44.289358+0000","last_active":"2024-04-21T08:57:45.475925+0000","last_peered":"2024-04-21T08:57:45.475925+0000","last_clean":"2024-04-21T08:57:45.475925+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T08:57:45.475925+0000","last_undegraded":"2024-04-21T08:57:45.475925+0000","last_fullsized":"2024-04-21T08:57:45.475925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478220+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T08:57:45.478220+0000","last_peered":"2024-04-21T08:57:45.478220+0000","last_clean":"2024-04-21T08:57:45.478220+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T08:57:45.478220+0000","last_undegraded":"2024-04-21T08:57:45.478220+0000","last_fullsized":"2024-04-21T08:57:45.478220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477620+0000","last_change":"2024-04-21T08:57:44.321062+0000","last_active":"2024-04-21T08:57:45.477620+0000","last_peered":"2024-04-21T08:57:45.477620+0000","last_clean":"2024-04-21T08:57:45.477620+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T08:57:45.477620+0000","last_undegraded":"2024-04-21T08:57:45.477620+0000","last_fullsized":"2024-04-21T08:57:45.477620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318978+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T08:57:49.318978+0000","last_peered":"2024-04-21T08:57:49.318978+0000","last_clean":"2024-04-21T08:57:49.318978+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T08:57:49.318978+0000","last_undegraded":"2024-04-21T08:57:49.318978+0000","last_fullsized":"2024-04-21T08:57:49.318978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477974+0000","last_change":"2024-04-21T08:57:44.315764+0000","last_active":"2024-04-21T08:57:45.477974+0000","last_peered":"2024-04-21T08:57:45.477974+0000","last_clean":"2024-04-21T08:57:45.477974+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T08:57:45.477974+0000","last_undegraded":"2024-04-21T08:57:45.477974+0000","last_fullsized":"2024-04-21T08:57:45.477974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162213+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T08:57:47.162213+0000","last_peered":"2024-04-21T08:57:47.162213+0000","last_clean":"2024-04-21T08:57:47.162213+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T08:57:47.162213+0000","last_undegraded":"2024-04-21T08:57:47.162213+0000","last_fullsized":"2024-04-21T08:57:47.162213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477623+0000","last_change":"2024-04-21T08:57:44.315316+0000","last_active":"2024-04-21T08:57:45.477623+0000","last_peered":"2024-04-21T08:57:45.477623+0000","last_clean":"2024-04-21T08:57:45.477623+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T08:57:45.477623+0000","last_undegraded":"2024-04-21T08:57:45.477623+0000","last_fullsized":"2024-04-21T08:57:45.477623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475756+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T08:57:45.475756+0000","last_peered":"2024-04-21T08:57:45.475756+0000","last_clean":"2024-04-21T08:57:45.475756+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T08:57:45.475756+0000","last_undegraded":"2024-04-21T08:57:45.475756+0000","last_fullsized":"2024-04-21T08:57:45.475756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478318+0000","last_change":"2024-04-21T08:57:44.298472+0000","last_active":"2024-04-21T08:57:45.478318+0000","last_peered":"2024-04-21T08:57:45.478318+0000","last_clean":"2024-04-21T08:57:45.478318+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T08:57:45.478318+0000","last_undegraded":"2024-04-21T08:57:45.478318+0000","last_fullsized":"2024-04-21T08:57:45.478318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:14:06.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295542+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T08:57:45.295542+0000","last_peered":"2024-04-21T08:57:45.295542+0000","last_clean":"2024-04-21T08:57:45.295542+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T08:57:45.295542+0000","last_undegraded":"2024-04-21T08:57:45.295542+0000","last_fullsized":"2024-04-21T08:57:45.295542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477601+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T08:57:45.477601+0000","last_peered":"2024-04-21T08:57:45.477601+0000","last_clean":"2024-04-21T08:57:45.477601+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T08:57:45.477601+0000","last_undegraded":"2024-04-21T08:57:45.477601+0000","last_fullsized":"2024-04-21T08:57:45.477601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300093+0000","last_change":"2024-04-21T08:57:44.289877+0000","last_active":"2024-04-21T08:57:45.300093+0000","last_peered":"2024-04-21T08:57:45.300093+0000","last_clean":"2024-04-21T08:57:45.300093+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T08:57:45.300093+0000","last_undegraded":"2024-04-21T08:57:45.300093+0000","last_fullsized":"2024-04-21T08:57:45.300093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475561+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T08:57:45.475561+0000","last_peered":"2024-04-21T08:57:45.475561+0000","last_clean":"2024-04-21T08:57:45.475561+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T08:57:45.475561+0000","last_undegraded":"2024-04-21T08:57:45.475561+0000","last_fullsized":"2024-04-21T08:57:45.475561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474956+0000","last_change":"2024-04-21T08:57:44.309539+0000","last_active":"2024-04-21T08:57:45.474956+0000","last_peered":"2024-04-21T08:57:45.474956+0000","last_clean":"2024-04-21T08:57:45.474956+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T08:57:45.474956+0000","last_undegraded":"2024-04-21T08:57:45.474956+0000","last_fullsized":"2024-04-21T08:57:45.474956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:47:34.419511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473930+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T08:57:45.473930+0000","last_peered":"2024-04-21T08:57:45.473930+0000","last_clean":"2024-04-21T08:57:45.473930+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T08:57:45.473930+0000","last_undegraded":"2024-04-21T08:57:45.473930+0000","last_fullsized":"2024-04-21T08:57:45.473930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301947+0000","last_change":"2024-04-21T08:57:44.298533+0000","last_active":"2024-04-21T08:57:45.301947+0000","last_peered":"2024-04-21T08:57:45.301947+0000","last_clean":"2024-04-21T08:57:45.301947+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T08:57:45.301947+0000","last_undegraded":"2024-04-21T08:57:45.301947+0000","last_fullsized":"2024-04-21T08:57:45.301947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478433+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T08:57:45.478433+0000","last_peered":"2024-04-21T08:57:45.478433+0000","last_clean":"2024-04-21T08:57:45.478433+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T08:57:45.478433+0000","last_undegraded":"2024-04-21T08:57:45.478433+0000","last_fullsized":"2024-04-21T08:57:45.478433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477998+0000","last_change":"2024-04-21T08:57:44.315633+0000","last_active":"2024-04-21T08:57:45.477998+0000","last_peered":"2024-04-21T08:57:45.477998+0000","last_clean":"2024-04-21T08:57:45.477998+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T08:57:45.477998+0000","last_undegraded":"2024-04-21T08:57:45.477998+0000","last_fullsized":"2024-04-21T08:57:45.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301760+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T08:57:45.301760+0000","last_peered":"2024-04-21T08:57:45.301760+0000","last_clean":"2024-04-21T08:57:45.301760+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T08:57:45.301760+0000","last_undegraded":"2024-04-21T08:57:45.301760+0000","last_fullsized":"2024-04-21T08:57:45.301760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475775+0000","last_change":"2024-04-21T08:57:44.318478+0000","last_active":"2024-04-21T08:57:45.475775+0000","last_peered":"2024-04-21T08:57:45.475775+0000","last_clean":"2024-04-21T08:57:45.475775+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T08:57:45.475775+0000","last_undegraded":"2024-04-21T08:57:45.475775+0000","last_fullsized":"2024-04-21T08:57:45.475775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478561+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T08:57:45.478561+0000","last_peered":"2024-04-21T08:57:45.478561+0000","last_clean":"2024-04-21T08:57:45.478561+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T08:57:45.478561+0000","last_undegraded":"2024-04-21T08:57:45.478561+0000","last_fullsized":"2024-04-21T08:57:45.478561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475343+0000","last_change":"2024-04-21T08:57:44.305172+0000","last_active":"2024-04-21T08:57:45.475343+0000","last_peered":"2024-04-21T08:57:45.475343+0000","last_clean":"2024-04-21T08:57:45.475343+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T08:57:45.475343+0000","last_undegraded":"2024-04-21T08:57:45.475343+0000","last_fullsized":"2024-04-21T08:57:45.475343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:13:46.282333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:46.165779+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T08:57:46.165779+0000","last_peered":"2024-04-21T08:57:46.165779+0000","last_clean":"2024-04-21T08:57:46.165779+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T08:57:46.165779+0000","last_undegraded":"2024-04-21T08:57:46.165779+0000","last_fullsized":"2024-04-21T08:57:46.165779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300739+0000","last_change":"2024-04-21T08:57:44.311283+0000","last_active":"2024-04-21T08:57:45.300739+0000","last_peered":"2024-04-21T08:57:45.300739+0000","last_clean":"2024-04-21T08:57:45.300739+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T08:57:45.300739+0000","last_undegraded":"2024-04-21T08:57:45.300739+0000","last_fullsized":"2024-04-21T08:57:45.300739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:06:14.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.316902+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T08:57:49.316902+0000","last_peered":"2024-04-21T08:57:49.316902+0000","last_clean":"2024-04-21T08:57:49.316902+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T08:57:49.316902+0000","last_undegraded":"2024-04-21T08:57:49.316902+0000","last_fullsized":"2024-04-21T08:57:49.316902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300568+0000","last_change":"2024-04-21T08:57:44.293449+0000","last_active":"2024-04-21T08:57:45.300568+0000","last_peered":"2024-04-21T08:57:45.300568+0000","last_clean":"2024-04-21T08:57:45.300568+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T08:57:45.300568+0000","last_undegraded":"2024-04-21T08:57:45.300568+0000","last_fullsized":"2024-04-21T08:57:45.300568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:13:04.768707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474913+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T08:57:45.474913+0000","last_peered":"2024-04-21T08:57:45.474913+0000","last_clean":"2024-04-21T08:57:45.474913+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T08:57:45.474913+0000","last_undegraded":"2024-04-21T08:57:45.474913+0000","last_fullsized":"2024-04-21T08:57:45.474913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476103+0000","last_change":"2024-04-21T08:57:44.294831+0000","last_active":"2024-04-21T08:57:45.476103+0000","last_peered":"2024-04-21T08:57:45.476103+0000","last_clean":"2024-04-21T08:57:45.476103+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T08:57:45.476103+0000","last_undegraded":"2024-04-21T08:57:45.476103+0000","last_fullsized":"2024-04-21T08:57:45.476103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300649+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T08:57:45.300649+0000","last_peered":"2024-04-21T08:57:45.300649+0000","last_clean":"2024-04-21T08:57:45.300649+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T08:57:45.300649+0000","last_undegraded":"2024-04-21T08:57:45.300649+0000","last_fullsized":"2024-04-21T08:57:45.300649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.299620+0000","last_change":"2024-04-21T08:57:44.299090+0000","last_active":"2024-04-21T08:57:45.299620+0000","last_peered":"2024-04-21T08:57:45.299620+0000","last_clean":"2024-04-21T08:57:45.299620+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T08:57:45.299620+0000","last_undegraded":"2024-04-21T08:57:45.299620+0000","last_fullsized":"2024-04-21T08:57:45.299620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475613+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T08:57:45.475613+0000","last_peered":"2024-04-21T08:57:45.475613+0000","last_clean":"2024-04-21T08:57:45.475613+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T08:57:45.475613+0000","last_undegraded":"2024-04-21T08:57:45.475613+0000","last_fullsized":"2024-04-21T08:57:45.475613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474385+0000","last_change":"2024-04-21T08:57:44.317697+0000","last_active":"2024-04-21T08:57:45.474385+0000","last_peered":"2024-04-21T08:57:45.474385+0000","last_clean":"2024-04-21T08:57:45.474385+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T08:57:45.474385+0000","last_undegraded":"2024-04-21T08:57:45.474385+0000","last_fullsized":"2024-04-21T08:57:45.474385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.317492+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T08:57:49.317492+0000","last_peered":"2024-04-21T08:57:49.317492+0000","last_clean":"2024-04-21T08:57:49.317492+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T08:57:49.317492+0000","last_undegraded":"2024-04-21T08:57:49.317492+0000","last_fullsized":"2024-04-21T08:57:49.317492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478072+0000","last_change":"2024-04-21T08:57:44.300498+0000","last_active":"2024-04-21T08:57:45.478072+0000","last_peered":"2024-04-21T08:57:45.478072+0000","last_clean":"2024-04-21T08:57:45.478072+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T08:57:45.478072+0000","last_undegraded":"2024-04-21T08:57:45.478072+0000","last_fullsized":"2024-04-21T08:57:45.478072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:36:51.242004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478121+0000","last_change":"2024-04-21T08:57:44.321085+0000","last_active":"2024-04-21T08:57:45.478121+0000","last_peered":"2024-04-21T08:57:45.478121+0000","last_clean":"2024-04-21T08:57:45.478121+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T08:57:45.478121+0000","last_undegraded":"2024-04-21T08:57:45.478121+0000","last_fullsized":"2024-04-21T08:57:45.478121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:49.754472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.313140+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T08:57:49.313140+0000","last_peered":"2024-04-21T08:57:49.313140+0000","last_clean":"2024-04-21T08:57:49.313140+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T08:57:49.313140+0000","last_undegraded":"2024-04-21T08:57:49.313140+0000","last_fullsized":"2024-04-21T08:57:49.313140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296663+0000","last_change":"2024-04-21T08:57:44.315810+0000","last_active":"2024-04-21T08:57:45.296663+0000","last_peered":"2024-04-21T08:57:45.296663+0000","last_clean":"2024-04-21T08:57:45.296663+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T08:57:45.296663+0000","last_undegraded":"2024-04-21T08:57:45.296663+0000","last_fullsized":"2024-04-21T08:57:45.296663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.311969+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T08:57:49.311969+0000","last_peered":"2024-04-21T08:57:49.311969+0000","last_clean":"2024-04-21T08:57:49.311969+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T08:57:49.311969+0000","last_undegraded":"2024-04-21T08:57:49.311969+0000","last_fullsized":"2024-04-21T08:57:49.311969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302388+0000","last_change":"2024-04-21T08:57:44.303912+0000","last_active":"2024-04-21T08:57:45.302388+0000","last_peered":"2024-04-21T08:57:45.302388+0000","last_clean":"2024-04-21T08:57:45.302388+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T08:57:45.302388+0000","last_undegraded":"2024-04-21T08:57:45.302388+0000","last_fullsized":"2024-04-21T08:57:45.302388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162279+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T08:57:47.162279+0000","last_peered":"2024-04-21T08:57:47.162279+0000","last_clean":"2024-04-21T08:57:47.162279+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T08:57:47.162279+0000","last_undegraded":"2024-04-21T08:57:47.162279+0000","last_fullsized":"2024-04-21T08:57:47.162279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302272+0000","last_change":"2024-04-21T08:57:44.301951+0000","last_active":"2024-04-21T08:57:45.302272+0000","last_peered":"2024-04-21T08:57:45.302272+0000","last_clean":"2024-04-21T08:57:45.302272+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T08:57:45.302272+0000","last_undegraded":"2024-04-21T08:57:45.302272+0000","last_fullsized":"2024-04-21T08:57:45.302272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319970+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T08:57:49.319970+0000","last_peered":"2024-04-21T08:57:49.319970+0000","last_clean":"2024-04-21T08:57:49.319970+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T08:57:49.319970+0000","last_undegraded":"2024-04-21T08:57:49.319970+0000","last_fullsized":"2024-04-21T08:57:49.319970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":212992,"data_stored":74063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":75093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":663919,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":217088,"data_stored":73537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":663941,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":76206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T08:58:03.685 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T08:58:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ef56640 1 Processor -- start 2024-04-21T08:58:03.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ef56640 1 -- start start 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ef56640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67680ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ef56640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67681550a0 0x7f67680d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ef56640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f676815ef30 con 0x7f67680ccfe0 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ef56640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f67680b3fd0 con 0x7f67681550a0 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ef56640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f67680b42b0 con 0x7f6768154cc0 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f6767fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67681550a0 0x7f67680d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f6767fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f67681550a0 0x7f67680d0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57110/0 (socket says 172.21.15.26:57110) 2024-04-21T08:58:03.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f6767fff640 1 -- 172.21.15.26:0/1606225343 learned_addr learned my addr 172.21.15.26:0/1606225343 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f676ccf2640 1 --2- 172.21.15.26:0/1606225343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67680ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f6767fff640 1 -- 172.21.15.26:0/1606225343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 msgr2=0x7f67680ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f6767fff640 1 --2- 172.21.15.26:0/1606225343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67680ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f6767fff640 1 -- 172.21.15.26:0/1606225343 >> v1:172.21.15.169:6789/0 conn(0x7f67680ccfe0 legacy=0x7f676815e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.834+0000 7f6767fff640 1 -- 172.21.15.26:0/1606225343 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67680b4590 con 0x7f67681550a0 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f6767fff640 1 --2- 172.21.15.26:0/1606225343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67681550a0 0x7f67680d0350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f675c009870 tx=0x7f675c01ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e96f782384bc4aa server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f67677fe640 1 -- 172.21.15.26:0/1606225343 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0b5070 con 0x7f67681550a0 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f67677fe640 1 -- 172.21.15.26:0/1606225343 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675c0a8a50 con 0x7f67681550a0 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f67677fe640 1 -- 172.21.15.26:0/1606225343 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675c0a8e20 con 0x7f67681550a0 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 -- 172.21.15.26:0/1606225343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67681550a0 msgr2=0x7f67680d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 --2- 172.21.15.26:0/1606225343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67681550a0 0x7f67680d0350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f675c009870 tx=0x7f675c01ed50 comp rx=0 tx=0).stop 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 -- 172.21.15.26:0/1606225343 shutdown_connections 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 --2- 172.21.15.26:0/1606225343 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67681550a0 0x7f67680d0350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 --2- 172.21.15.26:0/1606225343 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67680ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 -- 172.21.15.26:0/1606225343 >> 172.21.15.26:0/1606225343 conn(0x7f676806de80 msgr2=0x7f676806e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 -- 172.21.15.26:0/1606225343 shutdown_connections 2024-04-21T08:58:03.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 -- 172.21.15.26:0/1606225343 wait complete. 2024-04-21T08:58:03.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 Processor -- start 2024-04-21T08:58:03.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.838+0000 7f676ef56640 1 -- start start 2024-04-21T08:58:03.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67680ccfe0 0x7f67681f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67681f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67681550a0 0x7f67681526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f676815ae60 con 0x7f67680ccfe0 2024-04-21T08:58:03.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f67680b5070 con 0x7f67681550a0 2024-04-21T08:58:03.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f67680d0890 con 0x7f6768154cc0 2024-04-21T08:58:03.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67680ccfe0 0x7f67681f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67680ccfe0 0x7f67681f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57120/0 (socket says 172.21.15.26:57120) 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 -- 172.21.15.26:0/1177952320 learned_addr learned my addr 172.21.15.26:0/1177952320 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f6767fff640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67681f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 -- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 msgr2=0x7f67681f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676d4f3640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67681550a0 0x7f67681526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67681f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 -- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67681550a0 msgr2=0x7f67681526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67681550a0 0x7f67681526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 -- 172.21.15.26:0/1177952320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6768159ee0 con 0x7f67680ccfe0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676d4f3640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67681550a0 0x7f67681526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ccf2640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67680ccfe0 0x7f67681f4c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f675800e9b0 tx=0x7f675800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f67657fa640 1 -- 172.21.15.26:0/1177952320 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6758017070 con 0x7f67680ccfe0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f67657fa640 1 -- 172.21.15.26:0/1177952320 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675800c9a0 con 0x7f67680ccfe0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f67657fa640 1 -- 172.21.15.26:0/1177952320 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f675800cd70 con 0x7f67680ccfe0 2024-04-21T08:58:03.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676815a180 con 0x7f67680ccfe0 2024-04-21T08:58:03.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67681f0ea0 con 0x7f67680ccfe0 2024-04-21T08:58:03.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67681f0c90 con 0x7f67680ccfe0 2024-04-21T08:58:03.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f67657fa640 1 -- 172.21.15.26:0/1177952320 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f675801a070 con 0x7f67680ccfe0 2024-04-21T08:58:03.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f67657fa640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6754068380 0x7f675406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f67657fa640 1 -- 172.21.15.26:0/1177952320 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6758086ac0 con 0x7f67680ccfe0 2024-04-21T08:58:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.842+0000 7f6767fff640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6754068380 0x7f675406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:03.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.846+0000 7f6767fff640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6754068380 0x7f675406a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b2000 tx=0x7f675c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:03.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:03.846+0000 7f67657fa640 1 -- 172.21.15.26:0/1177952320 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6758056ff0 con 0x7f67680ccfe0 2024-04-21T08:58:04.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.002+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6768075ef0 con 0x7f6754068380 2024-04-21T08:58:04.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.022+0000 7f67657fa640 1 -- 172.21.15.26:0/1177952320 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251925 (secure 0 0 0) 0x7f6768075ef0 con 0x7f6754068380 2024-04-21T08:58:04.025 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:04.027 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T08:58:04.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6754068380 msgr2=0x7f675406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6754068380 0x7f675406a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f675c0b2000 tx=0x7f675c008040 comp rx=0 tx=0).stop 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67680ccfe0 msgr2=0x7f67681f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67680ccfe0 0x7f67681f4c10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f675800e9b0 tx=0x7f675800ee70 comp rx=0 tx=0).stop 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 shutdown_connections 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f67681550a0 0x7f67681526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6768154cc0 0x7f67681f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6754068380 0x7f675406a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 --2- 172.21.15.26:0/1177952320 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f67680ccfe0 0x7f67681f4c10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 >> 172.21.15.26:0/1177952320 conn(0x7f676806de80 msgr2=0x7f676806e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 shutdown_connections 2024-04-21T08:58:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.026+0000 7f676ef56640 1 -- 172.21.15.26:0/1177952320 wait complete. 2024-04-21T08:58:04.044 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-21T08:58:03.129982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234600,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740120,"statfs":{"total":773094113280,"available":772853882880,"internally_reserved":0,"allocated":1867776,"data_stored":1773845,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478008+0000","last_change":"2024-04-21T08:57:44.312400+0000","last_active":"2024-04-21T08:57:45.478008+0000","last_peered":"2024-04-21T08:57:45.478008+0000","last_clean":"2024-04-21T08:57:45.478008+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T08:57:45.478008+0000","last_undegraded":"2024-04-21T08:57:45.478008+0000","last_fullsized":"2024-04-21T08:57:45.478008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302244+0000","last_change":"2024-04-21T08:57:44.307469+0000","last_active":"2024-04-21T08:57:45.302244+0000","last_peered":"2024-04-21T08:57:45.302244+0000","last_clean":"2024-04-21T08:57:45.302244+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T08:57:45.302244+0000","last_undegraded":"2024-04-21T08:57:45.302244+0000","last_fullsized":"2024-04-21T08:57:45.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301915+0000","last_change":"2024-04-21T08:57:44.283704+0000","last_active":"2024-04-21T08:57:45.301915+0000","last_peered":"2024-04-21T08:57:45.301915+0000","last_clean":"2024-04-21T08:57:45.301915+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T08:57:45.301915+0000","last_undegraded":"2024-04-21T08:57:45.301915+0000","last_fullsized":"2024-04-21T08:57:45.301915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:22:29.477559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474882+0000","last_change":"2024-04-21T08:57:44.297940+0000","last_active":"2024-04-21T08:57:45.474882+0000","last_peered":"2024-04-21T08:57:45.474882+0000","last_clean":"2024-04-21T08:57:45.474882+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T08:57:45.474882+0000","last_undegraded":"2024-04-21T08:57:45.474882+0000","last_fullsized":"2024-04-21T08:57:45.474882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477621+0000","last_change":"2024-04-21T08:57:44.319147+0000","last_active":"2024-04-21T08:57:45.477621+0000","last_peered":"2024-04-21T08:57:45.477621+0000","last_clean":"2024-04-21T08:57:45.477621+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T08:57:45.477621+0000","last_undegraded":"2024-04-21T08:57:45.477621+0000","last_fullsized":"2024-04-21T08:57:45.477621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475406+0000","last_change":"2024-04-21T08:57:44.292228+0000","last_active":"2024-04-21T08:57:45.475406+0000","last_peered":"2024-04-21T08:57:45.475406+0000","last_clean":"2024-04-21T08:57:45.475406+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T08:57:45.475406+0000","last_undegraded":"2024-04-21T08:57:45.475406+0000","last_fullsized":"2024-04-21T08:57:45.475406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476097+0000","last_change":"2024-04-21T08:57:44.307483+0000","last_active":"2024-04-21T08:57:45.476097+0000","last_peered":"2024-04-21T08:57:45.476097+0000","last_clean":"2024-04-21T08:57:45.476097+0000","last_became_active":"2024-04-21T08:57:44.307147+0000","last_became_peered":"2024-04-21T08:57:44.307147+0000","last_unstale":"2024-04-21T08:57:45.476097+0000","last_undegraded":"2024-04-21T08:57:45.476097+0000","last_fullsized":"2024-04-21T08:57:45.476097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301538+0000","last_change":"2024-04-21T08:57:44.316305+0000","last_active":"2024-04-21T08:57:45.301538+0000","last_peered":"2024-04-21T08:57:45.301538+0000","last_clean":"2024-04-21T08:57:45.301538+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T08:57:45.301538+0000","last_undegraded":"2024-04-21T08:57:45.301538+0000","last_fullsized":"2024-04-21T08:57:45.301538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:02.718251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296716+0000","last_change":"2024-04-21T08:57:44.306928+0000","last_active":"2024-04-21T08:57:45.296716+0000","last_peered":"2024-04-21T08:57:45.296716+0000","last_clean":"2024-04-21T08:57:45.296716+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T08:57:45.296716+0000","last_undegraded":"2024-04-21T08:57:45.296716+0000","last_fullsized":"2024-04-21T08:57:45.296716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:47.382588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477106+0000","last_change":"2024-04-21T08:57:44.307925+0000","last_active":"2024-04-21T08:57:45.477106+0000","last_peered":"2024-04-21T08:57:45.477106+0000","last_clean":"2024-04-21T08:57:45.477106+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T08:57:45.477106+0000","last_undegraded":"2024-04-21T08:57:45.477106+0000","last_fullsized":"2024-04-21T08:57:45.477106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475344+0000","last_change":"2024-04-21T08:57:44.312289+0000","last_active":"2024-04-21T08:57:45.475344+0000","last_peered":"2024-04-21T08:57:45.475344+0000","last_clean":"2024-04-21T08:57:45.475344+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T08:57:45.475344+0000","last_undegraded":"2024-04-21T08:57:45.475344+0000","last_fullsized":"2024-04-21T08:57:45.475344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477952+0000","last_change":"2024-04-21T08:57:44.315406+0000","last_active":"2024-04-21T08:57:45.477952+0000","last_peered":"2024-04-21T08:57:45.477952+0000","last_clean":"2024-04-21T08:57:45.477952+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T08:57:45.477952+0000","last_undegraded":"2024-04-21T08:57:45.477952+0000","last_fullsized":"2024-04-21T08:57:45.477952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475316+0000","last_change":"2024-04-21T08:57:44.321357+0000","last_active":"2024-04-21T08:57:45.475316+0000","last_peered":"2024-04-21T08:57:45.475316+0000","last_clean":"2024-04-21T08:57:45.475316+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T08:57:45.475316+0000","last_undegraded":"2024-04-21T08:57:45.475316+0000","last_fullsized":"2024-04-21T08:57:45.475316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:01:59.921966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475445+0000","last_change":"2024-04-21T08:57:44.315428+0000","last_active":"2024-04-21T08:57:45.475445+0000","last_peered":"2024-04-21T08:57:45.475445+0000","last_clean":"2024-04-21T08:57:45.475445+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T08:57:45.475445+0000","last_undegraded":"2024-04-21T08:57:45.475445+0000","last_fullsized":"2024-04-21T08:57:45.475445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301076+0000","last_change":"2024-04-21T08:57:44.285663+0000","last_active":"2024-04-21T08:57:45.301076+0000","last_peered":"2024-04-21T08:57:45.301076+0000","last_clean":"2024-04-21T08:57:45.301076+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T08:57:45.301076+0000","last_undegraded":"2024-04-21T08:57:45.301076+0000","last_fullsized":"2024-04-21T08:57:45.301076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:54:18.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474994+0000","last_change":"2024-04-21T08:57:44.288842+0000","last_active":"2024-04-21T08:57:45.474994+0000","last_peered":"2024-04-21T08:57:45.474994+0000","last_clean":"2024-04-21T08:57:45.474994+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T08:57:45.474994+0000","last_undegraded":"2024-04-21T08:57:45.474994+0000","last_fullsized":"2024-04-21T08:57:45.474994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479022+0000","last_change":"2024-04-21T08:57:44.320371+0000","last_active":"2024-04-21T08:57:45.479022+0000","last_peered":"2024-04-21T08:57:45.479022+0000","last_clean":"2024-04-21T08:57:45.479022+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T08:57:45.479022+0000","last_undegraded":"2024-04-21T08:57:45.479022+0000","last_fullsized":"2024-04-21T08:57:45.479022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:37:23.456724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474849+0000","last_change":"2024-04-21T08:57:44.302161+0000","last_active":"2024-04-21T08:57:45.474849+0000","last_peered":"2024-04-21T08:57:45.474849+0000","last_clean":"2024-04-21T08:57:45.474849+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T08:57:45.474849+0000","last_undegraded":"2024-04-21T08:57:45.474849+0000","last_fullsized":"2024-04-21T08:57:45.474849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478601+0000","last_change":"2024-04-21T08:57:44.289531+0000","last_active":"2024-04-21T08:57:45.478601+0000","last_peered":"2024-04-21T08:57:45.478601+0000","last_clean":"2024-04-21T08:57:45.478601+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T08:57:45.478601+0000","last_undegraded":"2024-04-21T08:57:45.478601+0000","last_fullsized":"2024-04-21T08:57:45.478601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:42:25.869615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477213+0000","last_change":"2024-04-21T08:57:44.315116+0000","last_active":"2024-04-21T08:57:45.477213+0000","last_peered":"2024-04-21T08:57:45.477213+0000","last_clean":"2024-04-21T08:57:45.477213+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T08:57:45.477213+0000","last_undegraded":"2024-04-21T08:57:45.477213+0000","last_fullsized":"2024-04-21T08:57:45.477213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300338+0000","last_change":"2024-04-21T08:57:44.299295+0000","last_active":"2024-04-21T08:57:45.300338+0000","last_peered":"2024-04-21T08:57:45.300338+0000","last_clean":"2024-04-21T08:57:45.300338+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T08:57:45.300338+0000","last_undegraded":"2024-04-21T08:57:45.300338+0000","last_fullsized":"2024-04-21T08:57:45.300338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:32:23.460346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296074+0000","last_change":"2024-04-21T08:57:44.293141+0000","last_active":"2024-04-21T08:57:45.296074+0000","last_peered":"2024-04-21T08:57:45.296074+0000","last_clean":"2024-04-21T08:57:45.296074+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T08:57:45.296074+0000","last_undegraded":"2024-04-21T08:57:45.296074+0000","last_fullsized":"2024-04-21T08:57:45.296074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301628+0000","last_change":"2024-04-21T08:57:44.291347+0000","last_active":"2024-04-21T08:57:45.301628+0000","last_peered":"2024-04-21T08:57:45.301628+0000","last_clean":"2024-04-21T08:57:45.301628+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T08:57:45.301628+0000","last_undegraded":"2024-04-21T08:57:45.301628+0000","last_fullsized":"2024-04-21T08:57:45.301628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:29.349924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475426+0000","last_change":"2024-04-21T08:57:44.283481+0000","last_active":"2024-04-21T08:57:45.475426+0000","last_peered":"2024-04-21T08:57:45.475426+0000","last_clean":"2024-04-21T08:57:45.475426+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T08:57:45.475426+0000","last_undegraded":"2024-04-21T08:57:45.475426+0000","last_fullsized":"2024-04-21T08:57:45.475426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302199+0000","last_change":"2024-04-21T08:57:44.304218+0000","last_active":"2024-04-21T08:57:45.302199+0000","last_peered":"2024-04-21T08:57:45.302199+0000","last_clean":"2024-04-21T08:57:45.302199+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T08:57:45.302199+0000","last_undegraded":"2024-04-21T08:57:45.302199+0000","last_fullsized":"2024-04-21T08:57:45.302199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476814+0000","last_change":"2024-04-21T08:57:44.305569+0000","last_active":"2024-04-21T08:57:45.476814+0000","last_peered":"2024-04-21T08:57:45.476814+0000","last_clean":"2024-04-21T08:57:45.476814+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T08:57:45.476814+0000","last_undegraded":"2024-04-21T08:57:45.476814+0000","last_fullsized":"2024-04-21T08:57:45.476814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476147+0000","last_change":"2024-04-21T08:57:44.314872+0000","last_active":"2024-04-21T08:57:45.476147+0000","last_peered":"2024-04-21T08:57:45.476147+0000","last_clean":"2024-04-21T08:57:45.476147+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T08:57:45.476147+0000","last_undegraded":"2024-04-21T08:57:45.476147+0000","last_fullsized":"2024-04-21T08:57:45.476147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475471+0000","last_change":"2024-04-21T08:57:44.320786+0000","last_active":"2024-04-21T08:57:45.475471+0000","last_peered":"2024-04-21T08:57:45.475471+0000","last_clean":"2024-04-21T08:57:45.475471+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T08:57:45.475471+0000","last_undegraded":"2024-04-21T08:57:45.475471+0000","last_fullsized":"2024-04-21T08:57:45.475471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301360+0000","last_change":"2024-04-21T08:57:44.292576+0000","last_active":"2024-04-21T08:57:45.301360+0000","last_peered":"2024-04-21T08:57:45.301360+0000","last_clean":"2024-04-21T08:57:45.301360+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T08:57:45.301360+0000","last_undegraded":"2024-04-21T08:57:45.301360+0000","last_fullsized":"2024-04-21T08:57:45.301360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:41:15.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476800+0000","last_change":"2024-04-21T08:57:44.301159+0000","last_active":"2024-04-21T08:57:45.476800+0000","last_peered":"2024-04-21T08:57:45.476800+0000","last_clean":"2024-04-21T08:57:45.476800+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T08:57:45.476800+0000","last_undegraded":"2024-04-21T08:57:45.476800+0000","last_fullsized":"2024-04-21T08:57:45.476800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473997+0000","last_change":"2024-04-21T08:57:44.295923+0000","last_active":"2024-04-21T08:57:45.473997+0000","last_peered":"2024-04-21T08:57:45.473997+0000","last_clean":"2024-04-21T08:57:45.473997+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T08:57:45.473997+0000","last_undegraded":"2024-04-21T08:57:45.473997+0000","last_fullsized":"2024-04-21T08:57:45.473997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474254+0000","last_change":"2024-04-21T08:57:44.317457+0000","last_active":"2024-04-21T08:57:45.474254+0000","last_peered":"2024-04-21T08:57:45.474254+0000","last_clean":"2024-04-21T08:57:45.474254+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T08:57:45.474254+0000","last_undegraded":"2024-04-21T08:57:45.474254+0000","last_fullsized":"2024-04-21T08:57:45.474254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:17.843858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296164+0000","last_change":"2024-04-21T08:57:44.293278+0000","last_active":"2024-04-21T08:57:45.296164+0000","last_peered":"2024-04-21T08:57:45.296164+0000","last_clean":"2024-04-21T08:57:45.296164+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T08:57:45.296164+0000","last_undegraded":"2024-04-21T08:57:45.296164+0000","last_fullsized":"2024-04-21T08:57:45.296164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162151+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T08:57:47.162151+0000","last_peered":"2024-04-21T08:57:47.162151+0000","last_clean":"2024-04-21T08:57:47.162151+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T08:57:47.162151+0000","last_undegraded":"2024-04-21T08:57:47.162151+0000","last_fullsized":"2024-04-21T08:57:47.162151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300238+0000","last_change":"2024-04-21T08:57:44.308011+0000","last_active":"2024-04-21T08:57:45.300238+0000","last_peered":"2024-04-21T08:57:45.300238+0000","last_clean":"2024-04-21T08:57:45.300238+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T08:57:45.300238+0000","last_undegraded":"2024-04-21T08:57:45.300238+0000","last_fullsized":"2024-04-21T08:57:45.300238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:45.396672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478237+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T08:57:45.478237+0000","last_peered":"2024-04-21T08:57:45.478237+0000","last_clean":"2024-04-21T08:57:45.478237+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T08:57:45.478237+0000","last_undegraded":"2024-04-21T08:57:45.478237+0000","last_fullsized":"2024-04-21T08:57:45.478237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475213+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T08:57:45.475213+0000","last_peered":"2024-04-21T08:57:45.475213+0000","last_clean":"2024-04-21T08:57:45.475213+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T08:57:45.475213+0000","last_undegraded":"2024-04-21T08:57:45.475213+0000","last_fullsized":"2024-04-21T08:57:45.475213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302334+0000","last_change":"2024-04-21T08:57:44.307616+0000","last_active":"2024-04-21T08:57:45.302334+0000","last_peered":"2024-04-21T08:57:45.302334+0000","last_clean":"2024-04-21T08:57:45.302334+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T08:57:45.302334+0000","last_undegraded":"2024-04-21T08:57:45.302334+0000","last_fullsized":"2024-04-21T08:57:45.302334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475348+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T08:57:45.475348+0000","last_peered":"2024-04-21T08:57:45.475348+0000","last_clean":"2024-04-21T08:57:45.475348+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T08:57:45.475348+0000","last_undegraded":"2024-04-21T08:57:45.475348+0000","last_fullsized":"2024-04-21T08:57:45.475348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300102+0000","last_change":"2024-04-21T08:57:44.285516+0000","last_active":"2024-04-21T08:57:45.300102+0000","last_peered":"2024-04-21T08:57:45.300102+0000","last_clean":"2024-04-21T08:57:45.300102+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T08:57:45.300102+0000","last_undegraded":"2024-04-21T08:57:45.300102+0000","last_fullsized":"2024-04-21T08:57:45.300102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296625+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T08:57:45.296625+0000","last_peered":"2024-04-21T08:57:45.296625+0000","last_clean":"2024-04-21T08:57:45.296625+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T08:57:45.296625+0000","last_undegraded":"2024-04-21T08:57:45.296625+0000","last_fullsized":"2024-04-21T08:57:45.296625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477228+0000","last_change":"2024-04-21T08:57:44.305837+0000","last_active":"2024-04-21T08:57:45.477228+0000","last_peered":"2024-04-21T08:57:45.477228+0000","last_clean":"2024-04-21T08:57:45.477228+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T08:57:45.477228+0000","last_undegraded":"2024-04-21T08:57:45.477228+0000","last_fullsized":"2024-04-21T08:57:45.477228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477323+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T08:57:45.477323+0000","last_peered":"2024-04-21T08:57:45.477323+0000","last_clean":"2024-04-21T08:57:45.477323+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T08:57:45.477323+0000","last_undegraded":"2024-04-21T08:57:45.477323+0000","last_fullsized":"2024-04-21T08:57:45.477323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302616+0000","last_change":"2024-04-21T08:57:44.305156+0000","last_active":"2024-04-21T08:57:45.302616+0000","last_peered":"2024-04-21T08:57:45.302616+0000","last_clean":"2024-04-21T08:57:45.302616+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T08:57:45.302616+0000","last_undegraded":"2024-04-21T08:57:45.302616+0000","last_fullsized":"2024-04-21T08:57:45.302616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.320749+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T08:57:49.320749+0000","last_peered":"2024-04-21T08:57:49.320749+0000","last_clean":"2024-04-21T08:57:49.320749+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T08:57:49.320749+0000","last_undegraded":"2024-04-21T08:57:49.320749+0000","last_fullsized":"2024-04-21T08:57:49.320749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476386+0000","last_change":"2024-04-21T08:57:44.296804+0000","last_active":"2024-04-21T08:57:45.476386+0000","last_peered":"2024-04-21T08:57:45.476386+0000","last_clean":"2024-04-21T08:57:45.476386+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T08:57:45.476386+0000","last_undegraded":"2024-04-21T08:57:45.476386+0000","last_fullsized":"2024-04-21T08:57:45.476386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319718+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T08:57:49.319718+0000","last_peered":"2024-04-21T08:57:49.319718+0000","last_clean":"2024-04-21T08:57:49.319718+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T08:57:49.319718+0000","last_undegraded":"2024-04-21T08:57:49.319718+0000","last_fullsized":"2024-04-21T08:57:49.319718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475742+0000","last_change":"2024-04-21T08:57:44.323678+0000","last_active":"2024-04-21T08:57:45.475742+0000","last_peered":"2024-04-21T08:57:45.475742+0000","last_clean":"2024-04-21T08:57:45.475742+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T08:57:45.475742+0000","last_undegraded":"2024-04-21T08:57:45.475742+0000","last_fullsized":"2024-04-21T08:57:45.475742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318895+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T08:57:49.318895+0000","last_peered":"2024-04-21T08:57:49.318895+0000","last_clean":"2024-04-21T08:57:49.318895+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T08:57:49.318895+0000","last_undegraded":"2024-04-21T08:57:49.318895+0000","last_fullsized":"2024-04-21T08:57:49.318895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475320+0000","last_change":"2024-04-21T08:57:44.310092+0000","last_active":"2024-04-21T08:57:45.475320+0000","last_peered":"2024-04-21T08:57:45.475320+0000","last_clean":"2024-04-21T08:57:45.475320+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T08:57:45.475320+0000","last_undegraded":"2024-04-21T08:57:45.475320+0000","last_fullsized":"2024-04-21T08:57:45.475320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:03.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478308+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T08:57:45.478308+0000","last_peered":"2024-04-21T08:57:45.478308+0000","last_clean":"2024-04-21T08:57:45.478308+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T08:57:45.478308+0000","last_undegraded":"2024-04-21T08:57:45.478308+0000","last_fullsized":"2024-04-21T08:57:45.478308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477225+0000","last_change":"2024-04-21T08:57:44.320598+0000","last_active":"2024-04-21T08:57:45.477225+0000","last_peered":"2024-04-21T08:57:45.477225+0000","last_clean":"2024-04-21T08:57:45.477225+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T08:57:45.477225+0000","last_undegraded":"2024-04-21T08:57:45.477225+0000","last_fullsized":"2024-04-21T08:57:45.477225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:51.743927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476234+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T08:57:45.476234+0000","last_peered":"2024-04-21T08:57:45.476234+0000","last_clean":"2024-04-21T08:57:45.476234+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T08:57:45.476234+0000","last_undegraded":"2024-04-21T08:57:45.476234+0000","last_fullsized":"2024-04-21T08:57:45.476234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295791+0000","last_change":"2024-04-21T08:57:44.292658+0000","last_active":"2024-04-21T08:57:45.295791+0000","last_peered":"2024-04-21T08:57:45.295791+0000","last_clean":"2024-04-21T08:57:45.295791+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T08:57:45.295791+0000","last_undegraded":"2024-04-21T08:57:45.295791+0000","last_fullsized":"2024-04-21T08:57:45.295791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.321102+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T08:57:49.321102+0000","last_peered":"2024-04-21T08:57:49.321102+0000","last_clean":"2024-04-21T08:57:49.321102+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T08:57:49.321102+0000","last_undegraded":"2024-04-21T08:57:49.321102+0000","last_fullsized":"2024-04-21T08:57:49.321102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475925+0000","last_change":"2024-04-21T08:57:44.289358+0000","last_active":"2024-04-21T08:57:45.475925+0000","last_peered":"2024-04-21T08:57:45.475925+0000","last_clean":"2024-04-21T08:57:45.475925+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T08:57:45.475925+0000","last_undegraded":"2024-04-21T08:57:45.475925+0000","last_fullsized":"2024-04-21T08:57:45.475925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478220+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T08:57:45.478220+0000","last_peered":"2024-04-21T08:57:45.478220+0000","last_clean":"2024-04-21T08:57:45.478220+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T08:57:45.478220+0000","last_undegraded":"2024-04-21T08:57:45.478220+0000","last_fullsized":"2024-04-21T08:57:45.478220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477620+0000","last_change":"2024-04-21T08:57:44.321062+0000","last_active":"2024-04-21T08:57:45.477620+0000","last_peered":"2024-04-21T08:57:45.477620+0000","last_clean":"2024-04-21T08:57:45.477620+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T08:57:45.477620+0000","last_undegraded":"2024-04-21T08:57:45.477620+0000","last_fullsized":"2024-04-21T08:57:45.477620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318978+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T08:57:49.318978+0000","last_peered":"2024-04-21T08:57:49.318978+0000","last_clean":"2024-04-21T08:57:49.318978+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T08:57:49.318978+0000","last_undegraded":"2024-04-21T08:57:49.318978+0000","last_fullsized":"2024-04-21T08:57:49.318978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477974+0000","last_change":"2024-04-21T08:57:44.315764+0000","last_active":"2024-04-21T08:57:45.477974+0000","last_peered":"2024-04-21T08:57:45.477974+0000","last_clean":"2024-04-21T08:57:45.477974+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T08:57:45.477974+0000","last_undegraded":"2024-04-21T08:57:45.477974+0000","last_fullsized":"2024-04-21T08:57:45.477974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162213+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T08:57:47.162213+0000","last_peered":"2024-04-21T08:57:47.162213+0000","last_clean":"2024-04-21T08:57:47.162213+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T08:57:47.162213+0000","last_undegraded":"2024-04-21T08:57:47.162213+0000","last_fullsized":"2024-04-21T08:57:47.162213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477623+0000","last_change":"2024-04-21T08:57:44.315316+0000","last_active":"2024-04-21T08:57:45.477623+0000","last_peered":"2024-04-21T08:57:45.477623+0000","last_clean":"2024-04-21T08:57:45.477623+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T08:57:45.477623+0000","last_undegraded":"2024-04-21T08:57:45.477623+0000","last_fullsized":"2024-04-21T08:57:45.477623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475756+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T08:57:45.475756+0000","last_peered":"2024-04-21T08:57:45.475756+0000","last_clean":"2024-04-21T08:57:45.475756+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T08:57:45.475756+0000","last_undegraded":"2024-04-21T08:57:45.475756+0000","last_fullsized":"2024-04-21T08:57:45.475756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478318+0000","last_change":"2024-04-21T08:57:44.298472+0000","last_active":"2024-04-21T08:57:45.478318+0000","last_peered":"2024-04-21T08:57:45.478318+0000","last_clean":"2024-04-21T08:57:45.478318+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T08:57:45.478318+0000","last_undegraded":"2024-04-21T08:57:45.478318+0000","last_fullsized":"2024-04-21T08:57:45.478318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:14:06.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295542+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T08:57:45.295542+0000","last_peered":"2024-04-21T08:57:45.295542+0000","last_clean":"2024-04-21T08:57:45.295542+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T08:57:45.295542+0000","last_undegraded":"2024-04-21T08:57:45.295542+0000","last_fullsized":"2024-04-21T08:57:45.295542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477601+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T08:57:45.477601+0000","last_peered":"2024-04-21T08:57:45.477601+0000","last_clean":"2024-04-21T08:57:45.477601+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T08:57:45.477601+0000","last_undegraded":"2024-04-21T08:57:45.477601+0000","last_fullsized":"2024-04-21T08:57:45.477601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300093+0000","last_change":"2024-04-21T08:57:44.289877+0000","last_active":"2024-04-21T08:57:45.300093+0000","last_peered":"2024-04-21T08:57:45.300093+0000","last_clean":"2024-04-21T08:57:45.300093+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T08:57:45.300093+0000","last_undegraded":"2024-04-21T08:57:45.300093+0000","last_fullsized":"2024-04-21T08:57:45.300093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475561+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T08:57:45.475561+0000","last_peered":"2024-04-21T08:57:45.475561+0000","last_clean":"2024-04-21T08:57:45.475561+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T08:57:45.475561+0000","last_undegraded":"2024-04-21T08:57:45.475561+0000","last_fullsized":"2024-04-21T08:57:45.475561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474956+0000","last_change":"2024-04-21T08:57:44.309539+0000","last_active":"2024-04-21T08:57:45.474956+0000","last_peered":"2024-04-21T08:57:45.474956+0000","last_clean":"2024-04-21T08:57:45.474956+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T08:57:45.474956+0000","last_undegraded":"2024-04-21T08:57:45.474956+0000","last_fullsized":"2024-04-21T08:57:45.474956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:47:34.419511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473930+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T08:57:45.473930+0000","last_peered":"2024-04-21T08:57:45.473930+0000","last_clean":"2024-04-21T08:57:45.473930+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T08:57:45.473930+0000","last_undegraded":"2024-04-21T08:57:45.473930+0000","last_fullsized":"2024-04-21T08:57:45.473930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301947+0000","last_change":"2024-04-21T08:57:44.298533+0000","last_active":"2024-04-21T08:57:45.301947+0000","last_peered":"2024-04-21T08:57:45.301947+0000","last_clean":"2024-04-21T08:57:45.301947+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T08:57:45.301947+0000","last_undegraded":"2024-04-21T08:57:45.301947+0000","last_fullsized":"2024-04-21T08:57:45.301947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478433+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T08:57:45.478433+0000","last_peered":"2024-04-21T08:57:45.478433+0000","last_clean":"2024-04-21T08:57:45.478433+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T08:57:45.478433+0000","last_undegraded":"2024-04-21T08:57:45.478433+0000","last_fullsized":"2024-04-21T08:57:45.478433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477998+0000","last_change":"2024-04-21T08:57:44.315633+0000","last_active":"2024-04-21T08:57:45.477998+0000","last_peered":"2024-04-21T08:57:45.477998+0000","last_clean":"2024-04-21T08:57:45.477998+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T08:57:45.477998+0000","last_undegraded":"2024-04-21T08:57:45.477998+0000","last_fullsized":"2024-04-21T08:57:45.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301760+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T08:57:45.301760+0000","last_peered":"2024-04-21T08:57:45.301760+0000","last_clean":"2024-04-21T08:57:45.301760+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T08:57:45.301760+0000","last_undegraded":"2024-04-21T08:57:45.301760+0000","last_fullsized":"2024-04-21T08:57:45.301760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475775+0000","last_change":"2024-04-21T08:57:44.318478+0000","last_active":"2024-04-21T08:57:45.475775+0000","last_peered":"2024-04-21T08:57:45.475775+0000","last_clean":"2024-04-21T08:57:45.475775+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T08:57:45.475775+0000","last_undegraded":"2024-04-21T08:57:45.475775+0000","last_fullsized":"2024-04-21T08:57:45.475775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478561+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T08:57:45.478561+0000","last_peered":"2024-04-21T08:57:45.478561+0000","last_clean":"2024-04-21T08:57:45.478561+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T08:57:45.478561+0000","last_undegraded":"2024-04-21T08:57:45.478561+0000","last_fullsized":"2024-04-21T08:57:45.478561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475343+0000","last_change":"2024-04-21T08:57:44.305172+0000","last_active":"2024-04-21T08:57:45.475343+0000","last_peered":"2024-04-21T08:57:45.475343+0000","last_clean":"2024-04-21T08:57:45.475343+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T08:57:45.475343+0000","last_undegraded":"2024-04-21T08:57:45.475343+0000","last_fullsized":"2024-04-21T08:57:45.475343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:13:46.282333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:46.165779+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T08:57:46.165779+0000","last_peered":"2024-04-21T08:57:46.165779+0000","last_clean":"2024-04-21T08:57:46.165779+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T08:57:46.165779+0000","last_undegraded":"2024-04-21T08:57:46.165779+0000","last_fullsized":"2024-04-21T08:57:46.165779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300739+0000","last_change":"2024-04-21T08:57:44.311283+0000","last_active":"2024-04-21T08:57:45.300739+0000","last_peered":"2024-04-21T08:57:45.300739+0000","last_clean":"2024-04-21T08:57:45.300739+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T08:57:45.300739+0000","last_undegraded":"2024-04-21T08:57:45.300739+0000","last_fullsized":"2024-04-21T08:57:45.300739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:06:14.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.316902+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T08:57:49.316902+0000","last_peered":"2024-04-21T08:57:49.316902+0000","last_clean":"2024-04-21T08:57:49.316902+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T08:57:49.316902+0000","last_undegraded":"2024-04-21T08:57:49.316902+0000","last_fullsized":"2024-04-21T08:57:49.316902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300568+0000","last_change":"2024-04-21T08:57:44.293449+0000","last_active":"2024-04-21T08:57:45.300568+0000","last_peered":"2024-04-21T08:57:45.300568+0000","last_clean":"2024-04-21T08:57:45.300568+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T08:57:45.300568+0000","last_undegraded":"2024-04-21T08:57:45.300568+0000","last_fullsized":"2024-04-21T08:57:45.300568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:13:04.768707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474913+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T08:57:45.474913+0000","last_peered":"2024-04-21T08:57:45.474913+0000","last_clean":"2024-04-21T08:57:45.474913+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T08:57:45.474913+0000","last_undegraded":"2024-04-21T08:57:45.474913+0000","last_fullsized":"2024-04-21T08:57:45.474913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476103+0000","last_change":"2024-04-21T08:57:44.294831+0000","last_active":"2024-04-21T08:57:45.476103+0000","last_peered":"2024-04-21T08:57:45.476103+0000","last_clean":"2024-04-21T08:57:45.476103+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T08:57:45.476103+0000","last_undegraded":"2024-04-21T08:57:45.476103+0000","last_fullsized":"2024-04-21T08:57:45.476103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300649+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T08:57:45.300649+0000","last_peered":"2024-04-21T08:57:45.300649+0000","last_clean":"2024-04-21T08:57:45.300649+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T08:57:45.300649+0000","last_undegraded":"2024-04-21T08:57:45.300649+0000","last_fullsized":"2024-04-21T08:57:45.300649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.299620+0000","last_change":"2024-04-21T08:57:44.299090+0000","last_active":"2024-04-21T08:57:45.299620+0000","last_peered":"2024-04-21T08:57:45.299620+0000","last_clean":"2024-04-21T08:57:45.299620+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T08:57:45.299620+0000","last_undegraded":"2024-04-21T08:57:45.299620+0000","last_fullsized":"2024-04-21T08:57:45.299620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475613+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T08:57:45.475613+0000","last_peered":"2024-04-21T08:57:45.475613+0000","last_clean":"2024-04-21T08:57:45.475613+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T08:57:45.475613+0000","last_undegraded":"2024-04-21T08:57:45.475613+0000","last_fullsized":"2024-04-21T08:57:45.475613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474385+0000","last_change":"2024-04-21T08:57:44.317697+0000","last_active":"2024-04-21T08:57:45.474385+0000","last_peered":"2024-04-21T08:57:45.474385+0000","last_clean":"2024-04-21T08:57:45.474385+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T08:57:45.474385+0000","last_undegraded":"2024-04-21T08:57:45.474385+0000","last_fullsized":"2024-04-21T08:57:45.474385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.317492+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T08:57:49.317492+0000","last_peered":"2024-04-21T08:57:49.317492+0000","last_clean":"2024-04-21T08:57:49.317492+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T08:57:49.317492+0000","last_undegraded":"2024-04-21T08:57:49.317492+0000","last_fullsized":"2024-04-21T08:57:49.317492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478072+0000","last_change":"2024-04-21T08:57:44.300498+0000","last_active":"2024-04-21T08:57:45.478072+0000","last_peered":"2024-04-21T08:57:45.478072+0000","last_clean":"2024-04-21T08:57:45.478072+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T08:57:45.478072+0000","last_undegraded":"2024-04-21T08:57:45.478072+0000","last_fullsized":"2024-04-21T08:57:45.478072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:36:51.242004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478121+0000","last_change":"2024-04-21T08:57:44.321085+0000","last_active":"2024-04-21T08:57:45.478121+0000","last_peered":"2024-04-21T08:57:45.478121+0000","last_clean":"2024-04-21T08:57:45.478121+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T08:57:45.478121+0000","last_undegraded":"2024-04-21T08:57:45.478121+0000","last_fullsized":"2024-04-21T08:57:45.478121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:49.754472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.313140+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T08:57:49.313140+0000","last_peered":"2024-04-21T08:57:49.313140+0000","last_clean":"2024-04-21T08:57:49.313140+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T08:57:49.313140+0000","last_undegraded":"2024-04-21T08:57:49.313140+0000","last_fullsized":"2024-04-21T08:57:49.313140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296663+0000","last_change":"2024-04-21T08:57:44.315810+0000","last_active":"2024-04-21T08:57:45.296663+0000","last_peered":"2024-04-21T08:57:45.296663+0000","last_clean":"2024-04-21T08:57:45.296663+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T08:57:45.296663+0000","last_undegraded":"2024-04-21T08:57:45.296663+0000","last_fullsized":"2024-04-21T08:57:45.296663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.311969+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T08:57:49.311969+0000","last_peered":"2024-04-21T08:57:49.311969+0000","last_clean":"2024-04-21T08:57:49.311969+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T08:57:49.311969+0000","last_undegraded":"2024-04-21T08:57:49.311969+0000","last_fullsized":"2024-04-21T08:57:49.311969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302388+0000","last_change":"2024-04-21T08:57:44.303912+0000","last_active":"2024-04-21T08:57:45.302388+0000","last_peered":"2024-04-21T08:57:45.302388+0000","last_clean":"2024-04-21T08:57:45.302388+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T08:57:45.302388+0000","last_undegraded":"2024-04-21T08:57:45.302388+0000","last_fullsized":"2024-04-21T08:57:45.302388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162279+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T08:57:47.162279+0000","last_peered":"2024-04-21T08:57:47.162279+0000","last_clean":"2024-04-21T08:57:47.162279+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T08:57:47.162279+0000","last_undegraded":"2024-04-21T08:57:47.162279+0000","last_fullsized":"2024-04-21T08:57:47.162279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302272+0000","last_change":"2024-04-21T08:57:44.301951+0000","last_active":"2024-04-21T08:57:45.302272+0000","last_peered":"2024-04-21T08:57:45.302272+0000","last_clean":"2024-04-21T08:57:45.302272+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T08:57:45.302272+0000","last_undegraded":"2024-04-21T08:57:45.302272+0000","last_fullsized":"2024-04-21T08:57:45.302272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319970+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T08:57:49.319970+0000","last_peered":"2024-04-21T08:57:49.319970+0000","last_clean":"2024-04-21T08:57:49.319970+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T08:57:49.319970+0000","last_undegraded":"2024-04-21T08:57:49.319970+0000","last_fullsized":"2024-04-21T08:57:49.319970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":212992,"data_stored":74063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":75093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":663919,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":217088,"data_stored":73537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":663941,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":76206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T08:58:04.048 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-21T08:58:04.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T08:58:04.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb875712640 1 Processor -- start 2024-04-21T08:58:04.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb875712640 1 -- start start 2024-04-21T08:58:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb875712640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb870159150 0x7fb8700c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb875712640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb870159530 0x7fb870071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb875712640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8700c80d0 con 0x7fb87015f030 2024-04-21T08:58:04.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb875712640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb8700c8370 con 0x7fb870159530 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb875712640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fb8700c8650 con 0x7fb870159150 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86e7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb870159530 0x7fb870071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86e7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb870159530 0x7fb870071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57124/0 (socket says 172.21.15.26:57124) 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86e7fc640 1 -- 172.21.15.26:0/768479894 learned_addr learned my addr 172.21.15.26:0/768479894 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86effd640 1 --2- 172.21.15.26:0/768479894 >> v2:172.21.15.169:3300/0 conn(0x7fb870159150 0x7fb8700c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86e7fc640 1 -- 172.21.15.26:0/768479894 >> v2:172.21.15.169:3300/0 conn(0x7fb870159150 msgr2=0x7fb8700c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86e7fc640 1 --2- 172.21.15.26:0/768479894 >> v2:172.21.15.169:3300/0 conn(0x7fb870159150 0x7fb8700c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86e7fc640 1 -- 172.21.15.26:0/768479894 >> v1:172.21.15.169:6789/0 conn(0x7fb87015f030 legacy=0x7fb87015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:04.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.210+0000 7fb86e7fc640 1 -- 172.21.15.26:0/768479894 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8700714b0 con 0x7fb870159530 2024-04-21T08:58:04.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb86e7fc640 1 --2- 172.21.15.26:0/768479894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb870159530 0x7fb870071f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8700c99e0 tx=0x7fb85801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4b60312c037f6f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb86dffb640 1 -- 172.21.15.26:0/768479894 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580b0070 con 0x7fb870159530 2024-04-21T08:58:04.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb86dffb640 1 -- 172.21.15.26:0/768479894 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8580ab600 con 0x7fb870159530 2024-04-21T08:58:04.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb86dffb640 1 -- 172.21.15.26:0/768479894 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580ab9d0 con 0x7fb870159530 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 -- 172.21.15.26:0/768479894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb870159530 msgr2=0x7fb870071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 --2- 172.21.15.26:0/768479894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb870159530 0x7fb870071f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb8700c99e0 tx=0x7fb85801c4c0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 -- 172.21.15.26:0/768479894 shutdown_connections 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 --2- 172.21.15.26:0/768479894 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb870159530 0x7fb870071f90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 --2- 172.21.15.26:0/768479894 >> v2:172.21.15.169:3300/0 conn(0x7fb870159150 0x7fb8700c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 -- 172.21.15.26:0/768479894 >> 172.21.15.26:0/768479894 conn(0x7fb8700c8960 msgr2=0x7fb8700c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 -- 172.21.15.26:0/768479894 shutdown_connections 2024-04-21T08:58:04.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 -- 172.21.15.26:0/768479894 wait complete. 2024-04-21T08:58:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 Processor -- start 2024-04-21T08:58:04.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.214+0000 7fb875712640 1 -- start start 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb870159150 0x7fb8700c4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb87015f030 0x7fb87006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8701fc0d0 0x7fb87006df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb87006cb20 con 0x7fb8701fc0d0 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fb8700c97b0 con 0x7fb87015f030 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fb87006cca0 con 0x7fb870159150 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8701fc0d0 0x7fb87006df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8701fc0d0 0x7fb87006df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57136/0 (socket says 172.21.15.26:57136) 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 -- 172.21.15.26:0/2374745582 learned_addr learned my addr 172.21.15.26:0/2374745582 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86effd640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb870159150 0x7fb8700c4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86e7fc640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb87015f030 0x7fb87006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 -- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb870159150 msgr2=0x7fb8700c4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb870159150 0x7fb8700c4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 -- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb87015f030 msgr2=0x7fb87006d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb87015f030 0x7fb87006d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 -- 172.21.15.26:0/2374745582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87015adc0 con 0x7fb8701fc0d0 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86effd640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb870159150 0x7fb8700c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb86f7fe640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8701fc0d0 0x7fb87006df10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c7b0 tx=0x7fb86800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb8677fe640 1 -- 172.21.15.26:0/2374745582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868004b70 con 0x7fb8701fc0d0 2024-04-21T08:58:04.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb8677fe640 1 -- 172.21.15.26:0/2374745582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb868004d10 con 0x7fb8701fc0d0 2024-04-21T08:58:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8700c35c0 con 0x7fb8701fc0d0 2024-04-21T08:58:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb8677fe640 1 -- 172.21.15.26:0/2374745582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86800aa90 con 0x7fb8701fc0d0 2024-04-21T08:58:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8700c3b40 con 0x7fb8701fc0d0 2024-04-21T08:58:04.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb870075ef0 con 0x7fb8701fc0d0 2024-04-21T08:58:04.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb8677fe640 1 -- 172.21.15.26:0/2374745582 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb86800ac30 con 0x7fb8701fc0d0 2024-04-21T08:58:04.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb8677fe640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb850068380 0x7fb85006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.218+0000 7fb8677fe640 1 -- 172.21.15.26:0/2374745582 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb868087380 con 0x7fb8701fc0d0 2024-04-21T08:58:04.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.222+0000 7fb86effd640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb850068380 0x7fb85006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.222+0000 7fb86effd640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb850068380 0x7fb85006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb86000b9f0 tx=0x7fb860008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.222+0000 7fb8677fe640 1 -- 172.21.15.26:0/2374745582 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb868020070 con 0x7fb8701fc0d0 2024-04-21T08:58:04.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.378+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8700c72e0 con 0x7fb850068380 2024-04-21T08:58:04.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.394+0000 7fb8677fe640 1 -- 172.21.15.26:0/2374745582 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251925 (secure 0 0 0) 0x7fb8700c72e0 con 0x7fb850068380 2024-04-21T08:58:04.399 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:04.401 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T08:58:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb850068380 msgr2=0x7fb85006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb850068380 0x7fb85006a840 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb86000b9f0 tx=0x7fb860008040 comp rx=0 tx=0).stop 2024-04-21T08:58:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8701fc0d0 msgr2=0x7fb87006df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8701fc0d0 0x7fb87006df10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb86800c7b0 tx=0x7fb86800cc70 comp rx=0 tx=0).stop 2024-04-21T08:58:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 shutdown_connections 2024-04-21T08:58:04.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fb850068380 0x7fb85006a840 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb8701fc0d0 0x7fb87006df10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb87015f030 0x7fb87006d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 --2- 172.21.15.26:0/2374745582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb870159150 0x7fb8700c4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 >> 172.21.15.26:0/2374745582 conn(0x7fb8700c8960 msgr2=0x7fb8701567f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 shutdown_connections 2024-04-21T08:58:04.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.398+0000 7fb875712640 1 -- 172.21.15.26:0/2374745582 wait complete. 2024-04-21T08:58:04.418 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-21T08:58:03.129982+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":234600,"kb_used_data":1824,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740120,"statfs":{"total":773094113280,"available":772853882880,"internally_reserved":0,"allocated":1867776,"data_stored":1773845,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004807"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478008+0000","last_change":"2024-04-21T08:57:44.312400+0000","last_active":"2024-04-21T08:57:45.478008+0000","last_peered":"2024-04-21T08:57:45.478008+0000","last_clean":"2024-04-21T08:57:45.478008+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T08:57:45.478008+0000","last_undegraded":"2024-04-21T08:57:45.478008+0000","last_fullsized":"2024-04-21T08:57:45.478008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302244+0000","last_change":"2024-04-21T08:57:44.307469+0000","last_active":"2024-04-21T08:57:45.302244+0000","last_peered":"2024-04-21T08:57:45.302244+0000","last_clean":"2024-04-21T08:57:45.302244+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T08:57:45.302244+0000","last_undegraded":"2024-04-21T08:57:45.302244+0000","last_fullsized":"2024-04-21T08:57:45.302244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301915+0000","last_change":"2024-04-21T08:57:44.283704+0000","last_active":"2024-04-21T08:57:45.301915+0000","last_peered":"2024-04-21T08:57:45.301915+0000","last_clean":"2024-04-21T08:57:45.301915+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T08:57:45.301915+0000","last_undegraded":"2024-04-21T08:57:45.301915+0000","last_fullsized":"2024-04-21T08:57:45.301915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:22:29.477559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474882+0000","last_change":"2024-04-21T08:57:44.297940+0000","last_active":"2024-04-21T08:57:45.474882+0000","last_peered":"2024-04-21T08:57:45.474882+0000","last_clean":"2024-04-21T08:57:45.474882+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T08:57:45.474882+0000","last_undegraded":"2024-04-21T08:57:45.474882+0000","last_fullsized":"2024-04-21T08:57:45.474882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477621+0000","last_change":"2024-04-21T08:57:44.319147+0000","last_active":"2024-04-21T08:57:45.477621+0000","last_peered":"2024-04-21T08:57:45.477621+0000","last_clean":"2024-04-21T08:57:45.477621+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T08:57:45.477621+0000","last_undegraded":"2024-04-21T08:57:45.477621+0000","last_fullsized":"2024-04-21T08:57:45.477621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475406+0000","last_change":"2024-04-21T08:57:44.292228+0000","last_active":"2024-04-21T08:57:45.475406+0000","last_peered":"2024-04-21T08:57:45.475406+0000","last_clean":"2024-04-21T08:57:45.475406+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T08:57:45.475406+0000","last_undegraded":"2024-04-21T08:57:45.475406+0000","last_fullsized":"2024-04-21T08:57:45.475406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476097+0000","last_change":"2024-04-21T08:57:44.307483+0000","last_active":"2024-04-21T08:57:45.476097+0000","last_peered":"2024-04-21T08:57:45.476097+0000","last_clean":"2024-04-21T08:57:45.476097+0000","last_became_active":"2024-04-21T08:57:44.307147+0000","last_became_peered":"2024-04-21T08:57:44.307147+0000","last_unstale":"2024-04-21T08:57:45.476097+0000","last_undegraded":"2024-04-21T08:57:45.476097+0000","last_fullsized":"2024-04-21T08:57:45.476097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:11:30.987884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301538+0000","last_change":"2024-04-21T08:57:44.316305+0000","last_active":"2024-04-21T08:57:45.301538+0000","last_peered":"2024-04-21T08:57:45.301538+0000","last_clean":"2024-04-21T08:57:45.301538+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T08:57:45.301538+0000","last_undegraded":"2024-04-21T08:57:45.301538+0000","last_fullsized":"2024-04-21T08:57:45.301538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:02.718251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296716+0000","last_change":"2024-04-21T08:57:44.306928+0000","last_active":"2024-04-21T08:57:45.296716+0000","last_peered":"2024-04-21T08:57:45.296716+0000","last_clean":"2024-04-21T08:57:45.296716+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T08:57:45.296716+0000","last_undegraded":"2024-04-21T08:57:45.296716+0000","last_fullsized":"2024-04-21T08:57:45.296716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:47.382588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477106+0000","last_change":"2024-04-21T08:57:44.307925+0000","last_active":"2024-04-21T08:57:45.477106+0000","last_peered":"2024-04-21T08:57:45.477106+0000","last_clean":"2024-04-21T08:57:45.477106+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T08:57:45.477106+0000","last_undegraded":"2024-04-21T08:57:45.477106+0000","last_fullsized":"2024-04-21T08:57:45.477106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475344+0000","last_change":"2024-04-21T08:57:44.312289+0000","last_active":"2024-04-21T08:57:45.475344+0000","last_peered":"2024-04-21T08:57:45.475344+0000","last_clean":"2024-04-21T08:57:45.475344+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T08:57:45.475344+0000","last_undegraded":"2024-04-21T08:57:45.475344+0000","last_fullsized":"2024-04-21T08:57:45.475344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477952+0000","last_change":"2024-04-21T08:57:44.315406+0000","last_active":"2024-04-21T08:57:45.477952+0000","last_peered":"2024-04-21T08:57:45.477952+0000","last_clean":"2024-04-21T08:57:45.477952+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T08:57:45.477952+0000","last_undegraded":"2024-04-21T08:57:45.477952+0000","last_fullsized":"2024-04-21T08:57:45.477952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475316+0000","last_change":"2024-04-21T08:57:44.321357+0000","last_active":"2024-04-21T08:57:45.475316+0000","last_peered":"2024-04-21T08:57:45.475316+0000","last_clean":"2024-04-21T08:57:45.475316+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T08:57:45.475316+0000","last_undegraded":"2024-04-21T08:57:45.475316+0000","last_fullsized":"2024-04-21T08:57:45.475316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:01:59.921966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475445+0000","last_change":"2024-04-21T08:57:44.315428+0000","last_active":"2024-04-21T08:57:45.475445+0000","last_peered":"2024-04-21T08:57:45.475445+0000","last_clean":"2024-04-21T08:57:45.475445+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T08:57:45.475445+0000","last_undegraded":"2024-04-21T08:57:45.475445+0000","last_fullsized":"2024-04-21T08:57:45.475445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301076+0000","last_change":"2024-04-21T08:57:44.285663+0000","last_active":"2024-04-21T08:57:45.301076+0000","last_peered":"2024-04-21T08:57:45.301076+0000","last_clean":"2024-04-21T08:57:45.301076+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T08:57:45.301076+0000","last_undegraded":"2024-04-21T08:57:45.301076+0000","last_fullsized":"2024-04-21T08:57:45.301076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:54:18.333348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474994+0000","last_change":"2024-04-21T08:57:44.288842+0000","last_active":"2024-04-21T08:57:45.474994+0000","last_peered":"2024-04-21T08:57:45.474994+0000","last_clean":"2024-04-21T08:57:45.474994+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T08:57:45.474994+0000","last_undegraded":"2024-04-21T08:57:45.474994+0000","last_fullsized":"2024-04-21T08:57:45.474994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.479022+0000","last_change":"2024-04-21T08:57:44.320371+0000","last_active":"2024-04-21T08:57:45.479022+0000","last_peered":"2024-04-21T08:57:45.479022+0000","last_clean":"2024-04-21T08:57:45.479022+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T08:57:45.479022+0000","last_undegraded":"2024-04-21T08:57:45.479022+0000","last_fullsized":"2024-04-21T08:57:45.479022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:37:23.456724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474849+0000","last_change":"2024-04-21T08:57:44.302161+0000","last_active":"2024-04-21T08:57:45.474849+0000","last_peered":"2024-04-21T08:57:45.474849+0000","last_clean":"2024-04-21T08:57:45.474849+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T08:57:45.474849+0000","last_undegraded":"2024-04-21T08:57:45.474849+0000","last_fullsized":"2024-04-21T08:57:45.474849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478601+0000","last_change":"2024-04-21T08:57:44.289531+0000","last_active":"2024-04-21T08:57:45.478601+0000","last_peered":"2024-04-21T08:57:45.478601+0000","last_clean":"2024-04-21T08:57:45.478601+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T08:57:45.478601+0000","last_undegraded":"2024-04-21T08:57:45.478601+0000","last_fullsized":"2024-04-21T08:57:45.478601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:42:25.869615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477213+0000","last_change":"2024-04-21T08:57:44.315116+0000","last_active":"2024-04-21T08:57:45.477213+0000","last_peered":"2024-04-21T08:57:45.477213+0000","last_clean":"2024-04-21T08:57:45.477213+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T08:57:45.477213+0000","last_undegraded":"2024-04-21T08:57:45.477213+0000","last_fullsized":"2024-04-21T08:57:45.477213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300338+0000","last_change":"2024-04-21T08:57:44.299295+0000","last_active":"2024-04-21T08:57:45.300338+0000","last_peered":"2024-04-21T08:57:45.300338+0000","last_clean":"2024-04-21T08:57:45.300338+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T08:57:45.300338+0000","last_undegraded":"2024-04-21T08:57:45.300338+0000","last_fullsized":"2024-04-21T08:57:45.300338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:32:23.460346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296074+0000","last_change":"2024-04-21T08:57:44.293141+0000","last_active":"2024-04-21T08:57:45.296074+0000","last_peered":"2024-04-21T08:57:45.296074+0000","last_clean":"2024-04-21T08:57:45.296074+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T08:57:45.296074+0000","last_undegraded":"2024-04-21T08:57:45.296074+0000","last_fullsized":"2024-04-21T08:57:45.296074+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301628+0000","last_change":"2024-04-21T08:57:44.291347+0000","last_active":"2024-04-21T08:57:45.301628+0000","last_peered":"2024-04-21T08:57:45.301628+0000","last_clean":"2024-04-21T08:57:45.301628+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T08:57:45.301628+0000","last_undegraded":"2024-04-21T08:57:45.301628+0000","last_fullsized":"2024-04-21T08:57:45.301628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:29.349924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475426+0000","last_change":"2024-04-21T08:57:44.283481+0000","last_active":"2024-04-21T08:57:45.475426+0000","last_peered":"2024-04-21T08:57:45.475426+0000","last_clean":"2024-04-21T08:57:45.475426+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T08:57:45.475426+0000","last_undegraded":"2024-04-21T08:57:45.475426+0000","last_fullsized":"2024-04-21T08:57:45.475426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302199+0000","last_change":"2024-04-21T08:57:44.304218+0000","last_active":"2024-04-21T08:57:45.302199+0000","last_peered":"2024-04-21T08:57:45.302199+0000","last_clean":"2024-04-21T08:57:45.302199+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T08:57:45.302199+0000","last_undegraded":"2024-04-21T08:57:45.302199+0000","last_fullsized":"2024-04-21T08:57:45.302199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476814+0000","last_change":"2024-04-21T08:57:44.305569+0000","last_active":"2024-04-21T08:57:45.476814+0000","last_peered":"2024-04-21T08:57:45.476814+0000","last_clean":"2024-04-21T08:57:45.476814+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T08:57:45.476814+0000","last_undegraded":"2024-04-21T08:57:45.476814+0000","last_fullsized":"2024-04-21T08:57:45.476814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:45.731955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476147+0000","last_change":"2024-04-21T08:57:44.314872+0000","last_active":"2024-04-21T08:57:45.476147+0000","last_peered":"2024-04-21T08:57:45.476147+0000","last_clean":"2024-04-21T08:57:45.476147+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T08:57:45.476147+0000","last_undegraded":"2024-04-21T08:57:45.476147+0000","last_fullsized":"2024-04-21T08:57:45.476147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475471+0000","last_change":"2024-04-21T08:57:44.320786+0000","last_active":"2024-04-21T08:57:45.475471+0000","last_peered":"2024-04-21T08:57:45.475471+0000","last_clean":"2024-04-21T08:57:45.475471+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T08:57:45.475471+0000","last_undegraded":"2024-04-21T08:57:45.475471+0000","last_fullsized":"2024-04-21T08:57:45.475471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301360+0000","last_change":"2024-04-21T08:57:44.292576+0000","last_active":"2024-04-21T08:57:45.301360+0000","last_peered":"2024-04-21T08:57:45.301360+0000","last_clean":"2024-04-21T08:57:45.301360+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T08:57:45.301360+0000","last_undegraded":"2024-04-21T08:57:45.301360+0000","last_fullsized":"2024-04-21T08:57:45.301360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:41:15.951168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476800+0000","last_change":"2024-04-21T08:57:44.301159+0000","last_active":"2024-04-21T08:57:45.476800+0000","last_peered":"2024-04-21T08:57:45.476800+0000","last_clean":"2024-04-21T08:57:45.476800+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T08:57:45.476800+0000","last_undegraded":"2024-04-21T08:57:45.476800+0000","last_fullsized":"2024-04-21T08:57:45.476800+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:43.985826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473997+0000","last_change":"2024-04-21T08:57:44.295923+0000","last_active":"2024-04-21T08:57:45.473997+0000","last_peered":"2024-04-21T08:57:45.473997+0000","last_clean":"2024-04-21T08:57:45.473997+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T08:57:45.473997+0000","last_undegraded":"2024-04-21T08:57:45.473997+0000","last_fullsized":"2024-04-21T08:57:45.473997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:16.918520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474254+0000","last_change":"2024-04-21T08:57:44.317457+0000","last_active":"2024-04-21T08:57:45.474254+0000","last_peered":"2024-04-21T08:57:45.474254+0000","last_clean":"2024-04-21T08:57:45.474254+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T08:57:45.474254+0000","last_undegraded":"2024-04-21T08:57:45.474254+0000","last_fullsized":"2024-04-21T08:57:45.474254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:17.843858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296164+0000","last_change":"2024-04-21T08:57:44.293278+0000","last_active":"2024-04-21T08:57:45.296164+0000","last_peered":"2024-04-21T08:57:45.296164+0000","last_clean":"2024-04-21T08:57:45.296164+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T08:57:45.296164+0000","last_undegraded":"2024-04-21T08:57:45.296164+0000","last_fullsized":"2024-04-21T08:57:45.296164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162151+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T08:57:47.162151+0000","last_peered":"2024-04-21T08:57:47.162151+0000","last_clean":"2024-04-21T08:57:47.162151+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T08:57:47.162151+0000","last_undegraded":"2024-04-21T08:57:47.162151+0000","last_fullsized":"2024-04-21T08:57:47.162151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300238+0000","last_change":"2024-04-21T08:57:44.308011+0000","last_active":"2024-04-21T08:57:45.300238+0000","last_peered":"2024-04-21T08:57:45.300238+0000","last_clean":"2024-04-21T08:57:45.300238+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T08:57:45.300238+0000","last_undegraded":"2024-04-21T08:57:45.300238+0000","last_fullsized":"2024-04-21T08:57:45.300238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:58:45.396672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478237+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T08:57:45.478237+0000","last_peered":"2024-04-21T08:57:45.478237+0000","last_clean":"2024-04-21T08:57:45.478237+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T08:57:45.478237+0000","last_undegraded":"2024-04-21T08:57:45.478237+0000","last_fullsized":"2024-04-21T08:57:45.478237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475213+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T08:57:45.475213+0000","last_peered":"2024-04-21T08:57:45.475213+0000","last_clean":"2024-04-21T08:57:45.475213+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T08:57:45.475213+0000","last_undegraded":"2024-04-21T08:57:45.475213+0000","last_fullsized":"2024-04-21T08:57:45.475213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302334+0000","last_change":"2024-04-21T08:57:44.307616+0000","last_active":"2024-04-21T08:57:45.302334+0000","last_peered":"2024-04-21T08:57:45.302334+0000","last_clean":"2024-04-21T08:57:45.302334+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T08:57:45.302334+0000","last_undegraded":"2024-04-21T08:57:45.302334+0000","last_fullsized":"2024-04-21T08:57:45.302334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:55:11.140401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475348+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T08:57:45.475348+0000","last_peered":"2024-04-21T08:57:45.475348+0000","last_clean":"2024-04-21T08:57:45.475348+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T08:57:45.475348+0000","last_undegraded":"2024-04-21T08:57:45.475348+0000","last_fullsized":"2024-04-21T08:57:45.475348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300102+0000","last_change":"2024-04-21T08:57:44.285516+0000","last_active":"2024-04-21T08:57:45.300102+0000","last_peered":"2024-04-21T08:57:45.300102+0000","last_clean":"2024-04-21T08:57:45.300102+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T08:57:45.300102+0000","last_undegraded":"2024-04-21T08:57:45.300102+0000","last_fullsized":"2024-04-21T08:57:45.300102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:06:10.459981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296625+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T08:57:45.296625+0000","last_peered":"2024-04-21T08:57:45.296625+0000","last_clean":"2024-04-21T08:57:45.296625+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T08:57:45.296625+0000","last_undegraded":"2024-04-21T08:57:45.296625+0000","last_fullsized":"2024-04-21T08:57:45.296625+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477228+0000","last_change":"2024-04-21T08:57:44.305837+0000","last_active":"2024-04-21T08:57:45.477228+0000","last_peered":"2024-04-21T08:57:45.477228+0000","last_clean":"2024-04-21T08:57:45.477228+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T08:57:45.477228+0000","last_undegraded":"2024-04-21T08:57:45.477228+0000","last_fullsized":"2024-04-21T08:57:45.477228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:47.960516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477323+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T08:57:45.477323+0000","last_peered":"2024-04-21T08:57:45.477323+0000","last_clean":"2024-04-21T08:57:45.477323+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T08:57:45.477323+0000","last_undegraded":"2024-04-21T08:57:45.477323+0000","last_fullsized":"2024-04-21T08:57:45.477323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302616+0000","last_change":"2024-04-21T08:57:44.305156+0000","last_active":"2024-04-21T08:57:45.302616+0000","last_peered":"2024-04-21T08:57:45.302616+0000","last_clean":"2024-04-21T08:57:45.302616+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T08:57:45.302616+0000","last_undegraded":"2024-04-21T08:57:45.302616+0000","last_fullsized":"2024-04-21T08:57:45.302616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.320749+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T08:57:49.320749+0000","last_peered":"2024-04-21T08:57:49.320749+0000","last_clean":"2024-04-21T08:57:49.320749+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T08:57:49.320749+0000","last_undegraded":"2024-04-21T08:57:49.320749+0000","last_fullsized":"2024-04-21T08:57:49.320749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476386+0000","last_change":"2024-04-21T08:57:44.296804+0000","last_active":"2024-04-21T08:57:45.476386+0000","last_peered":"2024-04-21T08:57:45.476386+0000","last_clean":"2024-04-21T08:57:45.476386+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T08:57:45.476386+0000","last_undegraded":"2024-04-21T08:57:45.476386+0000","last_fullsized":"2024-04-21T08:57:45.476386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319718+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T08:57:49.319718+0000","last_peered":"2024-04-21T08:57:49.319718+0000","last_clean":"2024-04-21T08:57:49.319718+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T08:57:49.319718+0000","last_undegraded":"2024-04-21T08:57:49.319718+0000","last_fullsized":"2024-04-21T08:57:49.319718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475742+0000","last_change":"2024-04-21T08:57:44.323678+0000","last_active":"2024-04-21T08:57:45.475742+0000","last_peered":"2024-04-21T08:57:45.475742+0000","last_clean":"2024-04-21T08:57:45.475742+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T08:57:45.475742+0000","last_undegraded":"2024-04-21T08:57:45.475742+0000","last_fullsized":"2024-04-21T08:57:45.475742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:26:53.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318895+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T08:57:49.318895+0000","last_peered":"2024-04-21T08:57:49.318895+0000","last_clean":"2024-04-21T08:57:49.318895+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T08:57:49.318895+0000","last_undegraded":"2024-04-21T08:57:49.318895+0000","last_fullsized":"2024-04-21T08:57:49.318895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475320+0000","last_change":"2024-04-21T08:57:44.310092+0000","last_active":"2024-04-21T08:57:45.475320+0000","last_peered":"2024-04-21T08:57:45.475320+0000","last_clean":"2024-04-21T08:57:45.475320+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T08:57:45.475320+0000","last_undegraded":"2024-04-21T08:57:45.475320+0000","last_fullsized":"2024-04-21T08:57:45.475320+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:37:03.716306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478308+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T08:57:45.478308+0000","last_peered":"2024-04-21T08:57:45.478308+0000","last_clean":"2024-04-21T08:57:45.478308+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T08:57:45.478308+0000","last_undegraded":"2024-04-21T08:57:45.478308+0000","last_fullsized":"2024-04-21T08:57:45.478308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477225+0000","last_change":"2024-04-21T08:57:44.320598+0000","last_active":"2024-04-21T08:57:45.477225+0000","last_peered":"2024-04-21T08:57:45.477225+0000","last_clean":"2024-04-21T08:57:45.477225+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T08:57:45.477225+0000","last_undegraded":"2024-04-21T08:57:45.477225+0000","last_fullsized":"2024-04-21T08:57:45.477225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:48:51.743927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476234+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T08:57:45.476234+0000","last_peered":"2024-04-21T08:57:45.476234+0000","last_clean":"2024-04-21T08:57:45.476234+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T08:57:45.476234+0000","last_undegraded":"2024-04-21T08:57:45.476234+0000","last_fullsized":"2024-04-21T08:57:45.476234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295791+0000","last_change":"2024-04-21T08:57:44.292658+0000","last_active":"2024-04-21T08:57:45.295791+0000","last_peered":"2024-04-21T08:57:45.295791+0000","last_clean":"2024-04-21T08:57:45.295791+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T08:57:45.295791+0000","last_undegraded":"2024-04-21T08:57:45.295791+0000","last_fullsized":"2024-04-21T08:57:45.295791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.321102+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T08:57:49.321102+0000","last_peered":"2024-04-21T08:57:49.321102+0000","last_clean":"2024-04-21T08:57:49.321102+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T08:57:49.321102+0000","last_undegraded":"2024-04-21T08:57:49.321102+0000","last_fullsized":"2024-04-21T08:57:49.321102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475925+0000","last_change":"2024-04-21T08:57:44.289358+0000","last_active":"2024-04-21T08:57:45.475925+0000","last_peered":"2024-04-21T08:57:45.475925+0000","last_clean":"2024-04-21T08:57:45.475925+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T08:57:45.475925+0000","last_undegraded":"2024-04-21T08:57:45.475925+0000","last_fullsized":"2024-04-21T08:57:45.475925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:38:02.186086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478220+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T08:57:45.478220+0000","last_peered":"2024-04-21T08:57:45.478220+0000","last_clean":"2024-04-21T08:57:45.478220+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T08:57:45.478220+0000","last_undegraded":"2024-04-21T08:57:45.478220+0000","last_fullsized":"2024-04-21T08:57:45.478220+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477620+0000","last_change":"2024-04-21T08:57:44.321062+0000","last_active":"2024-04-21T08:57:45.477620+0000","last_peered":"2024-04-21T08:57:45.477620+0000","last_clean":"2024-04-21T08:57:45.477620+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T08:57:45.477620+0000","last_undegraded":"2024-04-21T08:57:45.477620+0000","last_fullsized":"2024-04-21T08:57:45.477620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.318978+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T08:57:49.318978+0000","last_peered":"2024-04-21T08:57:49.318978+0000","last_clean":"2024-04-21T08:57:49.318978+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T08:57:49.318978+0000","last_undegraded":"2024-04-21T08:57:49.318978+0000","last_fullsized":"2024-04-21T08:57:49.318978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477974+0000","last_change":"2024-04-21T08:57:44.315764+0000","last_active":"2024-04-21T08:57:45.477974+0000","last_peered":"2024-04-21T08:57:45.477974+0000","last_clean":"2024-04-21T08:57:45.477974+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T08:57:45.477974+0000","last_undegraded":"2024-04-21T08:57:45.477974+0000","last_fullsized":"2024-04-21T08:57:45.477974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162213+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T08:57:47.162213+0000","last_peered":"2024-04-21T08:57:47.162213+0000","last_clean":"2024-04-21T08:57:47.162213+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T08:57:47.162213+0000","last_undegraded":"2024-04-21T08:57:47.162213+0000","last_fullsized":"2024-04-21T08:57:47.162213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477623+0000","last_change":"2024-04-21T08:57:44.315316+0000","last_active":"2024-04-21T08:57:45.477623+0000","last_peered":"2024-04-21T08:57:45.477623+0000","last_clean":"2024-04-21T08:57:45.477623+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T08:57:45.477623+0000","last_undegraded":"2024-04-21T08:57:45.477623+0000","last_fullsized":"2024-04-21T08:57:45.477623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:23:53.414019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475756+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T08:57:45.475756+0000","last_peered":"2024-04-21T08:57:45.475756+0000","last_clean":"2024-04-21T08:57:45.475756+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T08:57:45.475756+0000","last_undegraded":"2024-04-21T08:57:45.475756+0000","last_fullsized":"2024-04-21T08:57:45.475756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478318+0000","last_change":"2024-04-21T08:57:44.298472+0000","last_active":"2024-04-21T08:57:45.478318+0000","last_peered":"2024-04-21T08:57:45.478318+0000","last_clean":"2024-04-21T08:57:45.478318+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T08:57:45.478318+0000","last_undegraded":"2024-04-21T08:57:45.478318+0000","last_fullsized":"2024-04-21T08:57:45.478318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:14:06.085648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.295542+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T08:57:45.295542+0000","last_peered":"2024-04-21T08:57:45.295542+0000","last_clean":"2024-04-21T08:57:45.295542+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T08:57:45.295542+0000","last_undegraded":"2024-04-21T08:57:45.295542+0000","last_fullsized":"2024-04-21T08:57:45.295542+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477601+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T08:57:45.477601+0000","last_peered":"2024-04-21T08:57:45.477601+0000","last_clean":"2024-04-21T08:57:45.477601+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T08:57:45.477601+0000","last_undegraded":"2024-04-21T08:57:45.477601+0000","last_fullsized":"2024-04-21T08:57:45.477601+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300093+0000","last_change":"2024-04-21T08:57:44.289877+0000","last_active":"2024-04-21T08:57:45.300093+0000","last_peered":"2024-04-21T08:57:45.300093+0000","last_clean":"2024-04-21T08:57:45.300093+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T08:57:45.300093+0000","last_undegraded":"2024-04-21T08:57:45.300093+0000","last_fullsized":"2024-04-21T08:57:45.300093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:42:57.116119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475561+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T08:57:45.475561+0000","last_peered":"2024-04-21T08:57:45.475561+0000","last_clean":"2024-04-21T08:57:45.475561+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T08:57:45.475561+0000","last_undegraded":"2024-04-21T08:57:45.475561+0000","last_fullsized":"2024-04-21T08:57:45.475561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474956+0000","last_change":"2024-04-21T08:57:44.309539+0000","last_active":"2024-04-21T08:57:45.474956+0000","last_peered":"2024-04-21T08:57:45.474956+0000","last_clean":"2024-04-21T08:57:45.474956+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T08:57:45.474956+0000","last_undegraded":"2024-04-21T08:57:45.474956+0000","last_fullsized":"2024-04-21T08:57:45.474956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:47:34.419511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.473930+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T08:57:45.473930+0000","last_peered":"2024-04-21T08:57:45.473930+0000","last_clean":"2024-04-21T08:57:45.473930+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T08:57:45.473930+0000","last_undegraded":"2024-04-21T08:57:45.473930+0000","last_fullsized":"2024-04-21T08:57:45.473930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301947+0000","last_change":"2024-04-21T08:57:44.298533+0000","last_active":"2024-04-21T08:57:45.301947+0000","last_peered":"2024-04-21T08:57:45.301947+0000","last_clean":"2024-04-21T08:57:45.301947+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T08:57:45.301947+0000","last_undegraded":"2024-04-21T08:57:45.301947+0000","last_fullsized":"2024-04-21T08:57:45.301947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:49:37.742387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478433+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T08:57:45.478433+0000","last_peered":"2024-04-21T08:57:45.478433+0000","last_clean":"2024-04-21T08:57:45.478433+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T08:57:45.478433+0000","last_undegraded":"2024-04-21T08:57:45.478433+0000","last_fullsized":"2024-04-21T08:57:45.478433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.477998+0000","last_change":"2024-04-21T08:57:44.315633+0000","last_active":"2024-04-21T08:57:45.477998+0000","last_peered":"2024-04-21T08:57:45.477998+0000","last_clean":"2024-04-21T08:57:45.477998+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T08:57:45.477998+0000","last_undegraded":"2024-04-21T08:57:45.477998+0000","last_fullsized":"2024-04-21T08:57:45.477998+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:50:56.922233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.301760+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T08:57:45.301760+0000","last_peered":"2024-04-21T08:57:45.301760+0000","last_clean":"2024-04-21T08:57:45.301760+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T08:57:45.301760+0000","last_undegraded":"2024-04-21T08:57:45.301760+0000","last_fullsized":"2024-04-21T08:57:45.301760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475775+0000","last_change":"2024-04-21T08:57:44.318478+0000","last_active":"2024-04-21T08:57:45.475775+0000","last_peered":"2024-04-21T08:57:45.475775+0000","last_clean":"2024-04-21T08:57:45.475775+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T08:57:45.475775+0000","last_undegraded":"2024-04-21T08:57:45.475775+0000","last_fullsized":"2024-04-21T08:57:45.475775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:43.409066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478561+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T08:57:45.478561+0000","last_peered":"2024-04-21T08:57:45.478561+0000","last_clean":"2024-04-21T08:57:45.478561+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T08:57:45.478561+0000","last_undegraded":"2024-04-21T08:57:45.478561+0000","last_fullsized":"2024-04-21T08:57:45.478561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475343+0000","last_change":"2024-04-21T08:57:44.305172+0000","last_active":"2024-04-21T08:57:45.475343+0000","last_peered":"2024-04-21T08:57:45.475343+0000","last_clean":"2024-04-21T08:57:45.475343+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T08:57:45.475343+0000","last_undegraded":"2024-04-21T08:57:45.475343+0000","last_fullsized":"2024-04-21T08:57:45.475343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:13:46.282333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:46.165779+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T08:57:46.165779+0000","last_peered":"2024-04-21T08:57:46.165779+0000","last_clean":"2024-04-21T08:57:46.165779+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T08:57:46.165779+0000","last_undegraded":"2024-04-21T08:57:46.165779+0000","last_fullsized":"2024-04-21T08:57:46.165779+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300739+0000","last_change":"2024-04-21T08:57:44.311283+0000","last_active":"2024-04-21T08:57:45.300739+0000","last_peered":"2024-04-21T08:57:45.300739+0000","last_clean":"2024-04-21T08:57:45.300739+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T08:57:45.300739+0000","last_undegraded":"2024-04-21T08:57:45.300739+0000","last_fullsized":"2024-04-21T08:57:45.300739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:06:14.179279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.316902+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T08:57:49.316902+0000","last_peered":"2024-04-21T08:57:49.316902+0000","last_clean":"2024-04-21T08:57:49.316902+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T08:57:49.316902+0000","last_undegraded":"2024-04-21T08:57:49.316902+0000","last_fullsized":"2024-04-21T08:57:49.316902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300568+0000","last_change":"2024-04-21T08:57:44.293449+0000","last_active":"2024-04-21T08:57:45.300568+0000","last_peered":"2024-04-21T08:57:45.300568+0000","last_clean":"2024-04-21T08:57:45.300568+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T08:57:45.300568+0000","last_undegraded":"2024-04-21T08:57:45.300568+0000","last_fullsized":"2024-04-21T08:57:45.300568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:13:04.768707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474913+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T08:57:45.474913+0000","last_peered":"2024-04-21T08:57:45.474913+0000","last_clean":"2024-04-21T08:57:45.474913+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T08:57:45.474913+0000","last_undegraded":"2024-04-21T08:57:45.474913+0000","last_fullsized":"2024-04-21T08:57:45.474913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.476103+0000","last_change":"2024-04-21T08:57:44.294831+0000","last_active":"2024-04-21T08:57:45.476103+0000","last_peered":"2024-04-21T08:57:45.476103+0000","last_clean":"2024-04-21T08:57:45.476103+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T08:57:45.476103+0000","last_undegraded":"2024-04-21T08:57:45.476103+0000","last_fullsized":"2024-04-21T08:57:45.476103+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:01:04.374884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.300649+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T08:57:45.300649+0000","last_peered":"2024-04-21T08:57:45.300649+0000","last_clean":"2024-04-21T08:57:45.300649+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T08:57:45.300649+0000","last_undegraded":"2024-04-21T08:57:45.300649+0000","last_fullsized":"2024-04-21T08:57:45.300649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.299620+0000","last_change":"2024-04-21T08:57:44.299090+0000","last_active":"2024-04-21T08:57:45.299620+0000","last_peered":"2024-04-21T08:57:45.299620+0000","last_clean":"2024-04-21T08:57:45.299620+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T08:57:45.299620+0000","last_undegraded":"2024-04-21T08:57:45.299620+0000","last_fullsized":"2024-04-21T08:57:45.299620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:42:44.581682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.475613+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T08:57:45.475613+0000","last_peered":"2024-04-21T08:57:45.475613+0000","last_clean":"2024-04-21T08:57:45.475613+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T08:57:45.475613+0000","last_undegraded":"2024-04-21T08:57:45.475613+0000","last_fullsized":"2024-04-21T08:57:45.475613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.474385+0000","last_change":"2024-04-21T08:57:44.317697+0000","last_active":"2024-04-21T08:57:45.474385+0000","last_peered":"2024-04-21T08:57:45.474385+0000","last_clean":"2024-04-21T08:57:45.474385+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T08:57:45.474385+0000","last_undegraded":"2024-04-21T08:57:45.474385+0000","last_fullsized":"2024-04-21T08:57:45.474385+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:48.099903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.317492+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T08:57:49.317492+0000","last_peered":"2024-04-21T08:57:49.317492+0000","last_clean":"2024-04-21T08:57:49.317492+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T08:57:49.317492+0000","last_undegraded":"2024-04-21T08:57:49.317492+0000","last_fullsized":"2024-04-21T08:57:49.317492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478072+0000","last_change":"2024-04-21T08:57:44.300498+0000","last_active":"2024-04-21T08:57:45.478072+0000","last_peered":"2024-04-21T08:57:45.478072+0000","last_clean":"2024-04-21T08:57:45.478072+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T08:57:45.478072+0000","last_undegraded":"2024-04-21T08:57:45.478072+0000","last_fullsized":"2024-04-21T08:57:45.478072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:36:51.242004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.478121+0000","last_change":"2024-04-21T08:57:44.321085+0000","last_active":"2024-04-21T08:57:45.478121+0000","last_peered":"2024-04-21T08:57:45.478121+0000","last_clean":"2024-04-21T08:57:45.478121+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T08:57:45.478121+0000","last_undegraded":"2024-04-21T08:57:45.478121+0000","last_fullsized":"2024-04-21T08:57:45.478121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:06:49.754472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.313140+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T08:57:49.313140+0000","last_peered":"2024-04-21T08:57:49.313140+0000","last_clean":"2024-04-21T08:57:49.313140+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T08:57:49.313140+0000","last_undegraded":"2024-04-21T08:57:49.313140+0000","last_fullsized":"2024-04-21T08:57:49.313140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.296663+0000","last_change":"2024-04-21T08:57:44.315810+0000","last_active":"2024-04-21T08:57:45.296663+0000","last_peered":"2024-04-21T08:57:45.296663+0000","last_clean":"2024-04-21T08:57:45.296663+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T08:57:45.296663+0000","last_undegraded":"2024-04-21T08:57:45.296663+0000","last_fullsized":"2024-04-21T08:57:45.296663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:06.785412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.311969+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T08:57:49.311969+0000","last_peered":"2024-04-21T08:57:49.311969+0000","last_clean":"2024-04-21T08:57:49.311969+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T08:57:49.311969+0000","last_undegraded":"2024-04-21T08:57:49.311969+0000","last_fullsized":"2024-04-21T08:57:49.311969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302388+0000","last_change":"2024-04-21T08:57:44.303912+0000","last_active":"2024-04-21T08:57:45.302388+0000","last_peered":"2024-04-21T08:57:45.302388+0000","last_clean":"2024-04-21T08:57:45.302388+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T08:57:45.302388+0000","last_undegraded":"2024-04-21T08:57:45.302388+0000","last_fullsized":"2024-04-21T08:57:45.302388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:15.317505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:47.162279+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T08:57:47.162279+0000","last_peered":"2024-04-21T08:57:47.162279+0000","last_clean":"2024-04-21T08:57:47.162279+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T08:57:47.162279+0000","last_undegraded":"2024-04-21T08:57:47.162279+0000","last_fullsized":"2024-04-21T08:57:47.162279+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:45.302272+0000","last_change":"2024-04-21T08:57:44.301951+0000","last_active":"2024-04-21T08:57:45.302272+0000","last_peered":"2024-04-21T08:57:45.302272+0000","last_clean":"2024-04-21T08:57:45.302272+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T08:57:45.302272+0000","last_undegraded":"2024-04-21T08:57:45.302272+0000","last_fullsized":"2024-04-21T08:57:45.302272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:47:57.646210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-21T08:57:49.319970+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T08:57:49.319970+0000","last_peered":"2024-04-21T08:57:49.319970+0000","last_clean":"2024-04-21T08:57:49.319970+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T08:57:49.319970+0000","last_undegraded":"2024-04-21T08:57:49.319970+0000","last_fullsized":"2024-04-21T08:57:49.319970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":212992,"data_stored":74063,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":221184,"data_stored":75093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":663919,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":217088,"data_stored":73537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":73605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":663941,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":73481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":229376,"data_stored":76206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2725,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T08:58:04.421 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:58:04.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643f5a6640 1 Processor -- start 2024-04-21T08:58:04.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643f5a6640 1 -- start start 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643f5a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f643815b320 0x7f643815b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643f5a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f643815bc40 0x7f64381590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643f5a6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64380c4c20 con 0x7f64380c5e30 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643f5a6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f64380c4f00 con 0x7f643815bc40 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643f5a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f64380c51e0 con 0x7f643815b320 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643d342640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f643815b320 0x7f643815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643cb41640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f643815bc40 0x7f64381590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643d342640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f643815b320 0x7f643815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:37120/0 (socket says 172.21.15.26:37120) 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643db43640 1 --1- 172.21.15.26:0/3010614629 >> v1:172.21.15.169:6789/0 conn(0x7f64380c5e30 0x7f6438151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:39302/0 (socket says 172.21.15.26:39302) 2024-04-21T08:58:04.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643d342640 1 -- 172.21.15.26:0/3010614629 learned_addr learned my addr 172.21.15.26:0/3010614629 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:04.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643cb41640 1 -- 172.21.15.26:0/3010614629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f643815b320 msgr2=0x7f643815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:04.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643cb41640 1 --2- 172.21.15.26:0/3010614629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f643815b320 0x7f643815b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643cb41640 1 -- 172.21.15.26:0/3010614629 >> v1:172.21.15.169:6789/0 conn(0x7f64380c5e30 legacy=0x7f6438151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.578+0000 7f643cb41640 1 -- 172.21.15.26:0/3010614629 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64380c54c0 con 0x7f643815bc40 2024-04-21T08:58:04.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643cb41640 1 --2- 172.21.15.26:0/3010614629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815bc40 0x7f64381590c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f64280097c0 tx=0x7f642801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef847d0e085066c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f642ffff640 1 -- 172.21.15.26:0/3010614629 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280b5070 con 0x7f643815bc40 2024-04-21T08:58:04.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f642ffff640 1 -- 172.21.15.26:0/3010614629 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64280a8990 con 0x7f643815bc40 2024-04-21T08:58:04.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f642ffff640 1 -- 172.21.15.26:0/3010614629 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64280a8d60 con 0x7f643815bc40 2024-04-21T08:58:04.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- 172.21.15.26:0/3010614629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815bc40 msgr2=0x7f64381590c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 --2- 172.21.15.26:0/3010614629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815bc40 0x7f64381590c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f64280097c0 tx=0x7f642801ec90 comp rx=0 tx=0).stop 2024-04-21T08:58:04.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- 172.21.15.26:0/3010614629 shutdown_connections 2024-04-21T08:58:04.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 --2- 172.21.15.26:0/3010614629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815bc40 0x7f64381590c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 --2- 172.21.15.26:0/3010614629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f643815b320 0x7f643815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- 172.21.15.26:0/3010614629 >> 172.21.15.26:0/3010614629 conn(0x7f64380c8960 msgr2=0x7f64380c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:04.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- 172.21.15.26:0/3010614629 shutdown_connections 2024-04-21T08:58:04.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- 172.21.15.26:0/3010614629 wait complete. 2024-04-21T08:58:04.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 Processor -- start 2024-04-21T08:58:04.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- start start 2024-04-21T08:58:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64380c5e30 0x7f6438152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815b320 0x7f64381507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64381ef2d0 0x7f6438157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f64380c9710 con 0x7f64380c5e30 2024-04-21T08:58:04.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f64380bfa30 con 0x7f643815b320 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643f5a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f64380c9890 con 0x7f64381ef2d0 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643d342640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64380c5e30 0x7f6438152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643d342640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64380c5e30 0x7f6438152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57152/0 (socket says 172.21.15.26:57152) 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643d342640 1 -- 172.21.15.26:0/2661622975 learned_addr learned my addr 172.21.15.26:0/2661622975 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.582+0000 7f643db43640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64381ef2d0 0x7f6438157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643cb41640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815b320 0x7f64381507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643d342640 1 -- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64381ef2d0 msgr2=0x7f6438157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643d342640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64381ef2d0 0x7f6438157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643d342640 1 -- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815b320 msgr2=0x7f64381507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643d342640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815b320 0x7f64381507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643d342640 1 -- 172.21.15.26:0/2661622975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64381530f0 con 0x7f64380c5e30 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643cb41640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815b320 0x7f64381507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643d342640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64380c5e30 0x7f6438152bb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f643400e890 tx=0x7f643400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f642dffb640 1 -- 172.21.15.26:0/2661622975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6434017070 con 0x7f64380c5e30 2024-04-21T08:58:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f642dffb640 1 -- 172.21.15.26:0/2661622975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f643400c940 con 0x7f64380c5e30 2024-04-21T08:58:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6438155630 con 0x7f64380c5e30 2024-04-21T08:58:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f642dffb640 1 -- 172.21.15.26:0/2661622975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643400cd30 con 0x7f64380c5e30 2024-04-21T08:58:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64381f2860 con 0x7f64380c5e30 2024-04-21T08:58:04.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6438075ef0 con 0x7f64380c5e30 2024-04-21T08:58:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f642dffb640 1 -- 172.21.15.26:0/2661622975 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f643401a070 con 0x7f64380c5e30 2024-04-21T08:58:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f642dffb640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f641c0683b0 0x7f641c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f642dffb640 1 -- 172.21.15.26:0/2661622975 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6434086920 con 0x7f64380c5e30 2024-04-21T08:58:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643cb41640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f641c0683b0 0x7f641c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.586+0000 7f643cb41640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f641c0683b0 0x7f641c06a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64280b2000 tx=0x7f6428008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.590+0000 7f642dffb640 1 -- 172.21.15.26:0/2661622975 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6434056800 con 0x7f64380c5e30 2024-04-21T08:58:04.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f643814d620 con 0x7f64380c5e30 2024-04-21T08:58:04.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f642dffb640 1 -- 172.21.15.26:0/2661622975 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f643405ab00 con 0x7f64380c5e30 2024-04-21T08:58:04.792 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:04.792 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T08:58:04.792 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T08:58:04.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f641c0683b0 msgr2=0x7f641c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f641c0683b0 0x7f641c06a870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f64280b2000 tx=0x7f6428008040 comp rx=0 tx=0).stop 2024-04-21T08:58:04.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64380c5e30 msgr2=0x7f6438152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64380c5e30 0x7f6438152bb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f643400e890 tx=0x7f643400ed50 comp rx=0 tx=0).stop 2024-04-21T08:58:04.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 shutdown_connections 2024-04-21T08:58:04.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64381ef2d0 0x7f6438157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f643815b320 0x7f64381507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f641c0683b0 0x7f641c06a870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 --2- 172.21.15.26:0/2661622975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64380c5e30 0x7f6438152bb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 >> 172.21.15.26:0/2661622975 conn(0x7f64380c8960 msgr2=0x7f64380c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:04.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 shutdown_connections 2024-04-21T08:58:04.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.790+0000 7f643f5a6640 1 -- 172.21.15.26:0/2661622975 wait complete. 2024-04-21T08:58:04.812 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:58:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8536d37640 1 Processor -- start 2024-04-21T08:58:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8536d37640 1 -- start start 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8536d37640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f8530072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8536d37640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f853006e0f0 0x7f853015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8536d37640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85300c9150 con 0x7f85300734f0 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8536d37640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f85300c7f60 con 0x7f853006e0f0 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8536d37640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f85300c8bd0 con 0x7f853015e640 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f852ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f853006e0f0 0x7f853015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f85352d4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f85300734f0 0x7f85300b1d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43262/0 (socket says 172.21.15.26:43262) 2024-04-21T08:58:04.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f852ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f853006e0f0 0x7f853015ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57164/0 (socket says 172.21.15.26:57164) 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f85352d4640 1 -- 172.21.15.26:0/102248327 learned_addr learned my addr 172.21.15.26:0/102248327 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8534ad3640 1 --2- 172.21.15.26:0/102248327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f8530072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f852ffff640 1 -- 172.21.15.26:0/102248327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 msgr2=0x7f8530072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f852ffff640 1 --2- 172.21.15.26:0/102248327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f8530072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f852ffff640 1 -- 172.21.15.26:0/102248327 >> v1:172.21.15.26:6789/0 conn(0x7f85300734f0 legacy=0x7f85300b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f852ffff640 1 -- 172.21.15.26:0/102248327 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85300c84c0 con 0x7f853006e0f0 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f852f7fe640 1 -- 172.21.15.26:0/102248327 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377674753 0 0) 0x7f85300c9150 con 0x7f85300734f0 2024-04-21T08:58:04.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.930+0000 7f8534ad3640 1 --2- 172.21.15.26:0/102248327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f8530072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:58:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f852ffff640 1 --2- 172.21.15.26:0/102248327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f853015ea20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f85180097c0 tx=0x7f851801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba1aebf592c45b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f852f7fe640 1 -- 172.21.15.26:0/102248327 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85180a7070 con 0x7f853006e0f0 2024-04-21T08:58:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f852f7fe640 1 -- 172.21.15.26:0/102248327 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85180b0070 con 0x7f853006e0f0 2024-04-21T08:58:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f852f7fe640 1 -- 172.21.15.26:0/102248327 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85180ab890 con 0x7f853006e0f0 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- 172.21.15.26:0/102248327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 msgr2=0x7f853015ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 --2- 172.21.15.26:0/102248327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f853015ea20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f85180097c0 tx=0x7f851801c470 comp rx=0 tx=0).stop 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- 172.21.15.26:0/102248327 shutdown_connections 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 --2- 172.21.15.26:0/102248327 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f853015ea20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 --2- 172.21.15.26:0/102248327 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f8530072fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- 172.21.15.26:0/102248327 >> 172.21.15.26:0/102248327 conn(0x7f85300c9b50 msgr2=0x7f85300c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- 172.21.15.26:0/102248327 shutdown_connections 2024-04-21T08:58:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- 172.21.15.26:0/102248327 wait complete. 2024-04-21T08:58:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 Processor -- start 2024-04-21T08:58:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- start start 2024-04-21T08:58:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f85301f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85300734f0 0x7f85301f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f85301f73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f85300b2590 con 0x7f853006e0f0 2024-04-21T08:58:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f85300b2410 con 0x7f85300734f0 2024-04-21T08:58:04.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8536d37640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f8530167f30 con 0x7f853015e640 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8534ad3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f85301f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8534ad3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f85301f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57170/0 (socket says 172.21.15.26:57170) 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8534ad3640 1 -- 172.21.15.26:0/2719337546 learned_addr learned my addr 172.21.15.26:0/2719337546 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f85352d4640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f85301f73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f852ffff640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85300734f0 0x7f85301f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8534ad3640 1 -- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 msgr2=0x7f85301f73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.934+0000 7f8534ad3640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f85301f73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f8534ad3640 1 -- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85300734f0 msgr2=0x7f85301f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f8534ad3640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85300734f0 0x7f85301f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f8534ad3640 1 -- 172.21.15.26:0/2719337546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85300c3a90 con 0x7f853006e0f0 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f85352d4640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f85301f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:04.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852ffff640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85300734f0 0x7f85301f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f8534ad3640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f85301f57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8520007f20 tx=0x7f852000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852d7fa640 1 -- 172.21.15.26:0/2719337546 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f852001a070 con 0x7f853006e0f0 2024-04-21T08:58:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852d7fa640 1 -- 172.21.15.26:0/2719337546 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8520003ba0 con 0x7f853006e0f0 2024-04-21T08:58:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85300c3d70 con 0x7f853006e0f0 2024-04-21T08:58:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852d7fa640 1 -- 172.21.15.26:0/2719337546 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8520004030 con 0x7f853006e0f0 2024-04-21T08:58:04.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85300cc6b0 con 0x7f853006e0f0 2024-04-21T08:58:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8530075ef0 con 0x7f853006e0f0 2024-04-21T08:58:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852d7fa640 1 -- 172.21.15.26:0/2719337546 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f852001d070 con 0x7f853006e0f0 2024-04-21T08:58:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852d7fa640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f8510068380 0x7f851006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852d7fa640 1 -- 172.21.15.26:0/2719337546 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8520086be0 con 0x7f853006e0f0 2024-04-21T08:58:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852ffff640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f8510068380 0x7f851006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:04.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.938+0000 7f852ffff640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f8510068380 0x7f851006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85180af000 tx=0x7f8518008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:04.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:04.942+0000 7f852d7fa640 1 -- 172.21.15.26:0/2719337546 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8520010070 con 0x7f853006e0f0 2024-04-21T08:58:05.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.106+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85300c5b40 con 0x7f853006e0f0 2024-04-21T08:58:05.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.106+0000 7f852d7fa640 1 -- 172.21.15.26:0/2719337546 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7f8520056ab0 con 0x7f853006e0f0 2024-04-21T08:58:05.110 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:05.111 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:58:05.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f8510068380 msgr2=0x7f851006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f8510068380 0x7f851006a840 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f85180af000 tx=0x7f8518008040 comp rx=0 tx=0).stop 2024-04-21T08:58:05.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 msgr2=0x7f85301f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f85301f57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8520007f20 tx=0x7f852000d560 comp rx=0 tx=0).stop 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 shutdown_connections 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f853015e640 0x7f85301f73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85300734f0 0x7f85301f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f8510068380 0x7f851006a840 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 --2- 172.21.15.26:0/2719337546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f853006e0f0 0x7f85301f57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 >> 172.21.15.26:0/2719337546 conn(0x7f85300c9b50 msgr2=0x7f85300cafb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 shutdown_connections 2024-04-21T08:58:05.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.110+0000 7f8536d37640 1 -- 172.21.15.26:0/2719337546 wait complete. 2024-04-21T08:58:05.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T08:58:05.130 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T08:58:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 Processor -- start 2024-04-21T08:58:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 -- start start 2024-04-21T08:58:05.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff66c154e70 0x7ff66c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff66c0cc8d0 0x7ff66c0d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c0cb340 0x7ff66c0d0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff66c15e260 con 0x7ff66c0cc8d0 2024-04-21T08:58:05.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff66c15e540 con 0x7ff66c154e70 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff673db6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c15e820 con 0x7ff66c0cb340 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff66c0cc8d0 0x7ff66c0d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff66c0cc8d0 0x7ff66c0d0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57180/0 (socket says 172.21.15.26:57180) 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 -- 172.21.15.26:0/382707390 learned_addr learned my addr 172.21.15.26:0/382707390 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff672353640 1 --2- 172.21.15.26:0/382707390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c0cb340 0x7ff66c0d0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671b52640 1 --2- 172.21.15.26:0/382707390 >> v2:172.21.15.169:3300/0 conn(0x7ff66c154e70 0x7ff66c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 -- 172.21.15.26:0/382707390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c0cb340 msgr2=0x7ff66c0d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 --2- 172.21.15.26:0/382707390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c0cb340 0x7ff66c0d0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 -- 172.21.15.26:0/382707390 >> v2:172.21.15.169:3300/0 conn(0x7ff66c154e70 msgr2=0x7ff66c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 --2- 172.21.15.26:0/382707390 >> v2:172.21.15.169:3300/0 conn(0x7ff66c154e70 0x7ff66c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671351640 1 -- 172.21.15.26:0/382707390 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c15eb00 con 0x7ff66c0cc8d0 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff671b52640 1 --2- 172.21.15.26:0/382707390 >> v2:172.21.15.169:3300/0 conn(0x7ff66c154e70 0x7ff66c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:58:05.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.254+0000 7ff672353640 1 --2- 172.21.15.26:0/382707390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c0cb340 0x7ff66c0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:58:05.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff671351640 1 --2- 172.21.15.26:0/382707390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c0cc8d0 0x7ff66c0d0350 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0cadf0 tx=0x7ff65c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=552b4a52c58d52f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff670b50640 1 -- 172.21.15.26:0/382707390 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0b0070 con 0x7ff66c0cc8d0 2024-04-21T08:58:05.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff670b50640 1 -- 172.21.15.26:0/382707390 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c0ab600 con 0x7ff66c0cc8d0 2024-04-21T08:58:05.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff670b50640 1 -- 172.21.15.26:0/382707390 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0ab9d0 con 0x7ff66c0cc8d0 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 -- 172.21.15.26:0/382707390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c0cc8d0 msgr2=0x7ff66c0d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 --2- 172.21.15.26:0/382707390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c0cc8d0 0x7ff66c0d0350 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0cadf0 tx=0x7ff65c01c520 comp rx=0 tx=0).stop 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 -- 172.21.15.26:0/382707390 shutdown_connections 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 --2- 172.21.15.26:0/382707390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c0cc8d0 0x7ff66c0d0350 secure :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff66c0cadf0 tx=0x7ff65c01c520 comp rx=0 tx=0).stop 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 --2- 172.21.15.26:0/382707390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c0cb340 0x7ff66c0d0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 --2- 172.21.15.26:0/382707390 >> v2:172.21.15.169:3300/0 conn(0x7ff66c154e70 0x7ff66c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 -- 172.21.15.26:0/382707390 >> 172.21.15.26:0/382707390 conn(0x7ff66c06de70 msgr2=0x7ff66c06e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 -- 172.21.15.26:0/382707390 shutdown_connections 2024-04-21T08:58:05.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 -- 172.21.15.26:0/382707390 wait complete. 2024-04-21T08:58:05.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 Processor -- start 2024-04-21T08:58:05.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.258+0000 7ff673db6640 1 -- start start 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff66c0cb340 0x7ff66c1f4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c154e70 0x7ff66c1f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c152050 0x7ff66c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0cd160 con 0x7ff66c152050 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff66c0ccfe0 con 0x7ff66c0cb340 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff66c0cd2e0 con 0x7ff66c154e70 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c152050 0x7ff66c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c152050 0x7ff66c14f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57194/0 (socket says 172.21.15.26:57194) 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 -- 172.21.15.26:0/940883420 learned_addr learned my addr 172.21.15.26:0/940883420 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:05.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff671b52640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff66c0cb340 0x7ff66c1f4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff671351640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c154e70 0x7ff66c1f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 -- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c154e70 msgr2=0x7ff66c1f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c154e70 0x7ff66c1f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 -- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff66c0cb340 msgr2=0x7ff66c1f4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff66c0cb340 0x7ff66c1f4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 -- 172.21.15.26:0/940883420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66c1f3d40 con 0x7ff66c152050 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff672353640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c152050 0x7ff66c14f580 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff66400e610 tx=0x7ff66400ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff6627fc640 1 -- 172.21.15.26:0/940883420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff66400f040 con 0x7ff66c152050 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff6627fc640 1 -- 172.21.15.26:0/940883420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff664004230 con 0x7ff66c152050 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff66c151190 con 0x7ff66c152050 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff6627fc640 1 -- 172.21.15.26:0/940883420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff664003620 con 0x7ff66c152050 2024-04-21T08:58:05.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff66c14be70 con 0x7ff66c152050 2024-04-21T08:58:05.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66c1f3f10 con 0x7ff66c152050 2024-04-21T08:58:05.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff6627fc640 1 -- 172.21.15.26:0/940883420 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff6640037c0 con 0x7ff66c152050 2024-04-21T08:58:05.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff6627fc640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6500683b0 0x7ff65006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff6627fc640 1 -- 172.21.15.26:0/940883420 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff664086540 con 0x7ff66c152050 2024-04-21T08:58:05.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.262+0000 7ff671b52640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6500683b0 0x7ff65006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.266+0000 7ff671b52640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6500683b0 0x7ff65006a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff668004430 tx=0x7ff668003a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.266+0000 7ff6627fc640 1 -- 172.21.15.26:0/940883420 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff664017020 con 0x7ff66c152050 2024-04-21T08:58:05.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.434+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff66c074320 con 0x7ff66c152050 2024-04-21T08:58:05.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.434+0000 7ff6627fc640 1 -- 172.21.15.26:0/940883420 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff664056b90 con 0x7ff66c152050 2024-04-21T08:58:05.438 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T08:58:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6500683b0 msgr2=0x7ff65006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6500683b0 0x7ff65006a870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff668004430 tx=0x7ff668003a00 comp rx=0 tx=0).stop 2024-04-21T08:58:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c152050 msgr2=0x7ff66c14f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c152050 0x7ff66c14f580 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff66400e610 tx=0x7ff66400ead0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 shutdown_connections 2024-04-21T08:58:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff6500683b0 0x7ff65006a870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff66c152050 0x7ff66c14f580 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff66c154e70 0x7ff66c1f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 --2- 172.21.15.26:0/940883420 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff66c0cb340 0x7ff66c1f4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 >> 172.21.15.26:0/940883420 conn(0x7ff66c06de70 msgr2=0x7ff66c152a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 shutdown_connections 2024-04-21T08:58:05.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.438+0000 7ff673db6640 1 -- 172.21.15.26:0/940883420 wait complete. 2024-04-21T08:58:05.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T08:58:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.578+0000 7f0c4fec4640 1 Processor -- start 2024-04-21T08:58:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.578+0000 7f0c4fec4640 1 -- start start 2024-04-21T08:58:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4fec4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0c48151bc0 0x7f0c48072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4fec4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c48151fa0 0x7f0c480732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4fec4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c480bfbb0 con 0x7f0c480c5e30 2024-04-21T08:58:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4fec4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4806d1b0 con 0x7f0c48151fa0 2024-04-21T08:58:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4fec4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0c4806ced0 con 0x7f0c48151bc0 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4d45f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c48151fa0 0x7f0c480732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4e461640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0c480c5e30 0x7f0c48157a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43266/0 (socket says 172.21.15.26:43266) 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4e461640 1 -- 172.21.15.26:0/624481341 learned_addr learned my addr 172.21.15.26:0/624481341 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4dc60640 1 --2- 172.21.15.26:0/624481341 >> v2:172.21.15.169:3300/0 conn(0x7f0c48151bc0 0x7f0c48072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4d45f640 1 -- 172.21.15.26:0/624481341 >> v2:172.21.15.169:3300/0 conn(0x7f0c48151bc0 msgr2=0x7f0c48072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4d45f640 1 --2- 172.21.15.26:0/624481341 >> v2:172.21.15.169:3300/0 conn(0x7f0c48151bc0 0x7f0c48072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4d45f640 1 -- 172.21.15.26:0/624481341 >> v1:172.21.15.26:6789/0 conn(0x7f0c480c5e30 legacy=0x7f0c48157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4d45f640 1 -- 172.21.15.26:0/624481341 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c48071fd0 con 0x7f0c48151fa0 2024-04-21T08:58:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4d45f640 1 --2- 172.21.15.26:0/624481341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480732d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c380097c0 tx=0x7f0c3801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa032480e09a62e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4cc5e640 1 -- 172.21.15.26:0/624481341 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c380b0070 con 0x7f0c48151fa0 2024-04-21T08:58:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4cc5e640 1 -- 172.21.15.26:0/624481341 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c380ab600 con 0x7f0c48151fa0 2024-04-21T08:58:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.582+0000 7f0c4cc5e640 1 -- 172.21.15.26:0/624481341 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c380ab9d0 con 0x7f0c48151fa0 2024-04-21T08:58:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- 172.21.15.26:0/624481341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 msgr2=0x7f0c480732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/624481341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480732d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0c380097c0 tx=0x7f0c3801c2f0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- 172.21.15.26:0/624481341 shutdown_connections 2024-04-21T08:58:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/624481341 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480732d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/624481341 >> v2:172.21.15.169:3300/0 conn(0x7f0c48151bc0 0x7f0c48072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- 172.21.15.26:0/624481341 >> 172.21.15.26:0/624481341 conn(0x7f0c480cbef0 msgr2=0x7f0c480cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- 172.21.15.26:0/624481341 shutdown_connections 2024-04-21T08:58:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- 172.21.15.26:0/624481341 wait complete. 2024-04-21T08:58:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 Processor -- start 2024-04-21T08:58:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- start start 2024-04-21T08:58:05.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c480c5e30 0x7f0c48154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c48151bc0 0x7f0c481f16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c48072870 con 0x7f0c48151fa0 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c48072590 con 0x7f0c480c5e30 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c4806cb00 con 0x7f0c48151bc0 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57208/0 (socket says 172.21.15.26:57208) 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 -- 172.21.15.26:0/628390023 learned_addr learned my addr 172.21.15.26:0/628390023 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4d45f640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c48151bc0 0x7f0c481f16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4dc60640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c480c5e30 0x7f0c48154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 -- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c48151bc0 msgr2=0x7f0c481f16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c48151bc0 0x7f0c481f16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 -- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c480c5e30 msgr2=0x7f0c48154cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c480c5e30 0x7f0c48154cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 -- 172.21.15.26:0/628390023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c481552c0 con 0x7f0c48151fa0 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4dc60640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c480c5e30 0x7f0c48154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4e461640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480caf40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000e550 tx=0x7f0c4000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c3e7fc640 1 -- 172.21.15.26:0/628390023 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c400119f0 con 0x7f0c48151fa0 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c3e7fc640 1 -- 172.21.15.26:0/628390023 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c40015070 con 0x7f0c48151fa0 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c481eda90 con 0x7f0c48151fa0 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c3e7fc640 1 -- 172.21.15.26:0/628390023 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40011dd0 con 0x7f0c48151fa0 2024-04-21T08:58:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.586+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c481ee050 con 0x7f0c48151fa0 2024-04-21T08:58:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.590+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c48074320 con 0x7f0c48151fa0 2024-04-21T08:58:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.590+0000 7f0c3e7fc640 1 -- 172.21.15.26:0/628390023 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c4001a470 con 0x7f0c48151fa0 2024-04-21T08:58:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.590+0000 7f0c3e7fc640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c2c068380 0x7f0c2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.590+0000 7f0c3e7fc640 1 -- 172.21.15.26:0/628390023 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0c4008b790 con 0x7f0c48151fa0 2024-04-21T08:58:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.590+0000 7f0c4dc60640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c2c068380 0x7f0c2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.590+0000 7f0c4dc60640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c2c068380 0x7f0c2c06a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c44007a70 tx=0x7f0c44008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.594+0000 7f0c3e7fc640 1 -- 172.21.15.26:0/628390023 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c4005b650 con 0x7f0c48151fa0 2024-04-21T08:58:05.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0c480c6380 con 0x7f0c48151fa0 2024-04-21T08:58:05.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c3e7fc640 1 -- 172.21.15.26:0/628390023 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f0c4005f950 con 0x7f0c48151fa0 2024-04-21T08:58:05.752 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T08:58:05.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c2c068380 msgr2=0x7f0c2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c2c068380 0x7f0c2c06a840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0c44007a70 tx=0x7f0c44008040 comp rx=0 tx=0).stop 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 msgr2=0x7f0c480caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480caf40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000e550 tx=0x7f0c4000ea10 comp rx=0 tx=0).stop 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 shutdown_connections 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c2c068380 0x7f0c2c06a840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c48151fa0 0x7f0c480caf40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c48151bc0 0x7f0c481f16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 --2- 172.21.15.26:0/628390023 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c480c5e30 0x7f0c48154cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.750+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 >> 172.21.15.26:0/628390023 conn(0x7f0c480cbef0 msgr2=0x7f0c4814bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.754+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 shutdown_connections 2024-04-21T08:58:05.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.754+0000 7f0c4fec4640 1 -- 172.21.15.26:0/628390023 wait complete. 2024-04-21T08:58:05.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T08:58:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.882+0000 7f18117bf640 1 Processor -- start 2024-04-21T08:58:05.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.882+0000 7f18117bf640 1 -- start start 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f180c154e70 0x7f180c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f180c0cb340 0x7f180c0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f180c15e260 con 0x7f180c0cc8d0 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f180c15e540 con 0x7f180c0cb340 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f180c15e820 con 0x7f180c154e70 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f180c0cb340 0x7f180c0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f180c0cb340 0x7f180c0c8990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57216/0 (socket says 172.21.15.26:57216) 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 -- 172.21.15.26:0/3156208753 learned_addr learned my addr 172.21.15.26:0/3156208753 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:05.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180affd640 1 --2- 172.21.15.26:0/3156208753 >> v2:172.21.15.169:3300/0 conn(0x7f180c154e70 0x7f180c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 -- 172.21.15.26:0/3156208753 >> v2:172.21.15.169:3300/0 conn(0x7f180c154e70 msgr2=0x7f180c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 --2- 172.21.15.26:0/3156208753 >> v2:172.21.15.169:3300/0 conn(0x7f180c154e70 0x7f180c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 -- 172.21.15.26:0/3156208753 >> v1:172.21.15.169:6789/0 conn(0x7f180c0cc8d0 legacy=0x7f180c0d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:05.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 -- 172.21.15.26:0/3156208753 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c15eb00 con 0x7f180c0cb340 2024-04-21T08:58:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f180b7fe640 1 --2- 172.21.15.26:0/3156208753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c0cb340 0x7f180c0c8990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f180c0cadf0 tx=0x7f180401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c778c3d0752718b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f1809ffb640 1 -- 172.21.15.26:0/3156208753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5670 con 0x7f180c0cb340 2024-04-21T08:58:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f1809ffb640 1 -- 172.21.15.26:0/3156208753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040a5810 con 0x7f180c0cb340 2024-04-21T08:58:05.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f1809ffb640 1 -- 172.21.15.26:0/3156208753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5be0 con 0x7f180c0cb340 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 -- 172.21.15.26:0/3156208753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c0cb340 msgr2=0x7f180c0c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 --2- 172.21.15.26:0/3156208753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c0cb340 0x7f180c0c8990 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f180c0cadf0 tx=0x7f180401c9b0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 -- 172.21.15.26:0/3156208753 shutdown_connections 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 --2- 172.21.15.26:0/3156208753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c0cb340 0x7f180c0c8990 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 --2- 172.21.15.26:0/3156208753 >> v2:172.21.15.169:3300/0 conn(0x7f180c154e70 0x7f180c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.886+0000 7f18117bf640 1 -- 172.21.15.26:0/3156208753 >> 172.21.15.26:0/3156208753 conn(0x7f180c06de70 msgr2=0x7f180c06e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- 172.21.15.26:0/3156208753 shutdown_connections 2024-04-21T08:58:05.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- 172.21.15.26:0/3156208753 wait complete. 2024-04-21T08:58:05.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 Processor -- start 2024-04-21T08:58:05.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- start start 2024-04-21T08:58:05.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f180c0cb340 0x7f180c15d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f180c0cc8d0 0x7f180c1f7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c154e70 0x7f180c1f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f180c0d0be0 con 0x7f180c154e70 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f180c0d0a60 con 0x7f180c0cc8d0 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f180c167d70 con 0x7f180c0cb340 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c154e70 0x7f180c1f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c154e70 0x7f180c1f7a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57226/0 (socket says 172.21.15.26:57226) 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 -- 172.21.15.26:0/3132175946 learned_addr learned my addr 172.21.15.26:0/3132175946 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180affd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f180c0cb340 0x7f180c15d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180a7fc640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f180c0cc8d0 0x7f180c1f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 -- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f180c0cb340 msgr2=0x7f180c15d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f180c0cb340 0x7f180c15d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 -- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f180c0cc8d0 msgr2=0x7f180c1f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:05.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f180c0cc8d0 0x7f180c1f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 -- 172.21.15.26:0/3132175946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f180c0b33c0 con 0x7f180c154e70 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f180b7fe640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c154e70 0x7f180c1f7a60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f180401b060 tx=0x7f1804019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f17f37fe640 1 -- 172.21.15.26:0/3132175946 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1804009510 con 0x7f180c154e70 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f17f37fe640 1 -- 172.21.15.26:0/3132175946 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18040be070 con 0x7f180c154e70 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f17f37fe640 1 -- 172.21.15.26:0/3132175946 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18040b88b0 con 0x7f180c154e70 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f180c0b3680 con 0x7f180c154e70 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.890+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f180c159a60 con 0x7f180c154e70 2024-04-21T08:58:05.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.894+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f180c074320 con 0x7f180c154e70 2024-04-21T08:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.894+0000 7f17f37fe640 1 -- 172.21.15.26:0/3132175946 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18040b8a50 con 0x7f180c154e70 2024-04-21T08:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.894+0000 7f17f37fe640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f17f8068380 0x7f17f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.894+0000 7f17f37fe640 1 -- 172.21.15.26:0/3132175946 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f1804121a00 con 0x7f180c154e70 2024-04-21T08:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.894+0000 7f180affd640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f17f8068380 0x7f17f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:05.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.894+0000 7f180affd640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f17f8068380 0x7f17f806a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0079c0 tx=0x7f17fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:05.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:05.898+0000 7f17f37fe640 1 -- 172.21.15.26:0/3132175946 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18040165a0 con 0x7f180c154e70 2024-04-21T08:58:06.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f180c165330 con 0x7f180c154e70 2024-04-21T08:58:06.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f17f37fe640 1 -- 172.21.15.26:0/3132175946 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7f18040f19f0 con 0x7f180c154e70 2024-04-21T08:58:06.056 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T08:58:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f17f8068380 msgr2=0x7f17f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f17f8068380 0x7f17f806a840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0079c0 tx=0x7f17fc008040 comp rx=0 tx=0).stop 2024-04-21T08:58:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c154e70 msgr2=0x7f180c1f7a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c154e70 0x7f180c1f7a60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f180401b060 tx=0x7f1804019750 comp rx=0 tx=0).stop 2024-04-21T08:58:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 shutdown_connections 2024-04-21T08:58:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f17f8068380 0x7f17f806a840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f180c154e70 0x7f180c1f7a60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f180c0cc8d0 0x7f180c1f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 --2- 172.21.15.26:0/3132175946 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f180c0cb340 0x7f180c15d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 >> 172.21.15.26:0/3132175946 conn(0x7f180c06de70 msgr2=0x7f180c159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:06.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 shutdown_connections 2024-04-21T08:58:06.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.054+0000 7f18117bf640 1 -- 172.21.15.26:0/3132175946 wait complete. 2024-04-21T08:58:06.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:58:06.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.198+0000 7f5aba016640 1 Processor -- start 2024-04-21T08:58:06.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.198+0000 7f5aba016640 1 -- start start 2024-04-21T08:58:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.198+0000 7f5aba016640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5ab41550a0 0x7f5ab406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.198+0000 7f5aba016640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ab40c81d0 0x7f5ab4072c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.198+0000 7f5aba016640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab40c9120 con 0x7f5ab415b8f0 2024-04-21T08:58:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.198+0000 7f5aba016640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab415bd40 con 0x7f5ab40c81d0 2024-04-21T08:58:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.198+0000 7f5aba016640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab415b460 con 0x7f5ab41550a0 2024-04-21T08:58:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ab40c81d0 0x7f5ab4072c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5ab40c81d0 0x7f5ab4072c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57232/0 (socket says 172.21.15.26:57232) 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 -- 172.21.15.26:0/2620449161 learned_addr learned my addr 172.21.15.26:0/2620449161 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab2ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5ab415b8f0 0x7f5ab4072560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43278/0 (socket says 172.21.15.26:43278) 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab37fe640 1 --2- 172.21.15.26:0/2620449161 >> v2:172.21.15.169:3300/0 conn(0x7f5ab41550a0 0x7f5ab406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 -- 172.21.15.26:0/2620449161 >> v2:172.21.15.169:3300/0 conn(0x7f5ab41550a0 msgr2=0x7f5ab406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 --2- 172.21.15.26:0/2620449161 >> v2:172.21.15.169:3300/0 conn(0x7f5ab41550a0 0x7f5ab406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 -- 172.21.15.26:0/2620449161 >> v1:172.21.15.26:6789/0 conn(0x7f5ab415b8f0 legacy=0x7f5ab4072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 -- 172.21.15.26:0/2620449161 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab40c8b60 con 0x7f5ab40c81d0 2024-04-21T08:58:06.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab27fc640 1 -- 172.21.15.26:0/2620449161 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913137580 0 0) 0x7f5ab40c9120 con 0x7f5ab415b8f0 2024-04-21T08:58:06.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab3fff640 1 --2- 172.21.15.26:0/2620449161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab4072c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ab415b5e0 tx=0x7f5aac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a77b754896beac9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab27fc640 1 -- 172.21.15.26:0/2620449161 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0a57a0 con 0x7f5ab40c81d0 2024-04-21T08:58:06.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab27fc640 1 -- 172.21.15.26:0/2620449161 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aac0a5940 con 0x7f5ab40c81d0 2024-04-21T08:58:06.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5ab27fc640 1 -- 172.21.15.26:0/2620449161 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac0a5d10 con 0x7f5ab40c81d0 2024-04-21T08:58:06.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 -- 172.21.15.26:0/2620449161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 msgr2=0x7f5ab4072c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 --2- 172.21.15.26:0/2620449161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab4072c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5ab415b5e0 tx=0x7f5aac01c9f0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 -- 172.21.15.26:0/2620449161 shutdown_connections 2024-04-21T08:58:06.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 --2- 172.21.15.26:0/2620449161 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab4072c70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 --2- 172.21.15.26:0/2620449161 >> v2:172.21.15.169:3300/0 conn(0x7f5ab41550a0 0x7f5ab406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 -- 172.21.15.26:0/2620449161 >> 172.21.15.26:0/2620449161 conn(0x7f5ab40c9350 msgr2=0x7f5ab40c9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:06.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 -- 172.21.15.26:0/2620449161 shutdown_connections 2024-04-21T08:58:06.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.202+0000 7f5aba016640 1 -- 172.21.15.26:0/2620449161 wait complete. 2024-04-21T08:58:06.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 Processor -- start 2024-04-21T08:58:06.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 -- start start 2024-04-21T08:58:06.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab40bf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab41550a0 0x7f5ab40be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab415b8f0 0x7f5ab40be610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40c0030 con 0x7f5ab40c81d0 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab40c85e0 con 0x7f5ab415b8f0 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab40c01b0 con 0x7f5ab41550a0 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab40bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab40bf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57246/0 (socket says 172.21.15.26:57246) 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 -- 172.21.15.26:0/2703745629 learned_addr learned my addr 172.21.15.26:0/2703745629 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab3fff640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab415b8f0 0x7f5ab40be610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 -- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab41550a0 msgr2=0x7f5ab40be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab41550a0 0x7f5ab40be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 -- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab415b8f0 msgr2=0x7f5ab40be610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab415b8f0 0x7f5ab40be610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 -- 172.21.15.26:0/2703745629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab4149d30 con 0x7f5ab40c81d0 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab3fff640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab415b8f0 0x7f5ab40be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5ab37fe640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab40bf010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400e960 tx=0x7f5aa400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5a9bfff640 1 -- 172.21.15.26:0/2703745629 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4017070 con 0x7f5ab40c81d0 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5a9bfff640 1 -- 172.21.15.26:0/2703745629 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa400ca00 con 0x7f5ab40c81d0 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab40ca7e0 con 0x7f5ab40c81d0 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5a9bfff640 1 -- 172.21.15.26:0/2703745629 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa400cdb0 con 0x7f5ab40c81d0 2024-04-21T08:58:06.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab40cada0 con 0x7f5ab40c81d0 2024-04-21T08:58:06.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.206+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab4075ef0 con 0x7f5ab40c81d0 2024-04-21T08:58:06.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.210+0000 7f5a9bfff640 1 -- 172.21.15.26:0/2703745629 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5aa401a070 con 0x7f5ab40c81d0 2024-04-21T08:58:06.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.210+0000 7f5a9bfff640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5aa0068380 0x7f5aa006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.210+0000 7f5a9bfff640 1 -- 172.21.15.26:0/2703745629 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5aa4086930 con 0x7f5ab40c81d0 2024-04-21T08:58:06.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.210+0000 7f5ab2ffd640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5aa0068380 0x7f5aa006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.210+0000 7f5ab2ffd640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5aa0068380 0x7f5aa006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c10 tx=0x7f5aa80079d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.214+0000 7f5a9bfff640 1 -- 172.21.15.26:0/2703745629 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5aa4056f80 con 0x7f5ab40c81d0 2024-04-21T08:58:06.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.410+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ab41532b0 con 0x7f5ab40c81d0 2024-04-21T08:58:06.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.410+0000 7f5a9bfff640 1 -- 172.21.15.26:0/2703745629 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f5aa4056880 con 0x7f5ab40c81d0 2024-04-21T08:58:06.414 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:06.415 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T08:58:06.415 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T08:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5aa0068380 msgr2=0x7f5aa006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5aa0068380 0x7f5aa006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8000c10 tx=0x7f5aa80079d0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 msgr2=0x7f5ab40bf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab40bf010 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400e960 tx=0x7f5aa400ee20 comp rx=0 tx=0).stop 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 shutdown_connections 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ab415b8f0 0x7f5ab40be610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ab41550a0 0x7f5ab40be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f5aa0068380 0x7f5aa006a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 --2- 172.21.15.26:0/2703745629 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5ab40c81d0 0x7f5ab40bf010 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 >> 172.21.15.26:0/2703745629 conn(0x7f5ab40c9350 msgr2=0x7f5ab4153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 shutdown_connections 2024-04-21T08:58:06.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.414+0000 7f5aba016640 1 -- 172.21.15.26:0/2703745629 wait complete. 2024-04-21T08:58:06.435 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T08:58:06.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f6409640 1 Processor -- start 2024-04-21T08:58:06.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f6409640 1 -- start start 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f6409640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f37f00c5e30 0x7f37f01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f6409640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37f0159600 0x7f37f0157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f6409640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37f015be10 con 0x7f37f015b320 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f6409640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f37f00c4c20 con 0x7f37f0159600 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f6409640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f37f00c4f00 con 0x7f37f00c5e30 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f49a6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37f0159600 0x7f37f0157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37effff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37f015b320 0x7f37f015b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43282/0 (socket says 172.21.15.26:43282) 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37effff640 1 -- 172.21.15.26:0/3032511628 learned_addr learned my addr 172.21.15.26:0/3032511628 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37f49a6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f37f0159600 0x7f37f0157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57258/0 (socket says 172.21.15.26:57258) 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.554+0000 7f37ef7fe640 1 --2- 172.21.15.26:0/3032511628 >> v2:172.21.15.169:3300/0 conn(0x7f37f00c5e30 0x7f37f01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f49a6640 1 -- 172.21.15.26:0/3032511628 >> v2:172.21.15.169:3300/0 conn(0x7f37f00c5e30 msgr2=0x7f37f01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f49a6640 1 --2- 172.21.15.26:0/3032511628 >> v2:172.21.15.169:3300/0 conn(0x7f37f00c5e30 0x7f37f01590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f49a6640 1 -- 172.21.15.26:0/3032511628 >> v1:172.21.15.26:6789/0 conn(0x7f37f015b320 legacy=0x7f37f015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f49a6640 1 -- 172.21.15.26:0/3032511628 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f00c51e0 con 0x7f37f0159600 2024-04-21T08:58:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f49a6640 1 --2- 172.21.15.26:0/3032511628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0159600 0x7f37f0157b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37f0070df0 tx=0x7f37e801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ba4946fd5b480b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37eeffd640 1 -- 172.21.15.26:0/3032511628 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e80b5070 con 0x7f37f0159600 2024-04-21T08:58:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37eeffd640 1 -- 172.21.15.26:0/3032511628 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e80a8970 con 0x7f37f0159600 2024-04-21T08:58:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37eeffd640 1 -- 172.21.15.26:0/3032511628 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e80a8d40 con 0x7f37f0159600 2024-04-21T08:58:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 -- 172.21.15.26:0/3032511628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0159600 msgr2=0x7f37f0157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 --2- 172.21.15.26:0/3032511628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0159600 0x7f37f0157b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37f0070df0 tx=0x7f37e801ec70 comp rx=0 tx=0).stop 2024-04-21T08:58:06.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 -- 172.21.15.26:0/3032511628 shutdown_connections 2024-04-21T08:58:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 --2- 172.21.15.26:0/3032511628 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f0159600 0x7f37f0157b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 --2- 172.21.15.26:0/3032511628 >> v2:172.21.15.169:3300/0 conn(0x7f37f00c5e30 0x7f37f01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 -- 172.21.15.26:0/3032511628 >> 172.21.15.26:0/3032511628 conn(0x7f37f00c8960 msgr2=0x7f37f00c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 -- 172.21.15.26:0/3032511628 shutdown_connections 2024-04-21T08:58:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.558+0000 7f37f6409640 1 -- 172.21.15.26:0/3032511628 wait complete. 2024-04-21T08:58:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 Processor -- start 2024-04-21T08:58:06.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 -- start start 2024-04-21T08:58:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f00c5e30 0x7f37f0150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37f0159600 0x7f37f01f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37f015b320 0x7f37f0073060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f37f0159a10 con 0x7f37f00c5e30 2024-04-21T08:58:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00c57a0 con 0x7f37f015b320 2024-04-21T08:58:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f37f00bfa30 con 0x7f37f0159600 2024-04-21T08:58:06.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f00c5e30 0x7f37f0150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f00c5e30 0x7f37f0150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57272/0 (socket says 172.21.15.26:57272) 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 -- 172.21.15.26:0/2628335520 learned_addr learned my addr 172.21.15.26:0/2628335520 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37ef7fe640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37f0159600 0x7f37f01f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f49a6640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37f015b320 0x7f37f0073060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 -- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37f0159600 msgr2=0x7f37f01f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37f0159600 0x7f37f01f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 -- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37f015b320 msgr2=0x7f37f0073060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37f015b320 0x7f37f0073060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 -- 172.21.15.26:0/2628335520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f00c8230 con 0x7f37f00c5e30 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37effff640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f00c5e30 0x7f37f0150e20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f37e000caa0 tx=0x7f37e000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37ecff9640 1 -- 172.21.15.26:0/2628335520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0017070 con 0x7f37f00c5e30 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37ecff9640 1 -- 172.21.15.26:0/2628335520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e000ac00 con 0x7f37f00c5e30 2024-04-21T08:58:06.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37ecff9640 1 -- 172.21.15.26:0/2628335520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e0012400 con 0x7f37f00c5e30 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f00c8510 con 0x7f37f00c5e30 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f00c71a0 con 0x7f37f00c5e30 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37f0075ef0 con 0x7f37f00c5e30 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.562+0000 7f37ecff9640 1 -- 172.21.15.26:0/2628335520 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f37e001a070 con 0x7f37f00c5e30 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.566+0000 7f37ecff9640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f37dc068380 0x7f37dc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.566+0000 7f37ecff9640 1 -- 172.21.15.26:0/2628335520 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f37e00866e0 con 0x7f37f00c5e30 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.566+0000 7f37ef7fe640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f37dc068380 0x7f37dc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.566+0000 7f37ef7fe640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f37dc068380 0x7f37dc06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37f006fe60 tx=0x7f37e4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.570+0000 7f37ecff9640 1 -- 172.21.15.26:0/2628335520 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f37e0056c90 con 0x7f37f00c5e30 2024-04-21T08:58:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.734+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f37f015b9e0 con 0x7f37f00c5e30 2024-04-21T08:58:06.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.734+0000 7f37ecff9640 1 -- 172.21.15.26:0/2628335520 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16597 (secure 0 0 0) 0x7f37e0056590 con 0x7f37f00c5e30 2024-04-21T08:58:06.737 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:06.737 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":21,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T08:57:45.283091+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T08:58:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f37dc068380 msgr2=0x7f37dc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f37dc068380 0x7f37dc06a840 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37f006fe60 tx=0x7f37e4008040 comp rx=0 tx=0).stop 2024-04-21T08:58:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f00c5e30 msgr2=0x7f37f0150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f00c5e30 0x7f37f0150e20 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f37e000caa0 tx=0x7f37e000cf60 comp rx=0 tx=0).stop 2024-04-21T08:58:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 shutdown_connections 2024-04-21T08:58:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f37f015b320 0x7f37f0073060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f37f0159600 0x7f37f01f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f37dc068380 0x7f37dc06a840 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 --2- 172.21.15.26:0/2628335520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37f00c5e30 0x7f37f0150e20 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 >> 172.21.15.26:0/2628335520 conn(0x7f37f00c8960 msgr2=0x7f37f006d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:06.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 shutdown_connections 2024-04-21T08:58:06.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.738+0000 7f37f6409640 1 -- 172.21.15.26:0/2628335520 wait complete. 2024-04-21T08:58:06.757 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 307377 2024-04-21T08:58:06.757 DEBUG:tasks.quiescer:Yielding 2024-04-21T08:58:06.757 INFO:teuthology.run_tasks:Running task workunit... 2024-04-21T08:58:06.770 INFO:tasks.workunit:Pulling workunits from ref 4f6bc5273643aaf5660909e85400647a8951c10b 2024-04-21T08:58:06.770 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-21T08:58:06.770 INFO:tasks.workunit:timeout=6h 2024-04-21T08:58:06.771 INFO:tasks.workunit:cleanup=True 2024-04-21T08:58:06.771 DEBUG:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-21T08:58:06.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T08:58:06.777 INFO:teuthology.orchestra.run.smithi026.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-21T08:58:06.778 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-21T08:58:06.778 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-21T08:58:06.778 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-21T08:58:06.778 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-21T08:58:06.778 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-21 08:57:49.302065606 +0000 2024-04-21T08:58:06.778 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-21 08:58:00.698171469 +0000 2024-04-21T08:58:06.778 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-21T08:58:06.778 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-21T08:58:06.778 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-21T08:58:06.838 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/leonid-s-usov/ceph-ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4f6bc5273643aaf5660909e85400647a8951c10b 2024-04-21T08:58:06.884 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-21T08:58:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.890+0000 7f52961d1640 1 Processor -- start 2024-04-21T08:58:06.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.890+0000 7f52961d1640 1 -- start start 2024-04-21T08:58:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f529015e720 0x7f52900ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52900b1940 0x7f529015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f52900c8400 0x7f52900c9030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f52900c7930 con 0x7f52900b1940 2024-04-21T08:58:06.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f529015f1f0 con 0x7f52900c8400 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f52900c7b80 con 0x7f529015e720 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52900b1940 0x7f529015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f52900b1940 0x7f529015eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57282/0 (socket says 172.21.15.26:57282) 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 -- 172.21.15.26:0/3114664669 learned_addr learned my addr 172.21.15.26:0/3114664669 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528f7fe640 1 --2- 172.21.15.26:0/3114664669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f529015e720 0x7f52900ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528ffff640 1 --2- 172.21.15.26:0/3114664669 >> v2:172.21.15.169:3300/0 conn(0x7f52900c8400 0x7f52900c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 -- 172.21.15.26:0/3114664669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f529015e720 msgr2=0x7f52900ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 --2- 172.21.15.26:0/3114664669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f529015e720 0x7f52900ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 -- 172.21.15.26:0/3114664669 >> v2:172.21.15.169:3300/0 conn(0x7f52900c8400 msgr2=0x7f52900c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 --2- 172.21.15.26:0/3114664669 >> v2:172.21.15.169:3300/0 conn(0x7f52900c8400 0x7f52900c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 -- 172.21.15.26:0/3114664669 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52900c7e60 con 0x7f52900b1940 2024-04-21T08:58:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528effd640 1 --2- 172.21.15.26:0/3114664669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900b1940 0x7f529015eb00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52900700d0 tx=0x7f528401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb988ef3cb6a386 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528e7fc640 1 -- 172.21.15.26:0/3114664669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840b0070 con 0x7f52900b1940 2024-04-21T08:58:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528e7fc640 1 -- 172.21.15.26:0/3114664669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52840ab600 con 0x7f52900b1940 2024-04-21T08:58:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f528e7fc640 1 -- 172.21.15.26:0/3114664669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840ab9d0 con 0x7f52900b1940 2024-04-21T08:58:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 -- 172.21.15.26:0/3114664669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900b1940 msgr2=0x7f529015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 --2- 172.21.15.26:0/3114664669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900b1940 0x7f529015eb00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52900700d0 tx=0x7f528401c490 comp rx=0 tx=0).stop 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 -- 172.21.15.26:0/3114664669 shutdown_connections 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 --2- 172.21.15.26:0/3114664669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900b1940 0x7f529015eb00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 --2- 172.21.15.26:0/3114664669 >> v2:172.21.15.169:3300/0 conn(0x7f52900c8400 0x7f52900c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 --2- 172.21.15.26:0/3114664669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f529015e720 0x7f52900ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 -- 172.21.15.26:0/3114664669 >> 172.21.15.26:0/3114664669 conn(0x7f52900c9b50 msgr2=0x7f52900c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.894+0000 7f52961d1640 1 -- 172.21.15.26:0/3114664669 shutdown_connections 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 -- 172.21.15.26:0/3114664669 wait complete. 2024-04-21T08:58:06.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 Processor -- start 2024-04-21T08:58:06.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 -- start start 2024-04-21T08:58:06.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52900b1940 0x7f52900733c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900c8400 0x7f5290072800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f529015e720 0x7f5290154890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f529015b760 con 0x7f52900c8400 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f52900c9980 con 0x7f529015e720 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f529015b8e0 con 0x7f52900b1940 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900c8400 0x7f5290072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900c8400 0x7f5290072800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57290/0 (socket says 172.21.15.26:57290) 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 -- 172.21.15.26:0/3611998034 learned_addr learned my addr 172.21.15.26:0/3611998034 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528f7fe640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52900b1940 0x7f52900733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528ffff640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f529015e720 0x7f5290154890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 -- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52900b1940 msgr2=0x7f52900733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52900b1940 0x7f52900733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 -- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f529015e720 msgr2=0x7f5290154890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f529015e720 0x7f5290154890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 -- 172.21.15.26:0/3611998034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52900aefa0 con 0x7f52900c8400 2024-04-21T08:58:06.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f528effd640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900c8400 0x7f5290072800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f52840ae040 tx=0x7f529015bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f5277fff640 1 -- 172.21.15.26:0/3611998034 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840b0040 con 0x7f52900c8400 2024-04-21T08:58:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f5277fff640 1 -- 172.21.15.26:0/3611998034 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52840b4420 con 0x7f52900c8400 2024-04-21T08:58:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52900c07a0 con 0x7f52900c8400 2024-04-21T08:58:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f5277fff640 1 -- 172.21.15.26:0/3611998034 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52840b4810 con 0x7f52900c8400 2024-04-21T08:58:06.903 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.898+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52901537f0 con 0x7f52900c8400 2024-04-21T08:58:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.902+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5290075ef0 con 0x7f52900c8400 2024-04-21T08:58:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.902+0000 7f5277fff640 1 -- 172.21.15.26:0/3611998034 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f52840b49b0 con 0x7f52900c8400 2024-04-21T08:58:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.902+0000 7f5277fff640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f527c068380 0x7f527c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.902+0000 7f5277fff640 1 -- 172.21.15.26:0/3611998034 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5284120420 con 0x7f52900c8400 2024-04-21T08:58:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.902+0000 7f528f7fe640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f527c068380 0x7f527c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:06.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.902+0000 7f528f7fe640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f527c068380 0x7f527c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f528000d8d0 tx=0x7f5280008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:06.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:06.906+0000 7f5277fff640 1 -- 172.21.15.26:0/3611998034 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5284016110 con 0x7f52900c8400 2024-04-21T08:58:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5290073a00 con 0x7f52900c8400 2024-04-21T08:58:07.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f5277fff640 1 -- 172.21.15.26:0/3611998034 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f52840f0b90 con 0x7f52900c8400 2024-04-21T08:58:07.107 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T08:58:07.108 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T08:58:07.108 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f527c068380 msgr2=0x7f527c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f527c068380 0x7f527c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f528000d8d0 tx=0x7f5280008040 comp rx=0 tx=0).stop 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900c8400 msgr2=0x7f5290072800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900c8400 0x7f5290072800 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f52840ae040 tx=0x7f529015bf60 comp rx=0 tx=0).stop 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 shutdown_connections 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f529015e720 0x7f5290154890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f527c068380 0x7f527c06a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f52900c8400 0x7f5290072800 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 --2- 172.21.15.26:0/3611998034 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52900b1940 0x7f52900733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 >> 172.21.15.26:0/3611998034 conn(0x7f52900c9b50 msgr2=0x7f529015ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 shutdown_connections 2024-04-21T08:58:07.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.106+0000 7f52961d1640 1 -- 172.21.15.26:0/3611998034 wait complete. 2024-04-21T08:58:07.731 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-21T08:57:43.594557+0000', 'modified': '2024-04-21T08:57:50.320200+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.169:6839/4294502436', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6837', 'nonce': 4294502436}, {'type': 'v1', 'addr': '172.21.15.169:6839', 'nonce': 4294502436}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4279, 'qdb_cluster': [4279]} 2024-04-21T08:58:07.732 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-21T08:58:07.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-21T08:58:07.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec7796640 1 Processor -- start 2024-04-21T08:58:07.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec7796640 1 -- start start 2024-04-21T08:58:07.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec7796640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ec0151bc0 0x7f2ec0072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec7796640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec00c5e30 0x7f2ec00732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec7796640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec00bfbb0 con 0x7f2ec0151fa0 2024-04-21T08:58:07.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec7796640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec006d1b0 con 0x7f2ec0151bc0 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec7796640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec006ced0 con 0x7f2ec00c5e30 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5532640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ec0151bc0 0x7f2ec0072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5532640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2ec0151bc0 0x7f2ec0072d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54206/0 (socket says 172.21.15.26:54206) 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5532640 1 -- 172.21.15.26:0/572874582 learned_addr learned my addr 172.21.15.26:0/572874582 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/572874582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec00c5e30 0x7f2ec00732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5532640 1 -- 172.21.15.26:0/572874582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec00c5e30 msgr2=0x7f2ec00732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5532640 1 --2- 172.21.15.26:0/572874582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec00c5e30 0x7f2ec00732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5532640 1 -- 172.21.15.26:0/572874582 >> v1:172.21.15.169:6789/0 conn(0x7f2ec0151fa0 legacy=0x7f2ec0157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5532640 1 -- 172.21.15.26:0/572874582 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec0071fd0 con 0x7f2ec0151bc0 2024-04-21T08:58:07.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.866+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/572874582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec00c5e30 0x7f2ec00732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec5532640 1 --2- 172.21.15.26:0/572874582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec0072d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0074260 tx=0x7f2ebc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc687183e84b3133 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2eb7fff640 1 -- 172.21.15.26:0/572874582 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0aa600 con 0x7f2ec0151bc0 2024-04-21T08:58:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2eb7fff640 1 -- 172.21.15.26:0/572874582 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0af070 con 0x7f2ec0151bc0 2024-04-21T08:58:07.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2eb7fff640 1 -- 172.21.15.26:0/572874582 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0aa9c0 con 0x7f2ec0151bc0 2024-04-21T08:58:07.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 -- 172.21.15.26:0/572874582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 msgr2=0x7f2ec0072d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 --2- 172.21.15.26:0/572874582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec0072d90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2ec0074260 tx=0x7f2ebc01c4e0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 -- 172.21.15.26:0/572874582 shutdown_connections 2024-04-21T08:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 --2- 172.21.15.26:0/572874582 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec00c5e30 0x7f2ec00732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 --2- 172.21.15.26:0/572874582 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec0072d90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 -- 172.21.15.26:0/572874582 >> 172.21.15.26:0/572874582 conn(0x7f2ec00cbef0 msgr2=0x7f2ec00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 -- 172.21.15.26:0/572874582 shutdown_connections 2024-04-21T08:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.870+0000 7f2ec7796640 1 -- 172.21.15.26:0/572874582 wait complete. 2024-04-21T08:58:07.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 Processor -- start 2024-04-21T08:58:07.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 -- start start 2024-04-21T08:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ec00c5e30 0x7f2ec0155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec0151fa0 0x7f2ec01475b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec006cc80 con 0x7f2ec0151bc0 2024-04-21T08:58:07.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec006cb00 con 0x7f2ec00c5e30 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec0164320 con 0x7f2ec0151fa0 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec014b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54216/0 (socket says 172.21.15.26:54216) 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 -- 172.21.15.26:0/1665105469 learned_addr learned my addr 172.21.15.26:0/1665105469 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec5532640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ec00c5e30 0x7f2ec0155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec0151fa0 0x7f2ec01475b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 -- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec0151fa0 msgr2=0x7f2ec01475b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec0151fa0 0x7f2ec01475b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 -- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ec00c5e30 msgr2=0x7f2ec0155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ec00c5e30 0x7f2ec0155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 -- 172.21.15.26:0/1665105469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec0147e40 con 0x7f2ec0151bc0 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec014b4f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b440 tx=0x7f2eb000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:07.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2eb5ffb640 1 -- 172.21.15.26:0/1665105469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0015020 con 0x7f2ec0151bc0 2024-04-21T08:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2eb5ffb640 1 -- 172.21.15.26:0/1665105469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb0011890 con 0x7f2ec0151bc0 2024-04-21T08:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec0148120 con 0x7f2ec0151bc0 2024-04-21T08:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2eb5ffb640 1 -- 172.21.15.26:0/1665105469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0011c80 con 0x7f2ec0151bc0 2024-04-21T08:58:07.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec01486e0 con 0x7f2ec0151bc0 2024-04-21T08:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2eb5ffb640 1 -- 172.21.15.26:0/1665105469 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2eb0018020 con 0x7f2ec0151bc0 2024-04-21T08:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.874+0000 7f2eb5ffb640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2ea4068380 0x7f2ea406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eb5ffb640 1 -- 172.21.15.26:0/1665105469 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2eb00866e0 con 0x7f2ec0151bc0 2024-04-21T08:58:07.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2ea4068380 0x7f2ea406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 Processor -- start 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 -- start start 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2ea4068380 0x7f2ea406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0ae000 tx=0x7f2ebc0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b721d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b7258080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b72589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b1b7066420 con 0x55b1b721d190 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b1b7000bf0 con 0x55b1b72585c0 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55b1b70623e0 con 0x55b1b721dab0 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b721d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b721d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54226/0 (socket says 172.21.15.26:54226) 2024-04-21T08:58:07.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 -- 172.21.15.26:0/3731565441 learned_addr learned my addr 172.21.15.26:0/3731565441 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b7258080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b72589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 -- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 msgr2=0x55b1b7258080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b7258080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 -- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 msgr2=0x55b1b72589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b72589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 -- 172.21.15.26:0/3731565441 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1b710e450 con 0x55b1b721d190 2024-04-21T08:58:07.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2ec5532640 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b721d570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01cd80 tx=0x7f2ebc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e282d3f46c4f371 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eaaffd640 1 -- 172.21.15.26:0/3731565441 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0c8630 con 0x55b1b721d190 2024-04-21T08:58:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eaaffd640 1 -- 172.21.15.26:0/3731565441 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0af040 con 0x55b1b721d190 2024-04-21T08:58:07.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.878+0000 7f2eaaffd640 1 -- 172.21.15.26:0/3731565441 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0c89d0 con 0x55b1b721d190 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/3731565441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 msgr2=0x55b1b721d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b721d570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01cd80 tx=0x7f2ebc004740 comp rx=0 tx=0).stop 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/3731565441 shutdown_connections 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b72589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b7258080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- 172.21.15.26:0/3731565441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b721d570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/3731565441 >> 172.21.15.26:0/3731565441 conn(0x55b1b7254e40 msgr2=0x55b1b7257260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/3731565441 shutdown_connections 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/3731565441 wait complete. 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- start start 2024-04-21T08:58:07.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 Processor -- start 2024-04-21T08:58:07.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b721d190 0x55b1b7219bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721dab0 0x55b1b721a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b72585c0 0x55b1b721a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b1b7006ec0 con 0x55b1b721dab0 2024-04-21T08:58:07.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b1b70e7120 con 0x55b1b721d190 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55b1b7071350 con 0x55b1b72585c0 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 10 client.0 _ll_register_callbacks cb 0x55b1b70434d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721dab0 0x55b1b721a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721dab0 0x55b1b721a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54228/0 (socket says 172.21.15.26:54228) 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 -- 172.21.15.26:0/2730294370 learned_addr learned my addr 172.21.15.26:0/2730294370 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec5532640 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b721d190 0x55b1b7219bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b72585c0 0x55b1b721a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 -- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b72585c0 msgr2=0x55b1b721a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b72585c0 0x55b1b721a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 -- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b721d190 msgr2=0x55b1b7219bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b721d190 0x55b1b7219bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 -- 172.21.15.26:0/2730294370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1b70abf80 con 0x55b1b721dab0 2024-04-21T08:58:07.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721dab0 0x55b1b721a110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2eb005ece0 tx=0x7f2eb0056d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a377e7ff1c634194 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2e9ffff640 1 -- 172.21.15.26:0/2730294370 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0083060 con 0x55b1b721dab0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2e9ffff640 1 -- 172.21.15.26:0/2730294370 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2eb005bd70 con 0x55b1b721dab0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ebc0af040 con 0x55b1b721dab0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2e9ffff640 1 -- 172.21.15.26:0/2730294370 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f2eb0073050 con 0x55b1b721dab0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 10 client.4797 fetch_fsmap learned FSMap version 8 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55b1b703ff00 con 0x55b1b721dab0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2e9ffff640 1 -- 172.21.15.26:0/2730294370 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0af040 con 0x55b1b721dab0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2e9ffff640 1 -- 172.21.15.26:0/2730294370 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f2eb0055a80 con 0x55b1b721dab0 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 10 client.4797 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 10 client.4797 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 20 client.4797 populate_metadata read hostname 'smithi026' 2024-04-21T08:58:07.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b726cd90 0x55b1b726f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 4 client.4797 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T08:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b1b6fffbc0 con 0x55b1b726cd90 2024-04-21T08:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.882+0000 7f2ec5532640 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b726cd90 0x55b1b726f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2ec5532640 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b726cd90 0x55b1b726f180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7dfec356499b83fd server_cookie=bfc9f9884b15cce0 in_seq=0 out_seq=0 2024-04-21T08:58:07.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2e9ffff640 10 client.4797 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2e9ffff640 1 -- 172.21.15.26:0/2730294370 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b1b6fffbc0 con 0x55b1b726cd90 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2e9ffff640 10 client.4797 handle_command_reply: tid=0 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 client.4797 shutdown 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721dab0 msgr2=0x55b1b721a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721dab0 0x55b1b721a110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2eb005ece0 tx=0x7f2eb0056d30 comp rx=0 tx=0).stop 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 shutdown_connections 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b726cd90 0x55b1b726f180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b72585c0 0x55b1b721a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721dab0 0x55b1b721a110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 --2- 172.21.15.26:0/2730294370 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b721d190 0x55b1b7219bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 >> 172.21.15.26:0/2730294370 conn(0x55b1b7254e40 msgr2=0x55b1b72561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2e9ffff640 0 client.4797 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T08:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 shutdown_connections 2024-04-21T08:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 1 -- 172.21.15.26:0/2730294370 wait complete. 2024-04-21T08:58:07.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.886+0000 7f2eca918000 20 client.4797 trim_cache size 0 max 16384 2024-04-21T08:58:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 Processor -- start 2024-04-21T08:58:07.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- start start 2024-04-21T08:58:07.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b7252e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b72533d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b726f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec01fd140 con 0x55b1b721d190 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec01f5000 con 0x55b1b72585c0 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec01f5650 con 0x55b1b721dab0 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b7252e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b7252e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54242/0 (socket says 172.21.15.26:54242) 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 -- 172.21.15.26:0/482511203 learned_addr learned my addr 172.21.15.26:0/482511203 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b72533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b726f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 -- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 msgr2=0x55b1b72533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b72533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 -- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 msgr2=0x55b1b726f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b726f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 -- 172.21.15.26:0/482511203 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1b6fece80 con 0x55b1b721d190 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b726f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2ec5532640 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b7252e90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01ab90 tx=0x7f2ebc0b5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0ee18ae3b9af6a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eaa7fc640 1 -- 172.21.15.26:0/482511203 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0cd040 con 0x55b1b721d190 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eaa7fc640 1 -- 172.21.15.26:0/482511203 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0af040 con 0x55b1b721d190 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eaa7fc640 1 -- 172.21.15.26:0/482511203 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0c8bf0 con 0x55b1b721d190 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- 172.21.15.26:0/482511203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 msgr2=0x55b1b7252e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b7252e90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01ab90 tx=0x7f2ebc0b5040 comp rx=0 tx=0).stop 2024-04-21T08:58:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- 172.21.15.26:0/482511203 shutdown_connections 2024-04-21T08:58:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b726f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b72533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 --2- 172.21.15.26:0/482511203 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b7252e90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- 172.21.15.26:0/482511203 >> 172.21.15.26:0/482511203 conn(0x55b1b7254e40 msgr2=0x55b1b7216cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- 172.21.15.26:0/482511203 shutdown_connections 2024-04-21T08:58:07.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- 172.21.15.26:0/482511203 wait complete. 2024-04-21T08:58:07.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.906+0000 7f2eca918000 1 -- start start 2024-04-21T08:58:07.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 Processor -- start 2024-04-21T08:58:07.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b72718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b728dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b728e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b1b7065730 con 0x55b1b721d190 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55b1b70329e0 con 0x55b1b72585c0 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55b1b706aa50 con 0x55b1b721dab0 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 10 client.0 _ll_register_callbacks cb 0x7f2eb0056400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b72718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b72718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54252/0 (socket says 172.21.15.26:54252) 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 -- 172.21.15.26:0/536705044 learned_addr learned my addr 172.21.15.26:0/536705044 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5d33640 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b728e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b728dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 -- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 msgr2=0x55b1b728dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b728dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 -- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 msgr2=0x55b1b728e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b728e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 -- 172.21.15.26:0/536705044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1b702eb30 con 0x55b1b721d190 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec5532640 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b72718a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01ab90 tx=0x7f2ebc01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ded5f749e77ddc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 1 -- 172.21.15.26:0/536705044 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0c87f0 con 0x55b1b721d190 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 1 -- 172.21.15.26:0/536705044 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2ebc0c8990 con 0x55b1b721d190 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ebc0af040 con 0x55b1b721d190 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 1 -- 172.21.15.26:0/536705044 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f2ebc0c8b90 con 0x55b1b721d190 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 10 client.4803 fetch_fsmap learned FSMap version 8 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55b1b70e75b0 con 0x55b1b721d190 2024-04-21T08:58:07.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 1 -- 172.21.15.26:0/536705044 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0af040 con 0x55b1b721d190 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 1 -- 172.21.15.26:0/536705044 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f2ebc0d7020 con 0x55b1b721d190 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 10 client.4803 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 10 client.4803 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 20 client.4803 populate_metadata read hostname 'smithi026' 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b72cd170 0x55b1b72cd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 4 client.4803 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "status"}) -- 0x55b1b7073e40 con 0x55b1b72cd170 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b72cd170 0x55b1b72cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 10 client.4803 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2ec4d31640 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b72cd170 0x55b1b72cd550 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=162f2eb98e8cc687 server_cookie=2a391f00ef6127e6 in_seq=0 out_seq=0 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 1 -- 172.21.15.26:0/536705044 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55b1b7073e40 con 0x55b1b72cd170 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 10 client.4803 handle_command_reply: tid=0 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 client.4803 shutdown 2024-04-21T08:58:07.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 msgr2=0x55b1b72718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b72718a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc01ab90 tx=0x7f2ebc01ad20 comp rx=0 tx=0).stop 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 shutdown_connections 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55b1b72cd170 0x55b1b72cd550 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55b1b72585c0 0x55b1b728e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55b1b721dab0 0x55b1b728dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 --2- 172.21.15.26:0/536705044 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b1b721d190 0x55b1b72718a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 >> 172.21.15.26:0/536705044 conn(0x55b1b7254e40 msgr2=0x55b1b7252600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2e9ffff640 0 client.4803 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 shutdown_connections 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.910+0000 7f2eca918000 1 -- 172.21.15.26:0/536705044 wait complete. 2024-04-21T08:58:07.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2eca918000 20 client.4803 trim_cache size 0 max 16384 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "c3cab1f1-d502-48e1-871b-caee77004426", 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4279, 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 23.615309363000001, 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 8, 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 21, 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 21, 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 30.509031078 2024-04-21T08:58:07.921 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T08:58:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2ea4068380 msgr2=0x7f2ea406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2ea4068380 0x7f2ea406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0ae000 tx=0x7f2ebc0a7000 comp rx=0 tx=0).stop 2024-04-21T08:58:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 msgr2=0x7f2ec014b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T08:58:07.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec014b4f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b440 tx=0x7f2eb000b900 comp rx=0 tx=0).stop 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 shutdown_connections 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2ec0151fa0 0x7f2ec01475b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f2ea4068380 0x7f2ea406a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2ec0151bc0 0x7f2ec014b4f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 --2- 172.21.15.26:0/1665105469 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2ec00c5e30 0x7f2ec0155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 >> 172.21.15.26:0/1665105469 conn(0x7f2ec00cbef0 msgr2=0x7f2ec0154690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 shutdown_connections 2024-04-21T08:58:07.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T08:58:07.914+0000 7f2ec7796640 1 -- 172.21.15.26:0/1665105469 wait complete. 2024-04-21T08:58:07.932 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 120 sec 2024-04-21T08:58:21.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:21.699 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:44.512 INFO:tasks.workunit.client.0.smithi026.stderr:Note: switching to '4f6bc5273643aaf5660909e85400647a8951c10b'. 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by switching back to a branch. 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr: git switch -c 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr:Or undo this operation with: 2024-04-21T08:58:44.513 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T08:58:44.514 INFO:tasks.workunit.client.0.smithi026.stderr: git switch - 2024-04-21T08:58:44.514 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T08:58:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-21T08:58:44.514 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T08:58:44.514 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at 4f6bc527364 use ubuntu for fs/workload tests 2024-04-21T08:58:44.517 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-21T08:58:44.523 INFO:tasks.workunit.client.0.smithi026.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-21T08:58:44.527 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-21T08:58:44.527 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-21T08:58:45.295 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-21T08:58:45.381 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-21T08:58:45.442 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-21T08:58:45.444 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-21T08:58:45.444 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-21T08:58:45.491 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-21T08:58:45.495 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T08:58:45.495 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-21T08:58:45.543 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2024-04-21T08:58:45.544 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2024-04-21T08:58:45.544 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-04-21T08:58:45.608 INFO:tasks.workunit.client.0.smithi026.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-04-21T08:58:51.864 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:51.868 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:58:52.669 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir foo 2024-04-21T08:58:52.687 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 foo 2024-04-21T08:58:53.713 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir foo/.snap/barsnap 2024-04-21T08:58:53.740 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm foo/linux-2.6.33.tar.bz2 2024-04-21T08:58:53.770 INFO:tasks.workunit.client.0.smithi026.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2024-04-21T08:58:53.931 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo passed: files are identical 2024-04-21T08:58:53.931 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir foo/.snap/barsnap 2024-04-21T08:58:53.932 INFO:tasks.workunit.client.0.smithi026.stdout:passed: files are identical 2024-04-21T08:58:53.973 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T08:58:53.974 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T08:58:53.974 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T08:58:53.974 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T08:58:54.032 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2024-04-21T08:58:54.033 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-04-21T08:58:54.051 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 1 2024-04-21T08:58:54.055 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 2 2024-04-21T08:58:54.058 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 3 2024-04-21T08:58:54.061 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' -e file4 ']' 2024-04-21T08:58:54.062 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/snap1 2024-04-21T08:58:54.084 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 4 2024-04-21T08:58:54.089 INFO:tasks.workunit.client.0.smithi026.stderr:++ ls 2024-04-21T08:58:54.100 INFO:tasks.workunit.client.0.smithi026.stderr:+ now='file1 2024-04-21T08:58:54.100 INFO:tasks.workunit.client.0.smithi026.stderr:file2 2024-04-21T08:58:54.100 INFO:tasks.workunit.client.0.smithi026.stderr:file3 2024-04-21T08:58:54.101 INFO:tasks.workunit.client.0.smithi026.stderr:file4' 2024-04-21T08:58:54.101 INFO:tasks.workunit.client.0.smithi026.stderr:++ ls .snap/snap1 2024-04-21T08:58:54.113 INFO:tasks.workunit.client.0.smithi026.stderr:+ then='file1 2024-04-21T08:58:54.113 INFO:tasks.workunit.client.0.smithi026.stderr:file2 2024-04-21T08:58:54.113 INFO:tasks.workunit.client.0.smithi026.stderr:file3' 2024-04-21T08:58:54.113 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/snap1 2024-04-21T08:58:54.141 INFO:tasks.workunit.client.0.smithi026.stderr:+ '[' 'file1 2024-04-21T08:58:54.141 INFO:tasks.workunit.client.0.smithi026.stderr:file2 2024-04-21T08:58:54.142 INFO:tasks.workunit.client.0.smithi026.stderr:file3 2024-04-21T08:58:54.142 INFO:tasks.workunit.client.0.smithi026.stderr:file4' = 'file1 2024-04-21T08:58:54.142 INFO:tasks.workunit.client.0.smithi026.stderr:file2 2024-04-21T08:58:54.142 INFO:tasks.workunit.client.0.smithi026.stderr:file3' ']' 2024-04-21T08:58:54.142 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 1 2024-04-21T08:58:54.153 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 2 2024-04-21T08:58:54.165 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 3 2024-04-21T08:58:54.177 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/snap1 2024-04-21T08:58:54.192 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 4 2024-04-21T08:58:54.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/snap1 2024-04-21T08:58:54.227 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm file1 file2 file3 file4 2024-04-21T08:58:54.245 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T08:58:54.246 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T08:58:54.246 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T08:58:54.246 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T08:58:54.321 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2024-04-21T08:58:54.321 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-04-21T08:58:54.385 INFO:tasks.workunit.client.0.smithi026.stdout:Create dir 100 to 199 ... 2024-04-21T08:58:54.387 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 100 2024-04-21T08:58:54.431 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 101 2024-04-21T08:58:54.472 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 102 2024-04-21T08:58:54.516 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 103 2024-04-21T08:58:54.560 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 104 2024-04-21T08:58:54.605 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 105 2024-04-21T08:58:54.653 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 106 2024-04-21T08:58:54.708 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 107 2024-04-21T08:58:54.758 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 108 2024-04-21T08:58:54.811 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 109 2024-04-21T08:58:54.858 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 110 2024-04-21T08:58:54.898 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 111 2024-04-21T08:58:54.944 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 112 2024-04-21T08:58:54.986 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 113 2024-04-21T08:58:55.030 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 114 2024-04-21T08:58:55.077 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 115 2024-04-21T08:58:55.115 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 116 2024-04-21T08:58:55.160 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 117 2024-04-21T08:58:55.207 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 118 2024-04-21T08:58:55.248 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 119 2024-04-21T08:58:55.294 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 120 2024-04-21T08:58:55.340 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 121 2024-04-21T08:58:55.391 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 122 2024-04-21T08:58:55.441 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 123 2024-04-21T08:58:55.472 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 124 2024-04-21T08:58:55.502 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 125 2024-04-21T08:58:55.531 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 126 2024-04-21T08:58:55.580 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 127 2024-04-21T08:58:55.607 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 128 2024-04-21T08:58:55.629 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 129 2024-04-21T08:58:55.654 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 130 2024-04-21T08:58:55.679 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 131 2024-04-21T08:58:55.706 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 132 2024-04-21T08:58:55.734 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 133 2024-04-21T08:58:55.761 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 134 2024-04-21T08:58:55.793 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 135 2024-04-21T08:58:55.826 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 136 2024-04-21T08:58:55.859 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 137 2024-04-21T08:58:55.897 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 138 2024-04-21T08:58:55.937 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 139 2024-04-21T08:58:55.976 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 140 2024-04-21T08:58:56.012 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 141 2024-04-21T08:58:56.049 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 142 2024-04-21T08:58:56.085 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 143 2024-04-21T08:58:56.126 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 144 2024-04-21T08:58:56.171 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 145 2024-04-21T08:58:56.217 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 146 2024-04-21T08:58:56.251 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 147 2024-04-21T08:58:56.290 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 148 2024-04-21T08:58:56.328 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 149 2024-04-21T08:58:56.363 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 150 2024-04-21T08:58:56.394 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 151 2024-04-21T08:58:56.426 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 152 2024-04-21T08:58:56.461 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 153 2024-04-21T08:58:56.501 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 154 2024-04-21T08:58:56.539 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 155 2024-04-21T08:58:56.587 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 156 2024-04-21T08:58:56.627 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 157 2024-04-21T08:58:56.666 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 158 2024-04-21T08:58:56.706 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 159 2024-04-21T08:58:56.746 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 160 2024-04-21T08:58:56.786 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 161 2024-04-21T08:58:56.827 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 162 2024-04-21T08:58:56.870 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 163 2024-04-21T08:58:56.910 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 164 2024-04-21T08:58:56.948 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 165 2024-04-21T08:58:56.987 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 166 2024-04-21T08:58:57.025 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 167 2024-04-21T08:58:57.060 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 168 2024-04-21T08:58:57.102 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 169 2024-04-21T08:58:57.147 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 170 2024-04-21T08:58:57.189 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 171 2024-04-21T08:58:57.233 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 172 2024-04-21T08:58:57.278 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 173 2024-04-21T08:58:57.317 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 174 2024-04-21T08:58:57.355 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 175 2024-04-21T08:58:57.392 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 176 2024-04-21T08:58:57.432 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 177 2024-04-21T08:58:57.472 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 178 2024-04-21T08:58:57.512 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 179 2024-04-21T08:58:57.545 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 180 2024-04-21T08:58:57.580 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 181 2024-04-21T08:58:57.613 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 182 2024-04-21T08:58:57.937 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 183 2024-04-21T08:58:57.983 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 184 2024-04-21T08:58:58.028 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 185 2024-04-21T08:58:58.068 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 186 2024-04-21T08:58:58.113 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 187 2024-04-21T08:58:58.167 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 188 2024-04-21T08:58:58.211 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 189 2024-04-21T08:58:58.254 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 190 2024-04-21T08:58:58.296 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 191 2024-04-21T08:58:58.342 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 192 2024-04-21T08:58:58.391 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 193 2024-04-21T08:58:58.429 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 194 2024-04-21T08:58:58.467 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 195 2024-04-21T08:58:58.505 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 196 2024-04-21T08:58:58.541 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 197 2024-04-21T08:58:58.577 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 198 2024-04-21T08:58:58.613 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 199 2024-04-21T08:58:58.651 INFO:tasks.workunit.client.0.smithi026.stdout:Take first snapshot .snap/test1 2024-04-21T08:58:58.823 INFO:tasks.workunit.client.0.smithi026.stdout:Create dir 200 to 299 ... 2024-04-21T08:58:58.824 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 200 2024-04-21T08:58:59.219 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 201 2024-04-21T08:58:59.253 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 202 2024-04-21T08:58:59.283 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 203 2024-04-21T08:58:59.313 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 204 2024-04-21T08:58:59.341 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 205 2024-04-21T08:58:59.376 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 206 2024-04-21T08:58:59.411 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 207 2024-04-21T08:58:59.443 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 208 2024-04-21T08:58:59.480 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 209 2024-04-21T08:58:59.516 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 210 2024-04-21T08:58:59.557 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 211 2024-04-21T08:58:59.595 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 212 2024-04-21T08:58:59.633 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 213 2024-04-21T08:58:59.674 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 214 2024-04-21T08:58:59.717 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 215 2024-04-21T08:58:59.761 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 216 2024-04-21T08:58:59.803 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 217 2024-04-21T08:58:59.844 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 218 2024-04-21T08:58:59.886 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 219 2024-04-21T08:58:59.929 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 220 2024-04-21T08:58:59.969 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 221 2024-04-21T08:59:00.006 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 222 2024-04-21T08:59:00.049 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 223 2024-04-21T08:59:00.088 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 224 2024-04-21T08:59:00.118 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 225 2024-04-21T08:59:00.150 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 226 2024-04-21T08:59:00.282 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 227 2024-04-21T08:59:00.320 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 228 2024-04-21T08:59:00.362 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 229 2024-04-21T08:59:00.625 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 230 2024-04-21T08:59:00.667 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 231 2024-04-21T08:59:00.716 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 232 2024-04-21T08:59:00.761 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 233 2024-04-21T08:59:00.802 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 234 2024-04-21T08:59:00.843 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 235 2024-04-21T08:59:00.886 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 236 2024-04-21T08:59:00.926 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 237 2024-04-21T08:59:00.965 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 238 2024-04-21T08:59:01.009 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 239 2024-04-21T08:59:01.053 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 240 2024-04-21T08:59:01.090 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 241 2024-04-21T08:59:01.127 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 242 2024-04-21T08:59:01.166 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 243 2024-04-21T08:59:01.386 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 244 2024-04-21T08:59:01.421 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 245 2024-04-21T08:59:01.458 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 246 2024-04-21T08:59:01.493 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 247 2024-04-21T08:59:01.530 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 248 2024-04-21T08:59:01.572 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 249 2024-04-21T08:59:01.611 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 250 2024-04-21T08:59:01.652 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 251 2024-04-21T08:59:03.542 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 252 2024-04-21T08:59:03.588 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 253 2024-04-21T08:59:03.634 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 254 2024-04-21T08:59:03.681 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 255 2024-04-21T08:59:03.724 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 256 2024-04-21T08:59:03.767 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 257 2024-04-21T08:59:03.807 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 258 2024-04-21T08:59:03.851 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 259 2024-04-21T08:59:03.894 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 260 2024-04-21T08:59:03.940 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 261 2024-04-21T08:59:03.982 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 262 2024-04-21T08:59:04.023 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 263 2024-04-21T08:59:04.064 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 264 2024-04-21T08:59:04.104 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 265 2024-04-21T08:59:04.145 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 266 2024-04-21T08:59:04.192 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 267 2024-04-21T08:59:04.230 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 268 2024-04-21T08:59:04.384 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 269 2024-04-21T08:59:04.426 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 270 2024-04-21T08:59:04.474 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 271 2024-04-21T08:59:04.522 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 272 2024-04-21T08:59:04.565 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 273 2024-04-21T08:59:04.603 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 274 2024-04-21T08:59:04.643 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 275 2024-04-21T08:59:04.682 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 276 2024-04-21T08:59:04.724 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 277 2024-04-21T08:59:04.766 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 278 2024-04-21T08:59:04.807 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 279 2024-04-21T08:59:04.852 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 280 2024-04-21T08:59:04.896 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 281 2024-04-21T08:59:04.937 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 282 2024-04-21T08:59:04.980 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 283 2024-04-21T08:59:05.022 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 284 2024-04-21T08:59:05.067 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 285 2024-04-21T08:59:05.111 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 286 2024-04-21T08:59:05.154 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 287 2024-04-21T08:59:05.195 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 288 2024-04-21T08:59:05.239 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 289 2024-04-21T08:59:05.526 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 290 2024-04-21T08:59:05.574 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 291 2024-04-21T08:59:05.618 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 292 2024-04-21T08:59:05.657 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 293 2024-04-21T08:59:05.694 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 294 2024-04-21T08:59:05.729 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 295 2024-04-21T08:59:05.763 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 296 2024-04-21T08:59:05.794 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 297 2024-04-21T08:59:05.824 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 298 2024-04-21T08:59:05.853 INFO:tasks.workunit.client.0.smithi026.stdout: create dir 299 2024-04-21T08:59:05.886 INFO:tasks.workunit.client.0.smithi026.stdout:Create a snapshot in every first level dir ... 2024-04-21T08:59:05.979 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/.snap/snap-subdir-test 2024-04-21T08:59:05.997 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/30 file after the snapshot 2024-04-21T08:59:06.001 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/31 file after the snapshot 2024-04-21T08:59:06.005 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/32 file after the snapshot 2024-04-21T08:59:06.010 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/33 file after the snapshot 2024-04-21T08:59:06.015 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/34 file after the snapshot 2024-04-21T08:59:06.019 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/35 file after the snapshot 2024-04-21T08:59:06.024 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/36 file after the snapshot 2024-04-21T08:59:06.028 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/37 file after the snapshot 2024-04-21T08:59:06.032 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/38 file after the snapshot 2024-04-21T08:59:06.036 INFO:tasks.workunit.client.0.smithi026.stdout: create 100/39 file after the snapshot 2024-04-21T08:59:06.041 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/.snap/snap-subdir-test 2024-04-21T08:59:06.060 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/30 file after the snapshot 2024-04-21T08:59:06.063 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/31 file after the snapshot 2024-04-21T08:59:06.066 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/32 file after the snapshot 2024-04-21T08:59:06.069 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/33 file after the snapshot 2024-04-21T08:59:06.072 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/34 file after the snapshot 2024-04-21T08:59:06.076 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/35 file after the snapshot 2024-04-21T08:59:06.079 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/36 file after the snapshot 2024-04-21T08:59:06.084 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/37 file after the snapshot 2024-04-21T08:59:06.086 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/38 file after the snapshot 2024-04-21T08:59:06.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 101/39 file after the snapshot 2024-04-21T08:59:06.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/.snap/snap-subdir-test 2024-04-21T08:59:06.111 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/30 file after the snapshot 2024-04-21T08:59:06.116 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/31 file after the snapshot 2024-04-21T08:59:06.121 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/32 file after the snapshot 2024-04-21T08:59:06.126 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/33 file after the snapshot 2024-04-21T08:59:06.128 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/34 file after the snapshot 2024-04-21T08:59:06.131 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/35 file after the snapshot 2024-04-21T08:59:06.133 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/36 file after the snapshot 2024-04-21T08:59:06.136 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/37 file after the snapshot 2024-04-21T08:59:06.139 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/38 file after the snapshot 2024-04-21T08:59:06.141 INFO:tasks.workunit.client.0.smithi026.stdout: create 102/39 file after the snapshot 2024-04-21T08:59:06.146 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/.snap/snap-subdir-test 2024-04-21T08:59:06.165 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/30 file after the snapshot 2024-04-21T08:59:06.170 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/31 file after the snapshot 2024-04-21T08:59:06.173 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/32 file after the snapshot 2024-04-21T08:59:06.176 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/33 file after the snapshot 2024-04-21T08:59:06.179 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/34 file after the snapshot 2024-04-21T08:59:06.181 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/35 file after the snapshot 2024-04-21T08:59:06.185 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/36 file after the snapshot 2024-04-21T08:59:06.188 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/37 file after the snapshot 2024-04-21T08:59:06.191 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/38 file after the snapshot 2024-04-21T08:59:06.194 INFO:tasks.workunit.client.0.smithi026.stdout: create 103/39 file after the snapshot 2024-04-21T08:59:06.197 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/.snap/snap-subdir-test 2024-04-21T08:59:06.217 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/30 file after the snapshot 2024-04-21T08:59:06.221 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/31 file after the snapshot 2024-04-21T08:59:06.225 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/32 file after the snapshot 2024-04-21T08:59:06.229 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/33 file after the snapshot 2024-04-21T08:59:06.232 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/34 file after the snapshot 2024-04-21T08:59:06.235 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/35 file after the snapshot 2024-04-21T08:59:06.239 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/36 file after the snapshot 2024-04-21T08:59:06.242 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/37 file after the snapshot 2024-04-21T08:59:06.244 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/38 file after the snapshot 2024-04-21T08:59:06.248 INFO:tasks.workunit.client.0.smithi026.stdout: create 104/39 file after the snapshot 2024-04-21T08:59:06.253 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/.snap/snap-subdir-test 2024-04-21T08:59:06.326 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/30 file after the snapshot 2024-04-21T08:59:06.430 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/31 file after the snapshot 2024-04-21T08:59:06.435 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/32 file after the snapshot 2024-04-21T08:59:06.439 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/33 file after the snapshot 2024-04-21T08:59:06.444 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/34 file after the snapshot 2024-04-21T08:59:06.448 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/35 file after the snapshot 2024-04-21T08:59:06.452 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/36 file after the snapshot 2024-04-21T08:59:06.457 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/37 file after the snapshot 2024-04-21T08:59:06.461 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/38 file after the snapshot 2024-04-21T08:59:06.466 INFO:tasks.workunit.client.0.smithi026.stdout: create 105/39 file after the snapshot 2024-04-21T08:59:06.470 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/.snap/snap-subdir-test 2024-04-21T08:59:06.556 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/30 file after the snapshot 2024-04-21T08:59:06.560 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/31 file after the snapshot 2024-04-21T08:59:06.564 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/32 file after the snapshot 2024-04-21T08:59:06.569 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/33 file after the snapshot 2024-04-21T08:59:06.574 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/34 file after the snapshot 2024-04-21T08:59:06.579 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/35 file after the snapshot 2024-04-21T08:59:06.583 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/36 file after the snapshot 2024-04-21T08:59:06.588 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/37 file after the snapshot 2024-04-21T08:59:06.593 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/38 file after the snapshot 2024-04-21T08:59:06.597 INFO:tasks.workunit.client.0.smithi026.stdout: create 106/39 file after the snapshot 2024-04-21T08:59:06.601 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/.snap/snap-subdir-test 2024-04-21T08:59:06.625 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/30 file after the snapshot 2024-04-21T08:59:06.629 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/31 file after the snapshot 2024-04-21T08:59:06.632 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/32 file after the snapshot 2024-04-21T08:59:06.637 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/33 file after the snapshot 2024-04-21T08:59:06.641 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/34 file after the snapshot 2024-04-21T08:59:06.645 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/35 file after the snapshot 2024-04-21T08:59:06.650 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/36 file after the snapshot 2024-04-21T08:59:06.654 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/37 file after the snapshot 2024-04-21T08:59:06.658 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/38 file after the snapshot 2024-04-21T08:59:06.662 INFO:tasks.workunit.client.0.smithi026.stdout: create 107/39 file after the snapshot 2024-04-21T08:59:06.666 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/.snap/snap-subdir-test 2024-04-21T08:59:06.688 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/30 file after the snapshot 2024-04-21T08:59:06.691 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/31 file after the snapshot 2024-04-21T08:59:06.695 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/32 file after the snapshot 2024-04-21T08:59:06.699 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/33 file after the snapshot 2024-04-21T08:59:06.703 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/34 file after the snapshot 2024-04-21T08:59:06.706 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/35 file after the snapshot 2024-04-21T08:59:06.710 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/36 file after the snapshot 2024-04-21T08:59:06.715 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/37 file after the snapshot 2024-04-21T08:59:06.720 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/38 file after the snapshot 2024-04-21T08:59:06.725 INFO:tasks.workunit.client.0.smithi026.stdout: create 108/39 file after the snapshot 2024-04-21T08:59:06.730 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/.snap/snap-subdir-test 2024-04-21T08:59:06.755 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/30 file after the snapshot 2024-04-21T08:59:06.759 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/31 file after the snapshot 2024-04-21T08:59:06.763 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/32 file after the snapshot 2024-04-21T08:59:06.767 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/33 file after the snapshot 2024-04-21T08:59:06.772 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/34 file after the snapshot 2024-04-21T08:59:06.775 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/35 file after the snapshot 2024-04-21T08:59:06.779 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/36 file after the snapshot 2024-04-21T08:59:06.783 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/37 file after the snapshot 2024-04-21T08:59:06.787 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/38 file after the snapshot 2024-04-21T08:59:06.791 INFO:tasks.workunit.client.0.smithi026.stdout: create 109/39 file after the snapshot 2024-04-21T08:59:06.794 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/.snap/snap-subdir-test 2024-04-21T08:59:06.818 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/30 file after the snapshot 2024-04-21T08:59:06.822 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/31 file after the snapshot 2024-04-21T08:59:06.825 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/32 file after the snapshot 2024-04-21T08:59:06.829 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/33 file after the snapshot 2024-04-21T08:59:06.833 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/34 file after the snapshot 2024-04-21T08:59:06.837 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/35 file after the snapshot 2024-04-21T08:59:06.841 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/36 file after the snapshot 2024-04-21T08:59:06.845 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/37 file after the snapshot 2024-04-21T08:59:06.849 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/38 file after the snapshot 2024-04-21T08:59:06.853 INFO:tasks.workunit.client.0.smithi026.stdout: create 110/39 file after the snapshot 2024-04-21T08:59:06.857 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/.snap/snap-subdir-test 2024-04-21T08:59:06.881 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/30 file after the snapshot 2024-04-21T08:59:06.885 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/31 file after the snapshot 2024-04-21T08:59:06.889 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/32 file after the snapshot 2024-04-21T08:59:06.892 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/33 file after the snapshot 2024-04-21T08:59:06.896 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/34 file after the snapshot 2024-04-21T08:59:06.900 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/35 file after the snapshot 2024-04-21T08:59:06.904 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/36 file after the snapshot 2024-04-21T08:59:06.908 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/37 file after the snapshot 2024-04-21T08:59:06.912 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/38 file after the snapshot 2024-04-21T08:59:06.915 INFO:tasks.workunit.client.0.smithi026.stdout: create 111/39 file after the snapshot 2024-04-21T08:59:06.919 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/.snap/snap-subdir-test 2024-04-21T08:59:06.943 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/30 file after the snapshot 2024-04-21T08:59:06.947 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/31 file after the snapshot 2024-04-21T08:59:06.951 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/32 file after the snapshot 2024-04-21T08:59:06.956 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/33 file after the snapshot 2024-04-21T08:59:06.960 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/34 file after the snapshot 2024-04-21T08:59:06.965 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/35 file after the snapshot 2024-04-21T08:59:06.969 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/36 file after the snapshot 2024-04-21T08:59:06.973 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/37 file after the snapshot 2024-04-21T08:59:06.977 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/38 file after the snapshot 2024-04-21T08:59:06.981 INFO:tasks.workunit.client.0.smithi026.stdout: create 112/39 file after the snapshot 2024-04-21T08:59:06.986 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/.snap/snap-subdir-test 2024-04-21T08:59:07.012 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/30 file after the snapshot 2024-04-21T08:59:07.016 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/31 file after the snapshot 2024-04-21T08:59:07.021 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/32 file after the snapshot 2024-04-21T08:59:07.025 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/33 file after the snapshot 2024-04-21T08:59:07.030 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/34 file after the snapshot 2024-04-21T08:59:07.034 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/35 file after the snapshot 2024-04-21T08:59:07.039 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/36 file after the snapshot 2024-04-21T08:59:07.043 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/37 file after the snapshot 2024-04-21T08:59:07.047 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/38 file after the snapshot 2024-04-21T08:59:07.051 INFO:tasks.workunit.client.0.smithi026.stdout: create 113/39 file after the snapshot 2024-04-21T08:59:07.055 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/.snap/snap-subdir-test 2024-04-21T08:59:07.086 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/30 file after the snapshot 2024-04-21T08:59:07.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/31 file after the snapshot 2024-04-21T08:59:07.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/32 file after the snapshot 2024-04-21T08:59:07.098 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/33 file after the snapshot 2024-04-21T08:59:07.102 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/34 file after the snapshot 2024-04-21T08:59:07.106 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/35 file after the snapshot 2024-04-21T08:59:07.110 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/36 file after the snapshot 2024-04-21T08:59:07.114 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/37 file after the snapshot 2024-04-21T08:59:07.118 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/38 file after the snapshot 2024-04-21T08:59:07.122 INFO:tasks.workunit.client.0.smithi026.stdout: create 114/39 file after the snapshot 2024-04-21T08:59:07.125 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/.snap/snap-subdir-test 2024-04-21T08:59:07.152 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/30 file after the snapshot 2024-04-21T08:59:07.155 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/31 file after the snapshot 2024-04-21T08:59:07.160 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/32 file after the snapshot 2024-04-21T08:59:07.163 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/33 file after the snapshot 2024-04-21T08:59:07.167 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/34 file after the snapshot 2024-04-21T08:59:07.171 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/35 file after the snapshot 2024-04-21T08:59:07.176 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/36 file after the snapshot 2024-04-21T08:59:07.181 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/37 file after the snapshot 2024-04-21T08:59:07.186 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/38 file after the snapshot 2024-04-21T08:59:07.190 INFO:tasks.workunit.client.0.smithi026.stdout: create 115/39 file after the snapshot 2024-04-21T08:59:07.194 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/.snap/snap-subdir-test 2024-04-21T08:59:07.217 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/30 file after the snapshot 2024-04-21T08:59:07.220 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/31 file after the snapshot 2024-04-21T08:59:07.224 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/32 file after the snapshot 2024-04-21T08:59:07.228 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/33 file after the snapshot 2024-04-21T08:59:07.231 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/34 file after the snapshot 2024-04-21T08:59:07.235 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/35 file after the snapshot 2024-04-21T08:59:07.239 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/36 file after the snapshot 2024-04-21T08:59:07.243 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/37 file after the snapshot 2024-04-21T08:59:07.247 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/38 file after the snapshot 2024-04-21T08:59:07.251 INFO:tasks.workunit.client.0.smithi026.stdout: create 116/39 file after the snapshot 2024-04-21T08:59:07.255 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/.snap/snap-subdir-test 2024-04-21T08:59:07.284 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/30 file after the snapshot 2024-04-21T08:59:07.293 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/31 file after the snapshot 2024-04-21T08:59:07.361 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/32 file after the snapshot 2024-04-21T08:59:07.367 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/33 file after the snapshot 2024-04-21T08:59:07.372 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/34 file after the snapshot 2024-04-21T08:59:07.377 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/35 file after the snapshot 2024-04-21T08:59:07.381 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/36 file after the snapshot 2024-04-21T08:59:07.386 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/37 file after the snapshot 2024-04-21T08:59:07.390 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/38 file after the snapshot 2024-04-21T08:59:07.396 INFO:tasks.workunit.client.0.smithi026.stdout: create 117/39 file after the snapshot 2024-04-21T08:59:07.402 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/.snap/snap-subdir-test 2024-04-21T08:59:07.465 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/30 file after the snapshot 2024-04-21T08:59:07.469 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/31 file after the snapshot 2024-04-21T08:59:07.474 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/32 file after the snapshot 2024-04-21T08:59:07.479 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/33 file after the snapshot 2024-04-21T08:59:07.483 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/34 file after the snapshot 2024-04-21T08:59:07.488 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/35 file after the snapshot 2024-04-21T08:59:07.493 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/36 file after the snapshot 2024-04-21T08:59:07.499 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/37 file after the snapshot 2024-04-21T08:59:07.504 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/38 file after the snapshot 2024-04-21T08:59:07.510 INFO:tasks.workunit.client.0.smithi026.stdout: create 118/39 file after the snapshot 2024-04-21T08:59:07.516 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/.snap/snap-subdir-test 2024-04-21T08:59:07.544 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/30 file after the snapshot 2024-04-21T08:59:07.548 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/31 file after the snapshot 2024-04-21T08:59:07.552 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/32 file after the snapshot 2024-04-21T08:59:07.556 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/33 file after the snapshot 2024-04-21T08:59:07.560 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/34 file after the snapshot 2024-04-21T08:59:07.565 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/35 file after the snapshot 2024-04-21T08:59:07.568 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/36 file after the snapshot 2024-04-21T08:59:07.573 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/37 file after the snapshot 2024-04-21T08:59:07.578 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/38 file after the snapshot 2024-04-21T08:59:07.582 INFO:tasks.workunit.client.0.smithi026.stdout: create 119/39 file after the snapshot 2024-04-21T08:59:07.586 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/.snap/snap-subdir-test 2024-04-21T08:59:07.613 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/30 file after the snapshot 2024-04-21T08:59:07.617 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/31 file after the snapshot 2024-04-21T08:59:07.621 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/32 file after the snapshot 2024-04-21T08:59:07.625 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/33 file after the snapshot 2024-04-21T08:59:07.630 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/34 file after the snapshot 2024-04-21T08:59:07.635 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/35 file after the snapshot 2024-04-21T08:59:07.640 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/36 file after the snapshot 2024-04-21T08:59:07.644 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/37 file after the snapshot 2024-04-21T08:59:07.648 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/38 file after the snapshot 2024-04-21T08:59:07.652 INFO:tasks.workunit.client.0.smithi026.stdout: create 120/39 file after the snapshot 2024-04-21T08:59:07.656 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/.snap/snap-subdir-test 2024-04-21T08:59:07.689 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/30 file after the snapshot 2024-04-21T08:59:07.694 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/31 file after the snapshot 2024-04-21T08:59:07.701 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/32 file after the snapshot 2024-04-21T08:59:07.706 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/33 file after the snapshot 2024-04-21T08:59:07.711 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/34 file after the snapshot 2024-04-21T08:59:07.716 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/35 file after the snapshot 2024-04-21T08:59:07.720 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/36 file after the snapshot 2024-04-21T08:59:07.725 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/37 file after the snapshot 2024-04-21T08:59:07.731 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/38 file after the snapshot 2024-04-21T08:59:07.737 INFO:tasks.workunit.client.0.smithi026.stdout: create 121/39 file after the snapshot 2024-04-21T08:59:07.741 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/.snap/snap-subdir-test 2024-04-21T08:59:07.768 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/30 file after the snapshot 2024-04-21T08:59:07.773 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/31 file after the snapshot 2024-04-21T08:59:07.779 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/32 file after the snapshot 2024-04-21T08:59:07.783 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/33 file after the snapshot 2024-04-21T08:59:07.788 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/34 file after the snapshot 2024-04-21T08:59:07.793 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/35 file after the snapshot 2024-04-21T08:59:07.797 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/36 file after the snapshot 2024-04-21T08:59:07.801 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/37 file after the snapshot 2024-04-21T08:59:07.806 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/38 file after the snapshot 2024-04-21T08:59:07.810 INFO:tasks.workunit.client.0.smithi026.stdout: create 122/39 file after the snapshot 2024-04-21T08:59:07.815 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/.snap/snap-subdir-test 2024-04-21T08:59:07.840 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/30 file after the snapshot 2024-04-21T08:59:07.843 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/31 file after the snapshot 2024-04-21T08:59:07.847 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/32 file after the snapshot 2024-04-21T08:59:07.852 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/33 file after the snapshot 2024-04-21T08:59:07.855 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/34 file after the snapshot 2024-04-21T08:59:07.859 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/35 file after the snapshot 2024-04-21T08:59:07.863 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/36 file after the snapshot 2024-04-21T08:59:07.867 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/37 file after the snapshot 2024-04-21T08:59:07.872 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/38 file after the snapshot 2024-04-21T08:59:07.874 INFO:tasks.workunit.client.0.smithi026.stdout: create 123/39 file after the snapshot 2024-04-21T08:59:07.879 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/.snap/snap-subdir-test 2024-04-21T08:59:07.904 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/30 file after the snapshot 2024-04-21T08:59:07.907 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/31 file after the snapshot 2024-04-21T08:59:07.911 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/32 file after the snapshot 2024-04-21T08:59:07.915 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/33 file after the snapshot 2024-04-21T08:59:07.920 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/34 file after the snapshot 2024-04-21T08:59:07.924 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/35 file after the snapshot 2024-04-21T08:59:07.928 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/36 file after the snapshot 2024-04-21T08:59:07.932 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/37 file after the snapshot 2024-04-21T08:59:07.936 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/38 file after the snapshot 2024-04-21T08:59:07.940 INFO:tasks.workunit.client.0.smithi026.stdout: create 124/39 file after the snapshot 2024-04-21T08:59:07.944 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/.snap/snap-subdir-test 2024-04-21T08:59:07.969 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/30 file after the snapshot 2024-04-21T08:59:07.973 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/31 file after the snapshot 2024-04-21T08:59:07.977 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/32 file after the snapshot 2024-04-21T08:59:07.980 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/33 file after the snapshot 2024-04-21T08:59:07.984 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/34 file after the snapshot 2024-04-21T08:59:07.989 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/35 file after the snapshot 2024-04-21T08:59:07.992 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/36 file after the snapshot 2024-04-21T08:59:07.996 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/37 file after the snapshot 2024-04-21T08:59:08.000 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/38 file after the snapshot 2024-04-21T08:59:08.004 INFO:tasks.workunit.client.0.smithi026.stdout: create 125/39 file after the snapshot 2024-04-21T08:59:08.008 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/.snap/snap-subdir-test 2024-04-21T08:59:08.033 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/30 file after the snapshot 2024-04-21T08:59:08.036 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/31 file after the snapshot 2024-04-21T08:59:08.041 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/32 file after the snapshot 2024-04-21T08:59:08.045 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/33 file after the snapshot 2024-04-21T08:59:08.049 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/34 file after the snapshot 2024-04-21T08:59:08.053 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/35 file after the snapshot 2024-04-21T08:59:08.057 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/36 file after the snapshot 2024-04-21T08:59:08.061 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/37 file after the snapshot 2024-04-21T08:59:08.065 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/38 file after the snapshot 2024-04-21T08:59:08.069 INFO:tasks.workunit.client.0.smithi026.stdout: create 126/39 file after the snapshot 2024-04-21T08:59:08.074 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/.snap/snap-subdir-test 2024-04-21T08:59:08.101 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/30 file after the snapshot 2024-04-21T08:59:08.105 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/31 file after the snapshot 2024-04-21T08:59:08.110 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/32 file after the snapshot 2024-04-21T08:59:08.114 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/33 file after the snapshot 2024-04-21T08:59:08.119 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/34 file after the snapshot 2024-04-21T08:59:08.123 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/35 file after the snapshot 2024-04-21T08:59:08.127 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/36 file after the snapshot 2024-04-21T08:59:08.132 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/37 file after the snapshot 2024-04-21T08:59:08.136 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/38 file after the snapshot 2024-04-21T08:59:08.140 INFO:tasks.workunit.client.0.smithi026.stdout: create 127/39 file after the snapshot 2024-04-21T08:59:08.144 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/.snap/snap-subdir-test 2024-04-21T08:59:08.169 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/30 file after the snapshot 2024-04-21T08:59:08.173 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/31 file after the snapshot 2024-04-21T08:59:08.177 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/32 file after the snapshot 2024-04-21T08:59:08.181 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/33 file after the snapshot 2024-04-21T08:59:08.185 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/34 file after the snapshot 2024-04-21T08:59:08.189 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/35 file after the snapshot 2024-04-21T08:59:08.193 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/36 file after the snapshot 2024-04-21T08:59:08.197 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/37 file after the snapshot 2024-04-21T08:59:08.201 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/38 file after the snapshot 2024-04-21T08:59:08.205 INFO:tasks.workunit.client.0.smithi026.stdout: create 128/39 file after the snapshot 2024-04-21T08:59:08.209 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/.snap/snap-subdir-test 2024-04-21T08:59:08.232 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/30 file after the snapshot 2024-04-21T08:59:08.235 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/31 file after the snapshot 2024-04-21T08:59:08.239 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/32 file after the snapshot 2024-04-21T08:59:08.243 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/33 file after the snapshot 2024-04-21T08:59:08.247 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/34 file after the snapshot 2024-04-21T08:59:08.250 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/35 file after the snapshot 2024-04-21T08:59:08.254 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/36 file after the snapshot 2024-04-21T08:59:08.258 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/37 file after the snapshot 2024-04-21T08:59:08.262 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/38 file after the snapshot 2024-04-21T08:59:08.266 INFO:tasks.workunit.client.0.smithi026.stdout: create 129/39 file after the snapshot 2024-04-21T08:59:08.269 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/.snap/snap-subdir-test 2024-04-21T08:59:08.293 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/30 file after the snapshot 2024-04-21T08:59:08.298 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/31 file after the snapshot 2024-04-21T08:59:08.302 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/32 file after the snapshot 2024-04-21T08:59:08.306 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/33 file after the snapshot 2024-04-21T08:59:08.311 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/34 file after the snapshot 2024-04-21T08:59:08.315 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/35 file after the snapshot 2024-04-21T08:59:08.319 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/36 file after the snapshot 2024-04-21T08:59:08.323 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/37 file after the snapshot 2024-04-21T08:59:08.328 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/38 file after the snapshot 2024-04-21T08:59:08.332 INFO:tasks.workunit.client.0.smithi026.stdout: create 130/39 file after the snapshot 2024-04-21T08:59:08.336 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/.snap/snap-subdir-test 2024-04-21T08:59:08.359 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/30 file after the snapshot 2024-04-21T08:59:08.363 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/31 file after the snapshot 2024-04-21T08:59:08.368 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/32 file after the snapshot 2024-04-21T08:59:08.371 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/33 file after the snapshot 2024-04-21T08:59:08.375 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/34 file after the snapshot 2024-04-21T08:59:08.379 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/35 file after the snapshot 2024-04-21T08:59:08.383 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/36 file after the snapshot 2024-04-21T08:59:08.386 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/37 file after the snapshot 2024-04-21T08:59:08.391 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/38 file after the snapshot 2024-04-21T08:59:08.398 INFO:tasks.workunit.client.0.smithi026.stdout: create 131/39 file after the snapshot 2024-04-21T08:59:08.402 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/.snap/snap-subdir-test 2024-04-21T08:59:08.423 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/30 file after the snapshot 2024-04-21T08:59:08.426 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/31 file after the snapshot 2024-04-21T08:59:08.430 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/32 file after the snapshot 2024-04-21T08:59:08.434 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/33 file after the snapshot 2024-04-21T08:59:08.437 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/34 file after the snapshot 2024-04-21T08:59:08.441 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/35 file after the snapshot 2024-04-21T08:59:08.445 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/36 file after the snapshot 2024-04-21T08:59:08.449 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/37 file after the snapshot 2024-04-21T08:59:08.452 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/38 file after the snapshot 2024-04-21T08:59:08.456 INFO:tasks.workunit.client.0.smithi026.stdout: create 132/39 file after the snapshot 2024-04-21T08:59:08.460 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/.snap/snap-subdir-test 2024-04-21T08:59:08.485 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/30 file after the snapshot 2024-04-21T08:59:08.488 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/31 file after the snapshot 2024-04-21T08:59:08.492 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/32 file after the snapshot 2024-04-21T08:59:08.497 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/33 file after the snapshot 2024-04-21T08:59:08.501 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/34 file after the snapshot 2024-04-21T08:59:08.505 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/35 file after the snapshot 2024-04-21T08:59:08.509 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/36 file after the snapshot 2024-04-21T08:59:08.514 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/37 file after the snapshot 2024-04-21T08:59:08.518 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/38 file after the snapshot 2024-04-21T08:59:08.522 INFO:tasks.workunit.client.0.smithi026.stdout: create 133/39 file after the snapshot 2024-04-21T08:59:08.526 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/.snap/snap-subdir-test 2024-04-21T08:59:08.548 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/30 file after the snapshot 2024-04-21T08:59:08.551 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/31 file after the snapshot 2024-04-21T08:59:08.556 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/32 file after the snapshot 2024-04-21T08:59:08.559 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/33 file after the snapshot 2024-04-21T08:59:08.564 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/34 file after the snapshot 2024-04-21T08:59:08.568 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/35 file after the snapshot 2024-04-21T08:59:08.571 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/36 file after the snapshot 2024-04-21T08:59:08.575 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/37 file after the snapshot 2024-04-21T08:59:08.580 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/38 file after the snapshot 2024-04-21T08:59:08.583 INFO:tasks.workunit.client.0.smithi026.stdout: create 134/39 file after the snapshot 2024-04-21T08:59:08.587 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/.snap/snap-subdir-test 2024-04-21T08:59:08.610 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/30 file after the snapshot 2024-04-21T08:59:08.613 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/31 file after the snapshot 2024-04-21T08:59:08.618 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/32 file after the snapshot 2024-04-21T08:59:08.621 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/33 file after the snapshot 2024-04-21T08:59:08.625 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/34 file after the snapshot 2024-04-21T08:59:08.630 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/35 file after the snapshot 2024-04-21T08:59:08.634 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/36 file after the snapshot 2024-04-21T08:59:08.639 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/37 file after the snapshot 2024-04-21T08:59:08.643 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/38 file after the snapshot 2024-04-21T08:59:08.646 INFO:tasks.workunit.client.0.smithi026.stdout: create 135/39 file after the snapshot 2024-04-21T08:59:08.651 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/.snap/snap-subdir-test 2024-04-21T08:59:08.675 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/30 file after the snapshot 2024-04-21T08:59:08.678 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/31 file after the snapshot 2024-04-21T08:59:08.682 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/32 file after the snapshot 2024-04-21T08:59:08.686 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/33 file after the snapshot 2024-04-21T08:59:08.690 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/34 file after the snapshot 2024-04-21T08:59:08.695 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/35 file after the snapshot 2024-04-21T08:59:08.699 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/36 file after the snapshot 2024-04-21T08:59:08.703 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/37 file after the snapshot 2024-04-21T08:59:08.707 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/38 file after the snapshot 2024-04-21T08:59:08.711 INFO:tasks.workunit.client.0.smithi026.stdout: create 136/39 file after the snapshot 2024-04-21T08:59:08.715 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/.snap/snap-subdir-test 2024-04-21T08:59:08.739 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/30 file after the snapshot 2024-04-21T08:59:08.743 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/31 file after the snapshot 2024-04-21T08:59:08.747 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/32 file after the snapshot 2024-04-21T08:59:08.751 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/33 file after the snapshot 2024-04-21T08:59:08.755 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/34 file after the snapshot 2024-04-21T08:59:08.758 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/35 file after the snapshot 2024-04-21T08:59:08.762 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/36 file after the snapshot 2024-04-21T08:59:08.766 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/37 file after the snapshot 2024-04-21T08:59:08.770 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/38 file after the snapshot 2024-04-21T08:59:08.774 INFO:tasks.workunit.client.0.smithi026.stdout: create 137/39 file after the snapshot 2024-04-21T08:59:08.778 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/.snap/snap-subdir-test 2024-04-21T08:59:08.803 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/30 file after the snapshot 2024-04-21T08:59:08.806 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/31 file after the snapshot 2024-04-21T08:59:08.811 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/32 file after the snapshot 2024-04-21T08:59:08.815 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/33 file after the snapshot 2024-04-21T08:59:08.819 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/34 file after the snapshot 2024-04-21T08:59:08.823 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/35 file after the snapshot 2024-04-21T08:59:08.827 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/36 file after the snapshot 2024-04-21T08:59:08.831 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/37 file after the snapshot 2024-04-21T08:59:08.834 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/38 file after the snapshot 2024-04-21T08:59:08.838 INFO:tasks.workunit.client.0.smithi026.stdout: create 138/39 file after the snapshot 2024-04-21T08:59:08.842 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/.snap/snap-subdir-test 2024-04-21T08:59:08.868 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/30 file after the snapshot 2024-04-21T08:59:08.872 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/31 file after the snapshot 2024-04-21T08:59:08.876 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/32 file after the snapshot 2024-04-21T08:59:08.879 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/33 file after the snapshot 2024-04-21T08:59:08.883 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/34 file after the snapshot 2024-04-21T08:59:08.888 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/35 file after the snapshot 2024-04-21T08:59:08.893 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/36 file after the snapshot 2024-04-21T08:59:08.896 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/37 file after the snapshot 2024-04-21T08:59:08.900 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/38 file after the snapshot 2024-04-21T08:59:08.903 INFO:tasks.workunit.client.0.smithi026.stdout: create 139/39 file after the snapshot 2024-04-21T08:59:08.907 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/.snap/snap-subdir-test 2024-04-21T08:59:08.931 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/30 file after the snapshot 2024-04-21T08:59:08.934 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/31 file after the snapshot 2024-04-21T08:59:08.938 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/32 file after the snapshot 2024-04-21T08:59:08.942 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/33 file after the snapshot 2024-04-21T08:59:08.946 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/34 file after the snapshot 2024-04-21T08:59:08.951 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/35 file after the snapshot 2024-04-21T08:59:08.954 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/36 file after the snapshot 2024-04-21T08:59:08.958 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/37 file after the snapshot 2024-04-21T08:59:08.962 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/38 file after the snapshot 2024-04-21T08:59:08.965 INFO:tasks.workunit.client.0.smithi026.stdout: create 140/39 file after the snapshot 2024-04-21T08:59:08.969 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/.snap/snap-subdir-test 2024-04-21T08:59:08.994 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/30 file after the snapshot 2024-04-21T08:59:08.998 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/31 file after the snapshot 2024-04-21T08:59:09.001 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/32 file after the snapshot 2024-04-21T08:59:09.005 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/33 file after the snapshot 2024-04-21T08:59:09.010 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/34 file after the snapshot 2024-04-21T08:59:09.012 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/35 file after the snapshot 2024-04-21T08:59:09.016 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/36 file after the snapshot 2024-04-21T08:59:09.020 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/37 file after the snapshot 2024-04-21T08:59:09.024 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/38 file after the snapshot 2024-04-21T08:59:09.028 INFO:tasks.workunit.client.0.smithi026.stdout: create 141/39 file after the snapshot 2024-04-21T08:59:09.032 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/.snap/snap-subdir-test 2024-04-21T08:59:09.058 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/30 file after the snapshot 2024-04-21T08:59:09.062 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/31 file after the snapshot 2024-04-21T08:59:09.066 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/32 file after the snapshot 2024-04-21T08:59:09.070 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/33 file after the snapshot 2024-04-21T08:59:09.074 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/34 file after the snapshot 2024-04-21T08:59:09.078 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/35 file after the snapshot 2024-04-21T08:59:09.082 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/36 file after the snapshot 2024-04-21T08:59:09.085 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/37 file after the snapshot 2024-04-21T08:59:09.089 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/38 file after the snapshot 2024-04-21T08:59:09.093 INFO:tasks.workunit.client.0.smithi026.stdout: create 142/39 file after the snapshot 2024-04-21T08:59:09.097 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/.snap/snap-subdir-test 2024-04-21T08:59:09.129 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/30 file after the snapshot 2024-04-21T08:59:09.133 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/31 file after the snapshot 2024-04-21T08:59:09.137 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/32 file after the snapshot 2024-04-21T08:59:09.142 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/33 file after the snapshot 2024-04-21T08:59:09.146 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/34 file after the snapshot 2024-04-21T08:59:09.149 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/35 file after the snapshot 2024-04-21T08:59:09.153 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/36 file after the snapshot 2024-04-21T08:59:09.157 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/37 file after the snapshot 2024-04-21T08:59:09.161 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/38 file after the snapshot 2024-04-21T08:59:09.165 INFO:tasks.workunit.client.0.smithi026.stdout: create 143/39 file after the snapshot 2024-04-21T08:59:09.168 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/.snap/snap-subdir-test 2024-04-21T08:59:09.194 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/30 file after the snapshot 2024-04-21T08:59:09.197 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/31 file after the snapshot 2024-04-21T08:59:09.201 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/32 file after the snapshot 2024-04-21T08:59:09.205 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/33 file after the snapshot 2024-04-21T08:59:09.208 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/34 file after the snapshot 2024-04-21T08:59:09.213 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/35 file after the snapshot 2024-04-21T08:59:09.217 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/36 file after the snapshot 2024-04-21T08:59:09.220 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/37 file after the snapshot 2024-04-21T08:59:09.224 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/38 file after the snapshot 2024-04-21T08:59:09.228 INFO:tasks.workunit.client.0.smithi026.stdout: create 144/39 file after the snapshot 2024-04-21T08:59:09.233 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/.snap/snap-subdir-test 2024-04-21T08:59:09.257 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/30 file after the snapshot 2024-04-21T08:59:09.261 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/31 file after the snapshot 2024-04-21T08:59:09.264 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/32 file after the snapshot 2024-04-21T08:59:09.268 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/33 file after the snapshot 2024-04-21T08:59:09.272 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/34 file after the snapshot 2024-04-21T08:59:09.276 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/35 file after the snapshot 2024-04-21T08:59:09.281 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/36 file after the snapshot 2024-04-21T08:59:09.285 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/37 file after the snapshot 2024-04-21T08:59:09.289 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/38 file after the snapshot 2024-04-21T08:59:09.293 INFO:tasks.workunit.client.0.smithi026.stdout: create 145/39 file after the snapshot 2024-04-21T08:59:09.307 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/.snap/snap-subdir-test 2024-04-21T08:59:09.512 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/30 file after the snapshot 2024-04-21T08:59:09.517 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/31 file after the snapshot 2024-04-21T08:59:09.522 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/32 file after the snapshot 2024-04-21T08:59:09.527 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/33 file after the snapshot 2024-04-21T08:59:09.531 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/34 file after the snapshot 2024-04-21T08:59:09.536 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/35 file after the snapshot 2024-04-21T08:59:09.542 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/36 file after the snapshot 2024-04-21T08:59:09.546 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/37 file after the snapshot 2024-04-21T08:59:09.551 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/38 file after the snapshot 2024-04-21T08:59:09.555 INFO:tasks.workunit.client.0.smithi026.stdout: create 146/39 file after the snapshot 2024-04-21T08:59:09.560 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/.snap/snap-subdir-test 2024-04-21T08:59:09.591 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/30 file after the snapshot 2024-04-21T08:59:09.595 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/31 file after the snapshot 2024-04-21T08:59:09.599 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/32 file after the snapshot 2024-04-21T08:59:09.603 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/33 file after the snapshot 2024-04-21T08:59:09.608 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/34 file after the snapshot 2024-04-21T08:59:09.612 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/35 file after the snapshot 2024-04-21T08:59:09.615 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/36 file after the snapshot 2024-04-21T08:59:09.619 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/37 file after the snapshot 2024-04-21T08:59:09.623 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/38 file after the snapshot 2024-04-21T08:59:09.626 INFO:tasks.workunit.client.0.smithi026.stdout: create 147/39 file after the snapshot 2024-04-21T08:59:09.630 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/.snap/snap-subdir-test 2024-04-21T08:59:09.656 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/30 file after the snapshot 2024-04-21T08:59:09.660 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/31 file after the snapshot 2024-04-21T08:59:09.663 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/32 file after the snapshot 2024-04-21T08:59:09.667 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/33 file after the snapshot 2024-04-21T08:59:09.672 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/34 file after the snapshot 2024-04-21T08:59:09.677 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/35 file after the snapshot 2024-04-21T08:59:09.680 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/36 file after the snapshot 2024-04-21T08:59:09.684 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/37 file after the snapshot 2024-04-21T08:59:09.688 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/38 file after the snapshot 2024-04-21T08:59:09.693 INFO:tasks.workunit.client.0.smithi026.stdout: create 148/39 file after the snapshot 2024-04-21T08:59:09.697 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/.snap/snap-subdir-test 2024-04-21T08:59:09.723 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/30 file after the snapshot 2024-04-21T08:59:09.727 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/31 file after the snapshot 2024-04-21T08:59:09.731 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/32 file after the snapshot 2024-04-21T08:59:09.735 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/33 file after the snapshot 2024-04-21T08:59:09.739 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/34 file after the snapshot 2024-04-21T08:59:09.744 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/35 file after the snapshot 2024-04-21T08:59:09.748 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/36 file after the snapshot 2024-04-21T08:59:09.752 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/37 file after the snapshot 2024-04-21T08:59:09.756 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/38 file after the snapshot 2024-04-21T08:59:09.760 INFO:tasks.workunit.client.0.smithi026.stdout: create 149/39 file after the snapshot 2024-04-21T08:59:09.764 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/.snap/snap-subdir-test 2024-04-21T08:59:09.790 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/30 file after the snapshot 2024-04-21T08:59:09.794 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/31 file after the snapshot 2024-04-21T08:59:09.799 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/32 file after the snapshot 2024-04-21T08:59:09.805 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/33 file after the snapshot 2024-04-21T08:59:09.809 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/34 file after the snapshot 2024-04-21T08:59:09.813 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/35 file after the snapshot 2024-04-21T08:59:09.817 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/36 file after the snapshot 2024-04-21T08:59:09.821 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/37 file after the snapshot 2024-04-21T08:59:09.825 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/38 file after the snapshot 2024-04-21T08:59:09.829 INFO:tasks.workunit.client.0.smithi026.stdout: create 150/39 file after the snapshot 2024-04-21T08:59:09.833 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/.snap/snap-subdir-test 2024-04-21T08:59:09.860 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/30 file after the snapshot 2024-04-21T08:59:09.863 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/31 file after the snapshot 2024-04-21T08:59:09.868 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/32 file after the snapshot 2024-04-21T08:59:09.872 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/33 file after the snapshot 2024-04-21T08:59:09.876 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/34 file after the snapshot 2024-04-21T08:59:09.880 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/35 file after the snapshot 2024-04-21T08:59:09.884 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/36 file after the snapshot 2024-04-21T08:59:09.888 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/37 file after the snapshot 2024-04-21T08:59:09.892 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/38 file after the snapshot 2024-04-21T08:59:09.897 INFO:tasks.workunit.client.0.smithi026.stdout: create 151/39 file after the snapshot 2024-04-21T08:59:09.901 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/.snap/snap-subdir-test 2024-04-21T08:59:09.928 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/30 file after the snapshot 2024-04-21T08:59:09.932 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/31 file after the snapshot 2024-04-21T08:59:09.935 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/32 file after the snapshot 2024-04-21T08:59:09.940 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/33 file after the snapshot 2024-04-21T08:59:09.944 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/34 file after the snapshot 2024-04-21T08:59:09.948 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/35 file after the snapshot 2024-04-21T08:59:09.952 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/36 file after the snapshot 2024-04-21T08:59:09.955 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/37 file after the snapshot 2024-04-21T08:59:09.960 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/38 file after the snapshot 2024-04-21T08:59:09.964 INFO:tasks.workunit.client.0.smithi026.stdout: create 152/39 file after the snapshot 2024-04-21T08:59:09.969 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/.snap/snap-subdir-test 2024-04-21T08:59:09.995 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/30 file after the snapshot 2024-04-21T08:59:09.999 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/31 file after the snapshot 2024-04-21T08:59:10.002 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/32 file after the snapshot 2024-04-21T08:59:10.006 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/33 file after the snapshot 2024-04-21T08:59:10.010 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/34 file after the snapshot 2024-04-21T08:59:10.014 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/35 file after the snapshot 2024-04-21T08:59:10.017 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/36 file after the snapshot 2024-04-21T08:59:10.021 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/37 file after the snapshot 2024-04-21T08:59:10.024 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/38 file after the snapshot 2024-04-21T08:59:10.028 INFO:tasks.workunit.client.0.smithi026.stdout: create 153/39 file after the snapshot 2024-04-21T08:59:10.031 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/.snap/snap-subdir-test 2024-04-21T08:59:10.056 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/30 file after the snapshot 2024-04-21T08:59:10.060 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/31 file after the snapshot 2024-04-21T08:59:10.064 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/32 file after the snapshot 2024-04-21T08:59:10.068 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/33 file after the snapshot 2024-04-21T08:59:10.073 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/34 file after the snapshot 2024-04-21T08:59:10.077 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/35 file after the snapshot 2024-04-21T08:59:10.081 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/36 file after the snapshot 2024-04-21T08:59:10.086 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/37 file after the snapshot 2024-04-21T08:59:10.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/38 file after the snapshot 2024-04-21T08:59:10.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 154/39 file after the snapshot 2024-04-21T08:59:10.099 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/.snap/snap-subdir-test 2024-04-21T08:59:10.126 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/30 file after the snapshot 2024-04-21T08:59:10.130 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/31 file after the snapshot 2024-04-21T08:59:10.134 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/32 file after the snapshot 2024-04-21T08:59:10.138 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/33 file after the snapshot 2024-04-21T08:59:10.142 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/34 file after the snapshot 2024-04-21T08:59:10.147 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/35 file after the snapshot 2024-04-21T08:59:10.151 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/36 file after the snapshot 2024-04-21T08:59:10.155 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/37 file after the snapshot 2024-04-21T08:59:10.160 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/38 file after the snapshot 2024-04-21T08:59:10.164 INFO:tasks.workunit.client.0.smithi026.stdout: create 155/39 file after the snapshot 2024-04-21T08:59:10.167 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/.snap/snap-subdir-test 2024-04-21T08:59:10.191 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/30 file after the snapshot 2024-04-21T08:59:10.194 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/31 file after the snapshot 2024-04-21T08:59:10.196 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/32 file after the snapshot 2024-04-21T08:59:10.199 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/33 file after the snapshot 2024-04-21T08:59:10.202 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/34 file after the snapshot 2024-04-21T08:59:10.206 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/35 file after the snapshot 2024-04-21T08:59:10.210 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/36 file after the snapshot 2024-04-21T08:59:10.214 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/37 file after the snapshot 2024-04-21T08:59:10.218 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/38 file after the snapshot 2024-04-21T08:59:10.222 INFO:tasks.workunit.client.0.smithi026.stdout: create 156/39 file after the snapshot 2024-04-21T08:59:10.226 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/.snap/snap-subdir-test 2024-04-21T08:59:10.250 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/30 file after the snapshot 2024-04-21T08:59:10.254 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/31 file after the snapshot 2024-04-21T08:59:10.258 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/32 file after the snapshot 2024-04-21T08:59:10.262 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/33 file after the snapshot 2024-04-21T08:59:10.265 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/34 file after the snapshot 2024-04-21T08:59:10.269 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/35 file after the snapshot 2024-04-21T08:59:10.273 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/36 file after the snapshot 2024-04-21T08:59:10.276 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/37 file after the snapshot 2024-04-21T08:59:10.279 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/38 file after the snapshot 2024-04-21T08:59:10.283 INFO:tasks.workunit.client.0.smithi026.stdout: create 157/39 file after the snapshot 2024-04-21T08:59:10.287 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/.snap/snap-subdir-test 2024-04-21T08:59:10.320 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/30 file after the snapshot 2024-04-21T08:59:10.623 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/31 file after the snapshot 2024-04-21T08:59:10.627 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/32 file after the snapshot 2024-04-21T08:59:10.632 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/33 file after the snapshot 2024-04-21T08:59:10.637 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/34 file after the snapshot 2024-04-21T08:59:10.642 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/35 file after the snapshot 2024-04-21T08:59:10.647 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/36 file after the snapshot 2024-04-21T08:59:10.652 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/37 file after the snapshot 2024-04-21T08:59:10.657 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/38 file after the snapshot 2024-04-21T08:59:10.662 INFO:tasks.workunit.client.0.smithi026.stdout: create 158/39 file after the snapshot 2024-04-21T08:59:10.666 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/.snap/snap-subdir-test 2024-04-21T08:59:10.737 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/30 file after the snapshot 2024-04-21T08:59:10.742 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/31 file after the snapshot 2024-04-21T08:59:10.745 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/32 file after the snapshot 2024-04-21T08:59:10.750 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/33 file after the snapshot 2024-04-21T08:59:10.754 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/34 file after the snapshot 2024-04-21T08:59:10.759 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/35 file after the snapshot 2024-04-21T08:59:10.763 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/36 file after the snapshot 2024-04-21T08:59:10.767 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/37 file after the snapshot 2024-04-21T08:59:10.772 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/38 file after the snapshot 2024-04-21T08:59:10.776 INFO:tasks.workunit.client.0.smithi026.stdout: create 159/39 file after the snapshot 2024-04-21T08:59:10.781 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/.snap/snap-subdir-test 2024-04-21T08:59:10.810 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/30 file after the snapshot 2024-04-21T08:59:10.814 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/31 file after the snapshot 2024-04-21T08:59:10.818 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/32 file after the snapshot 2024-04-21T08:59:10.823 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/33 file after the snapshot 2024-04-21T08:59:10.827 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/34 file after the snapshot 2024-04-21T08:59:10.831 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/35 file after the snapshot 2024-04-21T08:59:10.835 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/36 file after the snapshot 2024-04-21T08:59:10.840 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/37 file after the snapshot 2024-04-21T08:59:10.845 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/38 file after the snapshot 2024-04-21T08:59:10.849 INFO:tasks.workunit.client.0.smithi026.stdout: create 160/39 file after the snapshot 2024-04-21T08:59:10.853 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/.snap/snap-subdir-test 2024-04-21T08:59:10.889 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/30 file after the snapshot 2024-04-21T08:59:10.893 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/31 file after the snapshot 2024-04-21T08:59:10.898 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/32 file after the snapshot 2024-04-21T08:59:10.901 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/33 file after the snapshot 2024-04-21T08:59:10.905 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/34 file after the snapshot 2024-04-21T08:59:10.910 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/35 file after the snapshot 2024-04-21T08:59:10.914 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/36 file after the snapshot 2024-04-21T08:59:10.919 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/37 file after the snapshot 2024-04-21T08:59:10.923 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/38 file after the snapshot 2024-04-21T08:59:10.926 INFO:tasks.workunit.client.0.smithi026.stdout: create 161/39 file after the snapshot 2024-04-21T08:59:10.929 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/.snap/snap-subdir-test 2024-04-21T08:59:10.959 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/30 file after the snapshot 2024-04-21T08:59:10.963 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/31 file after the snapshot 2024-04-21T08:59:10.969 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/32 file after the snapshot 2024-04-21T08:59:10.974 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/33 file after the snapshot 2024-04-21T08:59:10.978 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/34 file after the snapshot 2024-04-21T08:59:10.982 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/35 file after the snapshot 2024-04-21T08:59:10.987 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/36 file after the snapshot 2024-04-21T08:59:10.990 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/37 file after the snapshot 2024-04-21T08:59:10.995 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/38 file after the snapshot 2024-04-21T08:59:11.001 INFO:tasks.workunit.client.0.smithi026.stdout: create 162/39 file after the snapshot 2024-04-21T08:59:11.005 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/.snap/snap-subdir-test 2024-04-21T08:59:11.032 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/30 file after the snapshot 2024-04-21T08:59:11.036 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/31 file after the snapshot 2024-04-21T08:59:11.041 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/32 file after the snapshot 2024-04-21T08:59:11.045 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/33 file after the snapshot 2024-04-21T08:59:11.048 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/34 file after the snapshot 2024-04-21T08:59:11.052 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/35 file after the snapshot 2024-04-21T08:59:11.056 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/36 file after the snapshot 2024-04-21T08:59:11.060 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/37 file after the snapshot 2024-04-21T08:59:11.064 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/38 file after the snapshot 2024-04-21T08:59:11.069 INFO:tasks.workunit.client.0.smithi026.stdout: create 163/39 file after the snapshot 2024-04-21T08:59:11.073 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/.snap/snap-subdir-test 2024-04-21T08:59:11.101 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/30 file after the snapshot 2024-04-21T08:59:11.106 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/31 file after the snapshot 2024-04-21T08:59:11.111 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/32 file after the snapshot 2024-04-21T08:59:11.116 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/33 file after the snapshot 2024-04-21T08:59:11.120 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/34 file after the snapshot 2024-04-21T08:59:11.124 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/35 file after the snapshot 2024-04-21T08:59:11.128 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/36 file after the snapshot 2024-04-21T08:59:11.133 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/37 file after the snapshot 2024-04-21T08:59:11.137 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/38 file after the snapshot 2024-04-21T08:59:11.140 INFO:tasks.workunit.client.0.smithi026.stdout: create 164/39 file after the snapshot 2024-04-21T08:59:11.144 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/.snap/snap-subdir-test 2024-04-21T08:59:11.172 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/30 file after the snapshot 2024-04-21T08:59:11.176 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/31 file after the snapshot 2024-04-21T08:59:11.180 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/32 file after the snapshot 2024-04-21T08:59:11.184 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/33 file after the snapshot 2024-04-21T08:59:11.188 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/34 file after the snapshot 2024-04-21T08:59:11.191 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/35 file after the snapshot 2024-04-21T08:59:11.195 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/36 file after the snapshot 2024-04-21T08:59:11.199 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/37 file after the snapshot 2024-04-21T08:59:11.202 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/38 file after the snapshot 2024-04-21T08:59:11.205 INFO:tasks.workunit.client.0.smithi026.stdout: create 165/39 file after the snapshot 2024-04-21T08:59:11.210 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/.snap/snap-subdir-test 2024-04-21T08:59:11.236 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/30 file after the snapshot 2024-04-21T08:59:11.239 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/31 file after the snapshot 2024-04-21T08:59:11.243 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/32 file after the snapshot 2024-04-21T08:59:11.246 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/33 file after the snapshot 2024-04-21T08:59:11.251 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/34 file after the snapshot 2024-04-21T08:59:11.255 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/35 file after the snapshot 2024-04-21T08:59:11.259 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/36 file after the snapshot 2024-04-21T08:59:11.264 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/37 file after the snapshot 2024-04-21T08:59:11.268 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/38 file after the snapshot 2024-04-21T08:59:11.272 INFO:tasks.workunit.client.0.smithi026.stdout: create 166/39 file after the snapshot 2024-04-21T08:59:11.276 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/.snap/snap-subdir-test 2024-04-21T08:59:11.301 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/30 file after the snapshot 2024-04-21T08:59:11.304 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/31 file after the snapshot 2024-04-21T08:59:11.309 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/32 file after the snapshot 2024-04-21T08:59:11.313 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/33 file after the snapshot 2024-04-21T08:59:11.317 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/34 file after the snapshot 2024-04-21T08:59:11.449 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/35 file after the snapshot 2024-04-21T08:59:11.453 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/36 file after the snapshot 2024-04-21T08:59:11.457 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/37 file after the snapshot 2024-04-21T08:59:11.462 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/38 file after the snapshot 2024-04-21T08:59:11.466 INFO:tasks.workunit.client.0.smithi026.stdout: create 167/39 file after the snapshot 2024-04-21T08:59:11.470 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/.snap/snap-subdir-test 2024-04-21T08:59:11.582 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/30 file after the snapshot 2024-04-21T08:59:11.586 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/31 file after the snapshot 2024-04-21T08:59:11.591 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/32 file after the snapshot 2024-04-21T08:59:11.594 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/33 file after the snapshot 2024-04-21T08:59:11.598 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/34 file after the snapshot 2024-04-21T08:59:11.602 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/35 file after the snapshot 2024-04-21T08:59:11.607 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/36 file after the snapshot 2024-04-21T08:59:11.611 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/37 file after the snapshot 2024-04-21T08:59:11.614 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/38 file after the snapshot 2024-04-21T08:59:11.618 INFO:tasks.workunit.client.0.smithi026.stdout: create 168/39 file after the snapshot 2024-04-21T08:59:11.622 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/.snap/snap-subdir-test 2024-04-21T08:59:11.651 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/30 file after the snapshot 2024-04-21T08:59:11.655 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/31 file after the snapshot 2024-04-21T08:59:11.660 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/32 file after the snapshot 2024-04-21T08:59:11.664 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/33 file after the snapshot 2024-04-21T08:59:11.668 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/34 file after the snapshot 2024-04-21T08:59:11.672 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/35 file after the snapshot 2024-04-21T08:59:11.677 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/36 file after the snapshot 2024-04-21T08:59:11.682 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/37 file after the snapshot 2024-04-21T08:59:11.687 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/38 file after the snapshot 2024-04-21T08:59:11.692 INFO:tasks.workunit.client.0.smithi026.stdout: create 169/39 file after the snapshot 2024-04-21T08:59:11.696 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/.snap/snap-subdir-test 2024-04-21T08:59:11.724 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/30 file after the snapshot 2024-04-21T08:59:11.728 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/31 file after the snapshot 2024-04-21T08:59:11.732 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/32 file after the snapshot 2024-04-21T08:59:11.737 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/33 file after the snapshot 2024-04-21T08:59:11.741 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/34 file after the snapshot 2024-04-21T08:59:11.745 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/35 file after the snapshot 2024-04-21T08:59:11.750 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/36 file after the snapshot 2024-04-21T08:59:11.755 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/37 file after the snapshot 2024-04-21T08:59:11.759 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/38 file after the snapshot 2024-04-21T08:59:11.763 INFO:tasks.workunit.client.0.smithi026.stdout: create 170/39 file after the snapshot 2024-04-21T08:59:11.768 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/.snap/snap-subdir-test 2024-04-21T08:59:11.798 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/30 file after the snapshot 2024-04-21T08:59:11.803 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/31 file after the snapshot 2024-04-21T08:59:11.808 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/32 file after the snapshot 2024-04-21T08:59:11.814 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/33 file after the snapshot 2024-04-21T08:59:11.818 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/34 file after the snapshot 2024-04-21T08:59:11.822 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/35 file after the snapshot 2024-04-21T08:59:11.826 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/36 file after the snapshot 2024-04-21T08:59:11.830 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/37 file after the snapshot 2024-04-21T08:59:11.834 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/38 file after the snapshot 2024-04-21T08:59:11.837 INFO:tasks.workunit.client.0.smithi026.stdout: create 171/39 file after the snapshot 2024-04-21T08:59:11.842 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/.snap/snap-subdir-test 2024-04-21T08:59:11.878 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/30 file after the snapshot 2024-04-21T08:59:11.882 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/31 file after the snapshot 2024-04-21T08:59:11.886 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/32 file after the snapshot 2024-04-21T08:59:11.890 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/33 file after the snapshot 2024-04-21T08:59:11.894 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/34 file after the snapshot 2024-04-21T08:59:11.898 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/35 file after the snapshot 2024-04-21T08:59:11.903 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/36 file after the snapshot 2024-04-21T08:59:11.907 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/37 file after the snapshot 2024-04-21T08:59:11.910 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/38 file after the snapshot 2024-04-21T08:59:11.915 INFO:tasks.workunit.client.0.smithi026.stdout: create 172/39 file after the snapshot 2024-04-21T08:59:11.919 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/.snap/snap-subdir-test 2024-04-21T08:59:11.953 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/30 file after the snapshot 2024-04-21T08:59:11.957 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/31 file after the snapshot 2024-04-21T08:59:11.961 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/32 file after the snapshot 2024-04-21T08:59:11.966 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/33 file after the snapshot 2024-04-21T08:59:11.969 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/34 file after the snapshot 2024-04-21T08:59:11.973 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/35 file after the snapshot 2024-04-21T08:59:11.978 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/36 file after the snapshot 2024-04-21T08:59:11.982 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/37 file after the snapshot 2024-04-21T08:59:11.986 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/38 file after the snapshot 2024-04-21T08:59:11.991 INFO:tasks.workunit.client.0.smithi026.stdout: create 173/39 file after the snapshot 2024-04-21T08:59:11.995 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/.snap/snap-subdir-test 2024-04-21T08:59:12.020 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/30 file after the snapshot 2024-04-21T08:59:12.023 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/31 file after the snapshot 2024-04-21T08:59:12.027 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/32 file after the snapshot 2024-04-21T08:59:12.031 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/33 file after the snapshot 2024-04-21T08:59:12.035 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/34 file after the snapshot 2024-04-21T08:59:12.038 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/35 file after the snapshot 2024-04-21T08:59:12.042 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/36 file after the snapshot 2024-04-21T08:59:12.046 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/37 file after the snapshot 2024-04-21T08:59:12.050 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/38 file after the snapshot 2024-04-21T08:59:12.054 INFO:tasks.workunit.client.0.smithi026.stdout: create 174/39 file after the snapshot 2024-04-21T08:59:12.058 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/.snap/snap-subdir-test 2024-04-21T08:59:12.083 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/30 file after the snapshot 2024-04-21T08:59:12.087 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/31 file after the snapshot 2024-04-21T08:59:12.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/32 file after the snapshot 2024-04-21T08:59:12.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/33 file after the snapshot 2024-04-21T08:59:12.098 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/34 file after the snapshot 2024-04-21T08:59:12.102 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/35 file after the snapshot 2024-04-21T08:59:12.106 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/36 file after the snapshot 2024-04-21T08:59:12.110 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/37 file after the snapshot 2024-04-21T08:59:12.114 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/38 file after the snapshot 2024-04-21T08:59:12.119 INFO:tasks.workunit.client.0.smithi026.stdout: create 175/39 file after the snapshot 2024-04-21T08:59:12.123 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/.snap/snap-subdir-test 2024-04-21T08:59:12.158 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/30 file after the snapshot 2024-04-21T08:59:12.162 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/31 file after the snapshot 2024-04-21T08:59:12.165 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/32 file after the snapshot 2024-04-21T08:59:12.169 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/33 file after the snapshot 2024-04-21T08:59:12.173 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/34 file after the snapshot 2024-04-21T08:59:12.177 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/35 file after the snapshot 2024-04-21T08:59:12.181 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/36 file after the snapshot 2024-04-21T08:59:12.185 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/37 file after the snapshot 2024-04-21T08:59:12.189 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/38 file after the snapshot 2024-04-21T08:59:12.194 INFO:tasks.workunit.client.0.smithi026.stdout: create 176/39 file after the snapshot 2024-04-21T08:59:12.199 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/.snap/snap-subdir-test 2024-04-21T08:59:12.225 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/30 file after the snapshot 2024-04-21T08:59:12.229 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/31 file after the snapshot 2024-04-21T08:59:12.233 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/32 file after the snapshot 2024-04-21T08:59:12.237 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/33 file after the snapshot 2024-04-21T08:59:12.241 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/34 file after the snapshot 2024-04-21T08:59:12.245 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/35 file after the snapshot 2024-04-21T08:59:12.249 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/36 file after the snapshot 2024-04-21T08:59:12.253 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/37 file after the snapshot 2024-04-21T08:59:12.256 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/38 file after the snapshot 2024-04-21T08:59:12.261 INFO:tasks.workunit.client.0.smithi026.stdout: create 177/39 file after the snapshot 2024-04-21T08:59:12.264 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/.snap/snap-subdir-test 2024-04-21T08:59:12.297 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/30 file after the snapshot 2024-04-21T08:59:12.301 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/31 file after the snapshot 2024-04-21T08:59:12.305 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/32 file after the snapshot 2024-04-21T08:59:12.309 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/33 file after the snapshot 2024-04-21T08:59:12.314 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/34 file after the snapshot 2024-04-21T08:59:12.318 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/35 file after the snapshot 2024-04-21T08:59:12.322 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/36 file after the snapshot 2024-04-21T08:59:12.326 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/37 file after the snapshot 2024-04-21T08:59:12.336 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/38 file after the snapshot 2024-04-21T08:59:12.425 INFO:tasks.workunit.client.0.smithi026.stdout: create 178/39 file after the snapshot 2024-04-21T08:59:12.429 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/.snap/snap-subdir-test 2024-04-21T08:59:12.535 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/30 file after the snapshot 2024-04-21T08:59:12.540 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/31 file after the snapshot 2024-04-21T08:59:12.545 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/32 file after the snapshot 2024-04-21T08:59:12.550 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/33 file after the snapshot 2024-04-21T08:59:12.555 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/34 file after the snapshot 2024-04-21T08:59:12.559 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/35 file after the snapshot 2024-04-21T08:59:12.564 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/36 file after the snapshot 2024-04-21T08:59:12.571 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/37 file after the snapshot 2024-04-21T08:59:12.576 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/38 file after the snapshot 2024-04-21T08:59:12.582 INFO:tasks.workunit.client.0.smithi026.stdout: create 179/39 file after the snapshot 2024-04-21T08:59:12.587 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/.snap/snap-subdir-test 2024-04-21T08:59:12.612 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/30 file after the snapshot 2024-04-21T08:59:12.615 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/31 file after the snapshot 2024-04-21T08:59:12.619 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/32 file after the snapshot 2024-04-21T08:59:12.623 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/33 file after the snapshot 2024-04-21T08:59:12.627 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/34 file after the snapshot 2024-04-21T08:59:12.630 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/35 file after the snapshot 2024-04-21T08:59:12.635 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/36 file after the snapshot 2024-04-21T08:59:12.639 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/37 file after the snapshot 2024-04-21T08:59:12.643 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/38 file after the snapshot 2024-04-21T08:59:12.648 INFO:tasks.workunit.client.0.smithi026.stdout: create 180/39 file after the snapshot 2024-04-21T08:59:12.652 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/.snap/snap-subdir-test 2024-04-21T08:59:12.681 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/30 file after the snapshot 2024-04-21T08:59:12.685 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/31 file after the snapshot 2024-04-21T08:59:12.689 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/32 file after the snapshot 2024-04-21T08:59:12.693 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/33 file after the snapshot 2024-04-21T08:59:12.698 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/34 file after the snapshot 2024-04-21T08:59:12.703 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/35 file after the snapshot 2024-04-21T08:59:12.708 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/36 file after the snapshot 2024-04-21T08:59:12.713 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/37 file after the snapshot 2024-04-21T08:59:12.719 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/38 file after the snapshot 2024-04-21T08:59:12.724 INFO:tasks.workunit.client.0.smithi026.stdout: create 181/39 file after the snapshot 2024-04-21T08:59:12.728 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/.snap/snap-subdir-test 2024-04-21T08:59:12.755 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/30 file after the snapshot 2024-04-21T08:59:12.759 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/31 file after the snapshot 2024-04-21T08:59:12.763 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/32 file after the snapshot 2024-04-21T08:59:12.767 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/33 file after the snapshot 2024-04-21T08:59:12.771 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/34 file after the snapshot 2024-04-21T08:59:12.775 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/35 file after the snapshot 2024-04-21T08:59:12.778 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/36 file after the snapshot 2024-04-21T08:59:12.783 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/37 file after the snapshot 2024-04-21T08:59:12.787 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/38 file after the snapshot 2024-04-21T08:59:12.791 INFO:tasks.workunit.client.0.smithi026.stdout: create 182/39 file after the snapshot 2024-04-21T08:59:12.796 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/.snap/snap-subdir-test 2024-04-21T08:59:12.829 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/30 file after the snapshot 2024-04-21T08:59:12.833 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/31 file after the snapshot 2024-04-21T08:59:12.837 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/32 file after the snapshot 2024-04-21T08:59:12.841 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/33 file after the snapshot 2024-04-21T08:59:12.845 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/34 file after the snapshot 2024-04-21T08:59:12.849 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/35 file after the snapshot 2024-04-21T08:59:12.853 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/36 file after the snapshot 2024-04-21T08:59:12.857 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/37 file after the snapshot 2024-04-21T08:59:12.861 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/38 file after the snapshot 2024-04-21T08:59:12.865 INFO:tasks.workunit.client.0.smithi026.stdout: create 183/39 file after the snapshot 2024-04-21T08:59:12.871 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/.snap/snap-subdir-test 2024-04-21T08:59:12.900 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/30 file after the snapshot 2024-04-21T08:59:12.905 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/31 file after the snapshot 2024-04-21T08:59:12.910 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/32 file after the snapshot 2024-04-21T08:59:12.913 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/33 file after the snapshot 2024-04-21T08:59:12.917 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/34 file after the snapshot 2024-04-21T08:59:12.921 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/35 file after the snapshot 2024-04-21T08:59:12.925 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/36 file after the snapshot 2024-04-21T08:59:12.930 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/37 file after the snapshot 2024-04-21T08:59:12.935 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/38 file after the snapshot 2024-04-21T08:59:12.939 INFO:tasks.workunit.client.0.smithi026.stdout: create 184/39 file after the snapshot 2024-04-21T08:59:12.944 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/.snap/snap-subdir-test 2024-04-21T08:59:12.979 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/30 file after the snapshot 2024-04-21T08:59:12.983 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/31 file after the snapshot 2024-04-21T08:59:12.986 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/32 file after the snapshot 2024-04-21T08:59:12.990 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/33 file after the snapshot 2024-04-21T08:59:12.995 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/34 file after the snapshot 2024-04-21T08:59:13.000 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/35 file after the snapshot 2024-04-21T08:59:13.005 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/36 file after the snapshot 2024-04-21T08:59:13.009 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/37 file after the snapshot 2024-04-21T08:59:13.013 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/38 file after the snapshot 2024-04-21T08:59:13.018 INFO:tasks.workunit.client.0.smithi026.stdout: create 185/39 file after the snapshot 2024-04-21T08:59:13.021 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/.snap/snap-subdir-test 2024-04-21T08:59:13.048 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/30 file after the snapshot 2024-04-21T08:59:13.051 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/31 file after the snapshot 2024-04-21T08:59:13.057 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/32 file after the snapshot 2024-04-21T08:59:13.062 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/33 file after the snapshot 2024-04-21T08:59:13.066 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/34 file after the snapshot 2024-04-21T08:59:13.070 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/35 file after the snapshot 2024-04-21T08:59:13.075 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/36 file after the snapshot 2024-04-21T08:59:13.080 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/37 file after the snapshot 2024-04-21T08:59:13.085 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/38 file after the snapshot 2024-04-21T08:59:13.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 186/39 file after the snapshot 2024-04-21T08:59:13.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/.snap/snap-subdir-test 2024-04-21T08:59:13.120 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/30 file after the snapshot 2024-04-21T08:59:13.123 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/31 file after the snapshot 2024-04-21T08:59:13.127 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/32 file after the snapshot 2024-04-21T08:59:13.132 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/33 file after the snapshot 2024-04-21T08:59:13.136 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/34 file after the snapshot 2024-04-21T08:59:13.141 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/35 file after the snapshot 2024-04-21T08:59:13.145 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/36 file after the snapshot 2024-04-21T08:59:13.149 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/37 file after the snapshot 2024-04-21T08:59:13.153 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/38 file after the snapshot 2024-04-21T08:59:13.158 INFO:tasks.workunit.client.0.smithi026.stdout: create 187/39 file after the snapshot 2024-04-21T08:59:13.162 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/.snap/snap-subdir-test 2024-04-21T08:59:13.196 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/30 file after the snapshot 2024-04-21T08:59:13.199 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/31 file after the snapshot 2024-04-21T08:59:13.204 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/32 file after the snapshot 2024-04-21T08:59:13.208 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/33 file after the snapshot 2024-04-21T08:59:13.212 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/34 file after the snapshot 2024-04-21T08:59:13.217 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/35 file after the snapshot 2024-04-21T08:59:13.220 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/36 file after the snapshot 2024-04-21T08:59:13.224 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/37 file after the snapshot 2024-04-21T08:59:13.229 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/38 file after the snapshot 2024-04-21T08:59:13.233 INFO:tasks.workunit.client.0.smithi026.stdout: create 188/39 file after the snapshot 2024-04-21T08:59:13.238 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/.snap/snap-subdir-test 2024-04-21T08:59:13.266 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/30 file after the snapshot 2024-04-21T08:59:13.270 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/31 file after the snapshot 2024-04-21T08:59:13.275 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/32 file after the snapshot 2024-04-21T08:59:13.279 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/33 file after the snapshot 2024-04-21T08:59:13.283 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/34 file after the snapshot 2024-04-21T08:59:13.287 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/35 file after the snapshot 2024-04-21T08:59:13.292 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/36 file after the snapshot 2024-04-21T08:59:13.296 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/37 file after the snapshot 2024-04-21T08:59:13.300 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/38 file after the snapshot 2024-04-21T08:59:13.305 INFO:tasks.workunit.client.0.smithi026.stdout: create 189/39 file after the snapshot 2024-04-21T08:59:13.310 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/.snap/snap-subdir-test 2024-04-21T08:59:13.347 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/30 file after the snapshot 2024-04-21T08:59:13.447 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/31 file after the snapshot 2024-04-21T08:59:13.451 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/32 file after the snapshot 2024-04-21T08:59:13.455 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/33 file after the snapshot 2024-04-21T08:59:13.460 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/34 file after the snapshot 2024-04-21T08:59:13.464 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/35 file after the snapshot 2024-04-21T08:59:13.468 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/36 file after the snapshot 2024-04-21T08:59:13.472 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/37 file after the snapshot 2024-04-21T08:59:13.478 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/38 file after the snapshot 2024-04-21T08:59:13.483 INFO:tasks.workunit.client.0.smithi026.stdout: create 190/39 file after the snapshot 2024-04-21T08:59:13.487 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/.snap/snap-subdir-test 2024-04-21T08:59:13.582 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/30 file after the snapshot 2024-04-21T08:59:13.586 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/31 file after the snapshot 2024-04-21T08:59:13.592 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/32 file after the snapshot 2024-04-21T08:59:13.598 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/33 file after the snapshot 2024-04-21T08:59:13.603 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/34 file after the snapshot 2024-04-21T08:59:13.608 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/35 file after the snapshot 2024-04-21T08:59:13.614 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/36 file after the snapshot 2024-04-21T08:59:13.620 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/37 file after the snapshot 2024-04-21T08:59:13.624 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/38 file after the snapshot 2024-04-21T08:59:13.629 INFO:tasks.workunit.client.0.smithi026.stdout: create 191/39 file after the snapshot 2024-04-21T08:59:13.632 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/.snap/snap-subdir-test 2024-04-21T08:59:13.659 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/30 file after the snapshot 2024-04-21T08:59:13.663 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/31 file after the snapshot 2024-04-21T08:59:13.668 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/32 file after the snapshot 2024-04-21T08:59:13.672 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/33 file after the snapshot 2024-04-21T08:59:13.677 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/34 file after the snapshot 2024-04-21T08:59:13.681 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/35 file after the snapshot 2024-04-21T08:59:13.685 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/36 file after the snapshot 2024-04-21T08:59:13.689 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/37 file after the snapshot 2024-04-21T08:59:13.693 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/38 file after the snapshot 2024-04-21T08:59:13.699 INFO:tasks.workunit.client.0.smithi026.stdout: create 192/39 file after the snapshot 2024-04-21T08:59:13.702 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/.snap/snap-subdir-test 2024-04-21T08:59:13.733 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/30 file after the snapshot 2024-04-21T08:59:13.737 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/31 file after the snapshot 2024-04-21T08:59:13.741 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/32 file after the snapshot 2024-04-21T08:59:13.746 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/33 file after the snapshot 2024-04-21T08:59:13.750 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/34 file after the snapshot 2024-04-21T08:59:13.755 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/35 file after the snapshot 2024-04-21T08:59:13.761 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/36 file after the snapshot 2024-04-21T08:59:13.766 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/37 file after the snapshot 2024-04-21T08:59:13.771 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/38 file after the snapshot 2024-04-21T08:59:13.775 INFO:tasks.workunit.client.0.smithi026.stdout: create 193/39 file after the snapshot 2024-04-21T08:59:13.781 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/.snap/snap-subdir-test 2024-04-21T08:59:13.810 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/30 file after the snapshot 2024-04-21T08:59:13.815 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/31 file after the snapshot 2024-04-21T08:59:13.820 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/32 file after the snapshot 2024-04-21T08:59:13.825 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/33 file after the snapshot 2024-04-21T08:59:13.829 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/34 file after the snapshot 2024-04-21T08:59:13.833 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/35 file after the snapshot 2024-04-21T08:59:13.838 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/36 file after the snapshot 2024-04-21T08:59:13.842 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/37 file after the snapshot 2024-04-21T08:59:13.846 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/38 file after the snapshot 2024-04-21T08:59:13.849 INFO:tasks.workunit.client.0.smithi026.stdout: create 194/39 file after the snapshot 2024-04-21T08:59:13.854 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/.snap/snap-subdir-test 2024-04-21T08:59:13.881 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/30 file after the snapshot 2024-04-21T08:59:13.885 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/31 file after the snapshot 2024-04-21T08:59:13.888 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/32 file after the snapshot 2024-04-21T08:59:13.892 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/33 file after the snapshot 2024-04-21T08:59:13.895 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/34 file after the snapshot 2024-04-21T08:59:13.899 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/35 file after the snapshot 2024-04-21T08:59:13.903 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/36 file after the snapshot 2024-04-21T08:59:13.910 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/37 file after the snapshot 2024-04-21T08:59:13.912 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/38 file after the snapshot 2024-04-21T08:59:13.916 INFO:tasks.workunit.client.0.smithi026.stdout: create 195/39 file after the snapshot 2024-04-21T08:59:13.920 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/.snap/snap-subdir-test 2024-04-21T08:59:13.945 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/30 file after the snapshot 2024-04-21T08:59:13.948 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/31 file after the snapshot 2024-04-21T08:59:13.952 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/32 file after the snapshot 2024-04-21T08:59:13.956 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/33 file after the snapshot 2024-04-21T08:59:13.960 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/34 file after the snapshot 2024-04-21T08:59:13.963 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/35 file after the snapshot 2024-04-21T08:59:13.968 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/36 file after the snapshot 2024-04-21T08:59:13.971 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/37 file after the snapshot 2024-04-21T08:59:13.975 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/38 file after the snapshot 2024-04-21T08:59:13.978 INFO:tasks.workunit.client.0.smithi026.stdout: create 196/39 file after the snapshot 2024-04-21T08:59:13.982 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/.snap/snap-subdir-test 2024-04-21T08:59:14.008 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/30 file after the snapshot 2024-04-21T08:59:14.012 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/31 file after the snapshot 2024-04-21T08:59:14.016 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/32 file after the snapshot 2024-04-21T08:59:14.020 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/33 file after the snapshot 2024-04-21T08:59:14.024 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/34 file after the snapshot 2024-04-21T08:59:14.029 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/35 file after the snapshot 2024-04-21T08:59:14.032 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/36 file after the snapshot 2024-04-21T08:59:14.036 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/37 file after the snapshot 2024-04-21T08:59:14.040 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/38 file after the snapshot 2024-04-21T08:59:14.044 INFO:tasks.workunit.client.0.smithi026.stdout: create 197/39 file after the snapshot 2024-04-21T08:59:14.048 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/.snap/snap-subdir-test 2024-04-21T08:59:14.075 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/30 file after the snapshot 2024-04-21T08:59:14.078 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/31 file after the snapshot 2024-04-21T08:59:14.082 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/32 file after the snapshot 2024-04-21T08:59:14.086 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/33 file after the snapshot 2024-04-21T08:59:14.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/34 file after the snapshot 2024-04-21T08:59:14.093 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/35 file after the snapshot 2024-04-21T08:59:14.097 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/36 file after the snapshot 2024-04-21T08:59:14.101 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/37 file after the snapshot 2024-04-21T08:59:14.104 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/38 file after the snapshot 2024-04-21T08:59:14.108 INFO:tasks.workunit.client.0.smithi026.stdout: create 198/39 file after the snapshot 2024-04-21T08:59:14.112 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/.snap/snap-subdir-test 2024-04-21T08:59:14.139 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/30 file after the snapshot 2024-04-21T08:59:14.143 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/31 file after the snapshot 2024-04-21T08:59:14.147 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/32 file after the snapshot 2024-04-21T08:59:14.151 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/33 file after the snapshot 2024-04-21T08:59:14.155 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/34 file after the snapshot 2024-04-21T08:59:14.159 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/35 file after the snapshot 2024-04-21T08:59:14.163 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/36 file after the snapshot 2024-04-21T08:59:14.168 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/37 file after the snapshot 2024-04-21T08:59:14.172 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/38 file after the snapshot 2024-04-21T08:59:14.177 INFO:tasks.workunit.client.0.smithi026.stdout: create 199/39 file after the snapshot 2024-04-21T08:59:14.181 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/.snap/snap-subdir-test 2024-04-21T08:59:14.216 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/30 file after the snapshot 2024-04-21T08:59:14.220 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/31 file after the snapshot 2024-04-21T08:59:14.224 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/32 file after the snapshot 2024-04-21T08:59:14.228 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/33 file after the snapshot 2024-04-21T08:59:14.232 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/34 file after the snapshot 2024-04-21T08:59:14.236 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/35 file after the snapshot 2024-04-21T08:59:14.241 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/36 file after the snapshot 2024-04-21T08:59:14.245 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/37 file after the snapshot 2024-04-21T08:59:14.249 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/38 file after the snapshot 2024-04-21T08:59:14.253 INFO:tasks.workunit.client.0.smithi026.stdout: create 200/39 file after the snapshot 2024-04-21T08:59:14.257 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/.snap/snap-subdir-test 2024-04-21T08:59:14.283 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/30 file after the snapshot 2024-04-21T08:59:14.286 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/31 file after the snapshot 2024-04-21T08:59:14.290 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/32 file after the snapshot 2024-04-21T08:59:14.295 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/33 file after the snapshot 2024-04-21T08:59:14.298 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/34 file after the snapshot 2024-04-21T08:59:14.302 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/35 file after the snapshot 2024-04-21T08:59:14.306 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/36 file after the snapshot 2024-04-21T08:59:14.310 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/37 file after the snapshot 2024-04-21T08:59:14.314 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/38 file after the snapshot 2024-04-21T08:59:14.317 INFO:tasks.workunit.client.0.smithi026.stdout: create 201/39 file after the snapshot 2024-04-21T08:59:14.321 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/.snap/snap-subdir-test 2024-04-21T08:59:14.357 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/30 file after the snapshot 2024-04-21T08:59:14.473 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/31 file after the snapshot 2024-04-21T08:59:14.477 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/32 file after the snapshot 2024-04-21T08:59:14.482 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/33 file after the snapshot 2024-04-21T08:59:14.486 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/34 file after the snapshot 2024-04-21T08:59:14.491 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/35 file after the snapshot 2024-04-21T08:59:14.495 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/36 file after the snapshot 2024-04-21T08:59:14.499 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/37 file after the snapshot 2024-04-21T08:59:14.504 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/38 file after the snapshot 2024-04-21T08:59:14.509 INFO:tasks.workunit.client.0.smithi026.stdout: create 202/39 file after the snapshot 2024-04-21T08:59:14.514 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/.snap/snap-subdir-test 2024-04-21T08:59:14.594 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/30 file after the snapshot 2024-04-21T08:59:14.598 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/31 file after the snapshot 2024-04-21T08:59:14.603 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/32 file after the snapshot 2024-04-21T08:59:14.608 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/33 file after the snapshot 2024-04-21T08:59:14.613 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/34 file after the snapshot 2024-04-21T08:59:14.617 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/35 file after the snapshot 2024-04-21T08:59:14.622 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/36 file after the snapshot 2024-04-21T08:59:14.626 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/37 file after the snapshot 2024-04-21T08:59:14.631 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/38 file after the snapshot 2024-04-21T08:59:14.635 INFO:tasks.workunit.client.0.smithi026.stdout: create 203/39 file after the snapshot 2024-04-21T08:59:14.640 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/.snap/snap-subdir-test 2024-04-21T08:59:14.666 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/30 file after the snapshot 2024-04-21T08:59:14.671 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/31 file after the snapshot 2024-04-21T08:59:14.676 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/32 file after the snapshot 2024-04-21T08:59:14.679 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/33 file after the snapshot 2024-04-21T08:59:14.683 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/34 file after the snapshot 2024-04-21T08:59:14.686 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/35 file after the snapshot 2024-04-21T08:59:14.690 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/36 file after the snapshot 2024-04-21T08:59:14.694 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/37 file after the snapshot 2024-04-21T08:59:14.698 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/38 file after the snapshot 2024-04-21T08:59:14.701 INFO:tasks.workunit.client.0.smithi026.stdout: create 204/39 file after the snapshot 2024-04-21T08:59:14.705 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/.snap/snap-subdir-test 2024-04-21T08:59:14.734 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/30 file after the snapshot 2024-04-21T08:59:14.737 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/31 file after the snapshot 2024-04-21T08:59:14.741 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/32 file after the snapshot 2024-04-21T08:59:14.745 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/33 file after the snapshot 2024-04-21T08:59:14.749 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/34 file after the snapshot 2024-04-21T08:59:14.753 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/35 file after the snapshot 2024-04-21T08:59:14.757 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/36 file after the snapshot 2024-04-21T08:59:14.760 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/37 file after the snapshot 2024-04-21T08:59:14.765 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/38 file after the snapshot 2024-04-21T08:59:14.769 INFO:tasks.workunit.client.0.smithi026.stdout: create 205/39 file after the snapshot 2024-04-21T08:59:14.773 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/.snap/snap-subdir-test 2024-04-21T08:59:14.800 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/30 file after the snapshot 2024-04-21T08:59:14.804 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/31 file after the snapshot 2024-04-21T08:59:14.808 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/32 file after the snapshot 2024-04-21T08:59:14.812 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/33 file after the snapshot 2024-04-21T08:59:14.816 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/34 file after the snapshot 2024-04-21T08:59:14.820 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/35 file after the snapshot 2024-04-21T08:59:14.825 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/36 file after the snapshot 2024-04-21T08:59:14.828 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/37 file after the snapshot 2024-04-21T08:59:14.832 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/38 file after the snapshot 2024-04-21T08:59:14.836 INFO:tasks.workunit.client.0.smithi026.stdout: create 206/39 file after the snapshot 2024-04-21T08:59:14.840 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/.snap/snap-subdir-test 2024-04-21T08:59:14.867 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/30 file after the snapshot 2024-04-21T08:59:14.870 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/31 file after the snapshot 2024-04-21T08:59:14.874 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/32 file after the snapshot 2024-04-21T08:59:14.877 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/33 file after the snapshot 2024-04-21T08:59:14.881 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/34 file after the snapshot 2024-04-21T08:59:14.885 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/35 file after the snapshot 2024-04-21T08:59:14.890 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/36 file after the snapshot 2024-04-21T08:59:14.893 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/37 file after the snapshot 2024-04-21T08:59:14.897 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/38 file after the snapshot 2024-04-21T08:59:14.901 INFO:tasks.workunit.client.0.smithi026.stdout: create 207/39 file after the snapshot 2024-04-21T08:59:14.905 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/.snap/snap-subdir-test 2024-04-21T08:59:14.933 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/30 file after the snapshot 2024-04-21T08:59:14.937 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/31 file after the snapshot 2024-04-21T08:59:14.941 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/32 file after the snapshot 2024-04-21T08:59:14.945 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/33 file after the snapshot 2024-04-21T08:59:14.950 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/34 file after the snapshot 2024-04-21T08:59:14.954 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/35 file after the snapshot 2024-04-21T08:59:14.960 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/36 file after the snapshot 2024-04-21T08:59:14.965 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/37 file after the snapshot 2024-04-21T08:59:14.970 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/38 file after the snapshot 2024-04-21T08:59:14.974 INFO:tasks.workunit.client.0.smithi026.stdout: create 208/39 file after the snapshot 2024-04-21T08:59:14.980 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/.snap/snap-subdir-test 2024-04-21T08:59:15.012 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/30 file after the snapshot 2024-04-21T08:59:15.017 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/31 file after the snapshot 2024-04-21T08:59:15.021 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/32 file after the snapshot 2024-04-21T08:59:15.027 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/33 file after the snapshot 2024-04-21T08:59:15.032 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/34 file after the snapshot 2024-04-21T08:59:15.036 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/35 file after the snapshot 2024-04-21T08:59:15.041 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/36 file after the snapshot 2024-04-21T08:59:15.045 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/37 file after the snapshot 2024-04-21T08:59:15.050 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/38 file after the snapshot 2024-04-21T08:59:15.054 INFO:tasks.workunit.client.0.smithi026.stdout: create 209/39 file after the snapshot 2024-04-21T08:59:15.058 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/.snap/snap-subdir-test 2024-04-21T08:59:15.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/30 file after the snapshot 2024-04-21T08:59:15.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/31 file after the snapshot 2024-04-21T08:59:15.097 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/32 file after the snapshot 2024-04-21T08:59:15.102 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/33 file after the snapshot 2024-04-21T08:59:15.105 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/34 file after the snapshot 2024-04-21T08:59:15.110 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/35 file after the snapshot 2024-04-21T08:59:15.114 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/36 file after the snapshot 2024-04-21T08:59:15.118 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/37 file after the snapshot 2024-04-21T08:59:15.122 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/38 file after the snapshot 2024-04-21T08:59:15.127 INFO:tasks.workunit.client.0.smithi026.stdout: create 210/39 file after the snapshot 2024-04-21T08:59:15.131 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/.snap/snap-subdir-test 2024-04-21T08:59:15.161 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/30 file after the snapshot 2024-04-21T08:59:15.165 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/31 file after the snapshot 2024-04-21T08:59:15.168 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/32 file after the snapshot 2024-04-21T08:59:15.174 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/33 file after the snapshot 2024-04-21T08:59:15.180 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/34 file after the snapshot 2024-04-21T08:59:15.185 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/35 file after the snapshot 2024-04-21T08:59:15.191 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/36 file after the snapshot 2024-04-21T08:59:15.195 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/37 file after the snapshot 2024-04-21T08:59:15.199 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/38 file after the snapshot 2024-04-21T08:59:15.204 INFO:tasks.workunit.client.0.smithi026.stdout: create 211/39 file after the snapshot 2024-04-21T08:59:15.208 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/.snap/snap-subdir-test 2024-04-21T08:59:15.245 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/30 file after the snapshot 2024-04-21T08:59:15.249 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/31 file after the snapshot 2024-04-21T08:59:15.253 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/32 file after the snapshot 2024-04-21T08:59:15.257 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/33 file after the snapshot 2024-04-21T08:59:15.261 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/34 file after the snapshot 2024-04-21T08:59:15.264 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/35 file after the snapshot 2024-04-21T08:59:15.269 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/36 file after the snapshot 2024-04-21T08:59:15.273 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/37 file after the snapshot 2024-04-21T08:59:15.277 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/38 file after the snapshot 2024-04-21T08:59:15.282 INFO:tasks.workunit.client.0.smithi026.stdout: create 212/39 file after the snapshot 2024-04-21T08:59:15.287 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/.snap/snap-subdir-test 2024-04-21T08:59:15.315 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/30 file after the snapshot 2024-04-21T08:59:15.319 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/31 file after the snapshot 2024-04-21T08:59:15.323 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/32 file after the snapshot 2024-04-21T08:59:15.328 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/33 file after the snapshot 2024-04-21T08:59:15.333 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/34 file after the snapshot 2024-04-21T08:59:15.338 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/35 file after the snapshot 2024-04-21T08:59:15.342 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/36 file after the snapshot 2024-04-21T08:59:15.346 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/37 file after the snapshot 2024-04-21T08:59:15.350 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/38 file after the snapshot 2024-04-21T08:59:15.368 INFO:tasks.workunit.client.0.smithi026.stdout: create 213/39 file after the snapshot 2024-04-21T08:59:15.442 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/.snap/snap-subdir-test 2024-04-21T08:59:15.527 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/30 file after the snapshot 2024-04-21T08:59:15.531 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/31 file after the snapshot 2024-04-21T08:59:15.536 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/32 file after the snapshot 2024-04-21T08:59:15.541 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/33 file after the snapshot 2024-04-21T08:59:15.545 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/34 file after the snapshot 2024-04-21T08:59:15.551 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/35 file after the snapshot 2024-04-21T08:59:15.556 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/36 file after the snapshot 2024-04-21T08:59:15.561 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/37 file after the snapshot 2024-04-21T08:59:15.566 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/38 file after the snapshot 2024-04-21T08:59:15.570 INFO:tasks.workunit.client.0.smithi026.stdout: create 214/39 file after the snapshot 2024-04-21T08:59:15.576 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/.snap/snap-subdir-test 2024-04-21T08:59:15.607 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/30 file after the snapshot 2024-04-21T08:59:15.611 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/31 file after the snapshot 2024-04-21T08:59:15.616 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/32 file after the snapshot 2024-04-21T08:59:15.620 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/33 file after the snapshot 2024-04-21T08:59:15.625 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/34 file after the snapshot 2024-04-21T08:59:15.629 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/35 file after the snapshot 2024-04-21T08:59:15.633 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/36 file after the snapshot 2024-04-21T08:59:15.638 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/37 file after the snapshot 2024-04-21T08:59:15.643 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/38 file after the snapshot 2024-04-21T08:59:15.649 INFO:tasks.workunit.client.0.smithi026.stdout: create 215/39 file after the snapshot 2024-04-21T08:59:15.653 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/.snap/snap-subdir-test 2024-04-21T08:59:15.685 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/30 file after the snapshot 2024-04-21T08:59:15.689 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/31 file after the snapshot 2024-04-21T08:59:15.694 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/32 file after the snapshot 2024-04-21T08:59:15.698 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/33 file after the snapshot 2024-04-21T08:59:15.702 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/34 file after the snapshot 2024-04-21T08:59:15.707 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/35 file after the snapshot 2024-04-21T08:59:15.712 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/36 file after the snapshot 2024-04-21T08:59:15.717 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/37 file after the snapshot 2024-04-21T08:59:15.722 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/38 file after the snapshot 2024-04-21T08:59:15.726 INFO:tasks.workunit.client.0.smithi026.stdout: create 216/39 file after the snapshot 2024-04-21T08:59:15.731 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/.snap/snap-subdir-test 2024-04-21T08:59:15.763 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/30 file after the snapshot 2024-04-21T08:59:15.767 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/31 file after the snapshot 2024-04-21T08:59:15.771 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/32 file after the snapshot 2024-04-21T08:59:15.776 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/33 file after the snapshot 2024-04-21T08:59:15.779 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/34 file after the snapshot 2024-04-21T08:59:15.784 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/35 file after the snapshot 2024-04-21T08:59:15.788 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/36 file after the snapshot 2024-04-21T08:59:15.792 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/37 file after the snapshot 2024-04-21T08:59:15.796 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/38 file after the snapshot 2024-04-21T08:59:15.799 INFO:tasks.workunit.client.0.smithi026.stdout: create 217/39 file after the snapshot 2024-04-21T08:59:15.803 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/.snap/snap-subdir-test 2024-04-21T08:59:15.833 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/30 file after the snapshot 2024-04-21T08:59:15.836 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/31 file after the snapshot 2024-04-21T08:59:15.840 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/32 file after the snapshot 2024-04-21T08:59:15.843 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/33 file after the snapshot 2024-04-21T08:59:15.847 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/34 file after the snapshot 2024-04-21T08:59:15.851 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/35 file after the snapshot 2024-04-21T08:59:15.855 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/36 file after the snapshot 2024-04-21T08:59:15.859 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/37 file after the snapshot 2024-04-21T08:59:15.863 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/38 file after the snapshot 2024-04-21T08:59:15.866 INFO:tasks.workunit.client.0.smithi026.stdout: create 218/39 file after the snapshot 2024-04-21T08:59:15.870 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/.snap/snap-subdir-test 2024-04-21T08:59:15.901 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/30 file after the snapshot 2024-04-21T08:59:15.905 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/31 file after the snapshot 2024-04-21T08:59:15.910 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/32 file after the snapshot 2024-04-21T08:59:15.915 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/33 file after the snapshot 2024-04-21T08:59:15.920 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/34 file after the snapshot 2024-04-21T08:59:15.925 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/35 file after the snapshot 2024-04-21T08:59:15.929 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/36 file after the snapshot 2024-04-21T08:59:15.933 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/37 file after the snapshot 2024-04-21T08:59:15.938 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/38 file after the snapshot 2024-04-21T08:59:15.943 INFO:tasks.workunit.client.0.smithi026.stdout: create 219/39 file after the snapshot 2024-04-21T08:59:15.951 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/.snap/snap-subdir-test 2024-04-21T08:59:15.978 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/30 file after the snapshot 2024-04-21T08:59:15.981 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/31 file after the snapshot 2024-04-21T08:59:15.985 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/32 file after the snapshot 2024-04-21T08:59:15.989 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/33 file after the snapshot 2024-04-21T08:59:15.993 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/34 file after the snapshot 2024-04-21T08:59:15.997 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/35 file after the snapshot 2024-04-21T08:59:16.001 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/36 file after the snapshot 2024-04-21T08:59:16.005 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/37 file after the snapshot 2024-04-21T08:59:16.009 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/38 file after the snapshot 2024-04-21T08:59:16.013 INFO:tasks.workunit.client.0.smithi026.stdout: create 220/39 file after the snapshot 2024-04-21T08:59:16.017 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/.snap/snap-subdir-test 2024-04-21T08:59:16.047 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/30 file after the snapshot 2024-04-21T08:59:16.051 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/31 file after the snapshot 2024-04-21T08:59:16.056 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/32 file after the snapshot 2024-04-21T08:59:16.061 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/33 file after the snapshot 2024-04-21T08:59:16.065 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/34 file after the snapshot 2024-04-21T08:59:16.069 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/35 file after the snapshot 2024-04-21T08:59:16.073 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/36 file after the snapshot 2024-04-21T08:59:16.078 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/37 file after the snapshot 2024-04-21T08:59:16.082 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/38 file after the snapshot 2024-04-21T08:59:16.086 INFO:tasks.workunit.client.0.smithi026.stdout: create 221/39 file after the snapshot 2024-04-21T08:59:16.090 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/.snap/snap-subdir-test 2024-04-21T08:59:16.124 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/30 file after the snapshot 2024-04-21T08:59:16.129 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/31 file after the snapshot 2024-04-21T08:59:16.133 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/32 file after the snapshot 2024-04-21T08:59:16.136 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/33 file after the snapshot 2024-04-21T08:59:16.140 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/34 file after the snapshot 2024-04-21T08:59:16.144 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/35 file after the snapshot 2024-04-21T08:59:16.147 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/36 file after the snapshot 2024-04-21T08:59:16.151 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/37 file after the snapshot 2024-04-21T08:59:16.155 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/38 file after the snapshot 2024-04-21T08:59:16.159 INFO:tasks.workunit.client.0.smithi026.stdout: create 222/39 file after the snapshot 2024-04-21T08:59:16.163 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/.snap/snap-subdir-test 2024-04-21T08:59:16.192 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/30 file after the snapshot 2024-04-21T08:59:16.196 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/31 file after the snapshot 2024-04-21T08:59:16.200 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/32 file after the snapshot 2024-04-21T08:59:16.203 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/33 file after the snapshot 2024-04-21T08:59:16.207 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/34 file after the snapshot 2024-04-21T08:59:16.211 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/35 file after the snapshot 2024-04-21T08:59:16.215 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/36 file after the snapshot 2024-04-21T08:59:16.219 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/37 file after the snapshot 2024-04-21T08:59:16.223 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/38 file after the snapshot 2024-04-21T08:59:16.227 INFO:tasks.workunit.client.0.smithi026.stdout: create 223/39 file after the snapshot 2024-04-21T08:59:16.232 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/.snap/snap-subdir-test 2024-04-21T08:59:16.262 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/30 file after the snapshot 2024-04-21T08:59:16.266 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/31 file after the snapshot 2024-04-21T08:59:16.269 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/32 file after the snapshot 2024-04-21T08:59:16.273 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/33 file after the snapshot 2024-04-21T08:59:16.277 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/34 file after the snapshot 2024-04-21T08:59:16.282 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/35 file after the snapshot 2024-04-21T08:59:16.286 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/36 file after the snapshot 2024-04-21T08:59:16.290 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/37 file after the snapshot 2024-04-21T08:59:16.294 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/38 file after the snapshot 2024-04-21T08:59:16.299 INFO:tasks.workunit.client.0.smithi026.stdout: create 224/39 file after the snapshot 2024-04-21T08:59:16.304 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/.snap/snap-subdir-test 2024-04-21T08:59:16.333 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/30 file after the snapshot 2024-04-21T08:59:16.337 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/31 file after the snapshot 2024-04-21T08:59:16.341 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/32 file after the snapshot 2024-04-21T08:59:16.346 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/33 file after the snapshot 2024-04-21T08:59:16.350 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/34 file after the snapshot 2024-04-21T08:59:16.354 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/35 file after the snapshot 2024-04-21T08:59:16.359 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/36 file after the snapshot 2024-04-21T08:59:16.363 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/37 file after the snapshot 2024-04-21T08:59:16.367 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/38 file after the snapshot 2024-04-21T08:59:16.447 INFO:tasks.workunit.client.0.smithi026.stdout: create 225/39 file after the snapshot 2024-04-21T08:59:16.453 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/.snap/snap-subdir-test 2024-04-21T08:59:16.528 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/30 file after the snapshot 2024-04-21T08:59:16.534 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/31 file after the snapshot 2024-04-21T08:59:16.539 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/32 file after the snapshot 2024-04-21T08:59:16.544 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/33 file after the snapshot 2024-04-21T08:59:16.550 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/34 file after the snapshot 2024-04-21T08:59:16.556 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/35 file after the snapshot 2024-04-21T08:59:16.561 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/36 file after the snapshot 2024-04-21T08:59:16.566 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/37 file after the snapshot 2024-04-21T08:59:16.570 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/38 file after the snapshot 2024-04-21T08:59:16.575 INFO:tasks.workunit.client.0.smithi026.stdout: create 226/39 file after the snapshot 2024-04-21T08:59:16.580 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/.snap/snap-subdir-test 2024-04-21T08:59:16.616 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/30 file after the snapshot 2024-04-21T08:59:16.620 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/31 file after the snapshot 2024-04-21T08:59:16.624 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/32 file after the snapshot 2024-04-21T08:59:16.628 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/33 file after the snapshot 2024-04-21T08:59:16.632 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/34 file after the snapshot 2024-04-21T08:59:16.636 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/35 file after the snapshot 2024-04-21T08:59:16.640 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/36 file after the snapshot 2024-04-21T08:59:16.644 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/37 file after the snapshot 2024-04-21T08:59:16.648 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/38 file after the snapshot 2024-04-21T08:59:16.653 INFO:tasks.workunit.client.0.smithi026.stdout: create 227/39 file after the snapshot 2024-04-21T08:59:16.656 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/.snap/snap-subdir-test 2024-04-21T08:59:16.695 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/30 file after the snapshot 2024-04-21T08:59:16.699 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/31 file after the snapshot 2024-04-21T08:59:16.703 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/32 file after the snapshot 2024-04-21T08:59:16.707 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/33 file after the snapshot 2024-04-21T08:59:16.712 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/34 file after the snapshot 2024-04-21T08:59:16.715 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/35 file after the snapshot 2024-04-21T08:59:16.720 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/36 file after the snapshot 2024-04-21T08:59:16.724 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/37 file after the snapshot 2024-04-21T08:59:16.728 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/38 file after the snapshot 2024-04-21T08:59:16.732 INFO:tasks.workunit.client.0.smithi026.stdout: create 228/39 file after the snapshot 2024-04-21T08:59:16.736 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/.snap/snap-subdir-test 2024-04-21T08:59:16.765 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/30 file after the snapshot 2024-04-21T08:59:16.769 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/31 file after the snapshot 2024-04-21T08:59:16.773 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/32 file after the snapshot 2024-04-21T08:59:16.777 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/33 file after the snapshot 2024-04-21T08:59:16.782 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/34 file after the snapshot 2024-04-21T08:59:16.786 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/35 file after the snapshot 2024-04-21T08:59:16.789 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/36 file after the snapshot 2024-04-21T08:59:16.793 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/37 file after the snapshot 2024-04-21T08:59:16.797 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/38 file after the snapshot 2024-04-21T08:59:16.801 INFO:tasks.workunit.client.0.smithi026.stdout: create 229/39 file after the snapshot 2024-04-21T08:59:16.805 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/.snap/snap-subdir-test 2024-04-21T08:59:16.835 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/30 file after the snapshot 2024-04-21T08:59:16.839 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/31 file after the snapshot 2024-04-21T08:59:16.843 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/32 file after the snapshot 2024-04-21T08:59:16.846 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/33 file after the snapshot 2024-04-21T08:59:16.850 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/34 file after the snapshot 2024-04-21T08:59:16.853 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/35 file after the snapshot 2024-04-21T08:59:16.857 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/36 file after the snapshot 2024-04-21T08:59:16.861 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/37 file after the snapshot 2024-04-21T08:59:16.865 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/38 file after the snapshot 2024-04-21T08:59:16.869 INFO:tasks.workunit.client.0.smithi026.stdout: create 230/39 file after the snapshot 2024-04-21T08:59:16.873 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/.snap/snap-subdir-test 2024-04-21T08:59:16.904 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/30 file after the snapshot 2024-04-21T08:59:16.908 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/31 file after the snapshot 2024-04-21T08:59:16.912 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/32 file after the snapshot 2024-04-21T08:59:16.917 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/33 file after the snapshot 2024-04-21T08:59:16.922 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/34 file after the snapshot 2024-04-21T08:59:16.925 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/35 file after the snapshot 2024-04-21T08:59:16.929 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/36 file after the snapshot 2024-04-21T08:59:16.933 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/37 file after the snapshot 2024-04-21T08:59:16.937 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/38 file after the snapshot 2024-04-21T08:59:16.941 INFO:tasks.workunit.client.0.smithi026.stdout: create 231/39 file after the snapshot 2024-04-21T08:59:16.945 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/.snap/snap-subdir-test 2024-04-21T08:59:16.976 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/30 file after the snapshot 2024-04-21T08:59:16.980 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/31 file after the snapshot 2024-04-21T08:59:16.984 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/32 file after the snapshot 2024-04-21T08:59:16.988 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/33 file after the snapshot 2024-04-21T08:59:16.991 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/34 file after the snapshot 2024-04-21T08:59:16.995 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/35 file after the snapshot 2024-04-21T08:59:16.999 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/36 file after the snapshot 2024-04-21T08:59:17.003 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/37 file after the snapshot 2024-04-21T08:59:17.007 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/38 file after the snapshot 2024-04-21T08:59:17.011 INFO:tasks.workunit.client.0.smithi026.stdout: create 232/39 file after the snapshot 2024-04-21T08:59:17.015 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/.snap/snap-subdir-test 2024-04-21T08:59:17.044 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/30 file after the snapshot 2024-04-21T08:59:17.048 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/31 file after the snapshot 2024-04-21T08:59:17.052 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/32 file after the snapshot 2024-04-21T08:59:17.055 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/33 file after the snapshot 2024-04-21T08:59:17.059 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/34 file after the snapshot 2024-04-21T08:59:17.063 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/35 file after the snapshot 2024-04-21T08:59:17.068 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/36 file after the snapshot 2024-04-21T08:59:17.072 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/37 file after the snapshot 2024-04-21T08:59:17.076 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/38 file after the snapshot 2024-04-21T08:59:17.079 INFO:tasks.workunit.client.0.smithi026.stdout: create 233/39 file after the snapshot 2024-04-21T08:59:17.082 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/.snap/snap-subdir-test 2024-04-21T08:59:17.112 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/30 file after the snapshot 2024-04-21T08:59:17.115 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/31 file after the snapshot 2024-04-21T08:59:17.119 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/32 file after the snapshot 2024-04-21T08:59:17.122 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/33 file after the snapshot 2024-04-21T08:59:17.126 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/34 file after the snapshot 2024-04-21T08:59:17.129 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/35 file after the snapshot 2024-04-21T08:59:17.133 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/36 file after the snapshot 2024-04-21T08:59:17.137 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/37 file after the snapshot 2024-04-21T08:59:17.141 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/38 file after the snapshot 2024-04-21T08:59:17.146 INFO:tasks.workunit.client.0.smithi026.stdout: create 234/39 file after the snapshot 2024-04-21T08:59:17.151 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/.snap/snap-subdir-test 2024-04-21T08:59:17.183 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/30 file after the snapshot 2024-04-21T08:59:17.186 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/31 file after the snapshot 2024-04-21T08:59:17.190 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/32 file after the snapshot 2024-04-21T08:59:17.193 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/33 file after the snapshot 2024-04-21T08:59:17.197 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/34 file after the snapshot 2024-04-21T08:59:17.200 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/35 file after the snapshot 2024-04-21T08:59:17.204 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/36 file after the snapshot 2024-04-21T08:59:17.207 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/37 file after the snapshot 2024-04-21T08:59:17.211 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/38 file after the snapshot 2024-04-21T08:59:17.214 INFO:tasks.workunit.client.0.smithi026.stdout: create 235/39 file after the snapshot 2024-04-21T08:59:17.217 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/.snap/snap-subdir-test 2024-04-21T08:59:17.256 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/30 file after the snapshot 2024-04-21T08:59:17.260 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/31 file after the snapshot 2024-04-21T08:59:17.263 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/32 file after the snapshot 2024-04-21T08:59:17.267 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/33 file after the snapshot 2024-04-21T08:59:17.271 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/34 file after the snapshot 2024-04-21T08:59:17.275 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/35 file after the snapshot 2024-04-21T08:59:17.279 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/36 file after the snapshot 2024-04-21T08:59:17.284 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/37 file after the snapshot 2024-04-21T08:59:17.288 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/38 file after the snapshot 2024-04-21T08:59:17.293 INFO:tasks.workunit.client.0.smithi026.stdout: create 236/39 file after the snapshot 2024-04-21T08:59:17.297 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/.snap/snap-subdir-test 2024-04-21T08:59:17.328 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/30 file after the snapshot 2024-04-21T08:59:17.331 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/31 file after the snapshot 2024-04-21T08:59:17.335 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/32 file after the snapshot 2024-04-21T08:59:17.339 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/33 file after the snapshot 2024-04-21T08:59:17.343 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/34 file after the snapshot 2024-04-21T08:59:17.348 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/35 file after the snapshot 2024-04-21T08:59:17.353 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/36 file after the snapshot 2024-04-21T08:59:17.357 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/37 file after the snapshot 2024-04-21T08:59:17.362 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/38 file after the snapshot 2024-04-21T08:59:17.366 INFO:tasks.workunit.client.0.smithi026.stdout: create 237/39 file after the snapshot 2024-04-21T08:59:17.372 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/.snap/snap-subdir-test 2024-04-21T08:59:17.550 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/30 file after the snapshot 2024-04-21T08:59:17.554 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/31 file after the snapshot 2024-04-21T08:59:17.559 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/32 file after the snapshot 2024-04-21T08:59:17.564 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/33 file after the snapshot 2024-04-21T08:59:17.568 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/34 file after the snapshot 2024-04-21T08:59:17.573 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/35 file after the snapshot 2024-04-21T08:59:17.577 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/36 file after the snapshot 2024-04-21T08:59:17.582 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/37 file after the snapshot 2024-04-21T08:59:17.586 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/38 file after the snapshot 2024-04-21T08:59:17.591 INFO:tasks.workunit.client.0.smithi026.stdout: create 238/39 file after the snapshot 2024-04-21T08:59:17.595 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/.snap/snap-subdir-test 2024-04-21T08:59:17.625 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/30 file after the snapshot 2024-04-21T08:59:17.629 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/31 file after the snapshot 2024-04-21T08:59:17.633 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/32 file after the snapshot 2024-04-21T08:59:17.637 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/33 file after the snapshot 2024-04-21T08:59:17.641 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/34 file after the snapshot 2024-04-21T08:59:17.645 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/35 file after the snapshot 2024-04-21T08:59:17.649 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/36 file after the snapshot 2024-04-21T08:59:17.654 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/37 file after the snapshot 2024-04-21T08:59:17.658 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/38 file after the snapshot 2024-04-21T08:59:17.662 INFO:tasks.workunit.client.0.smithi026.stdout: create 239/39 file after the snapshot 2024-04-21T08:59:17.666 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/.snap/snap-subdir-test 2024-04-21T08:59:17.695 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/30 file after the snapshot 2024-04-21T08:59:17.699 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/31 file after the snapshot 2024-04-21T08:59:17.703 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/32 file after the snapshot 2024-04-21T08:59:17.707 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/33 file after the snapshot 2024-04-21T08:59:17.711 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/34 file after the snapshot 2024-04-21T08:59:17.716 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/35 file after the snapshot 2024-04-21T08:59:17.720 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/36 file after the snapshot 2024-04-21T08:59:17.723 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/37 file after the snapshot 2024-04-21T08:59:17.728 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/38 file after the snapshot 2024-04-21T08:59:17.731 INFO:tasks.workunit.client.0.smithi026.stdout: create 240/39 file after the snapshot 2024-04-21T08:59:17.735 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/.snap/snap-subdir-test 2024-04-21T08:59:17.762 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/30 file after the snapshot 2024-04-21T08:59:17.766 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/31 file after the snapshot 2024-04-21T08:59:17.769 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/32 file after the snapshot 2024-04-21T08:59:17.774 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/33 file after the snapshot 2024-04-21T08:59:17.778 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/34 file after the snapshot 2024-04-21T08:59:17.781 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/35 file after the snapshot 2024-04-21T08:59:17.785 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/36 file after the snapshot 2024-04-21T08:59:17.789 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/37 file after the snapshot 2024-04-21T08:59:17.793 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/38 file after the snapshot 2024-04-21T08:59:17.797 INFO:tasks.workunit.client.0.smithi026.stdout: create 241/39 file after the snapshot 2024-04-21T08:59:17.801 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/.snap/snap-subdir-test 2024-04-21T08:59:17.830 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/30 file after the snapshot 2024-04-21T08:59:17.834 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/31 file after the snapshot 2024-04-21T08:59:17.838 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/32 file after the snapshot 2024-04-21T08:59:17.843 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/33 file after the snapshot 2024-04-21T08:59:17.847 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/34 file after the snapshot 2024-04-21T08:59:17.852 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/35 file after the snapshot 2024-04-21T08:59:17.856 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/36 file after the snapshot 2024-04-21T08:59:17.860 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/37 file after the snapshot 2024-04-21T08:59:17.864 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/38 file after the snapshot 2024-04-21T08:59:17.868 INFO:tasks.workunit.client.0.smithi026.stdout: create 242/39 file after the snapshot 2024-04-21T08:59:17.873 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/.snap/snap-subdir-test 2024-04-21T08:59:17.903 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/30 file after the snapshot 2024-04-21T08:59:17.907 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/31 file after the snapshot 2024-04-21T08:59:17.911 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/32 file after the snapshot 2024-04-21T08:59:17.915 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/33 file after the snapshot 2024-04-21T08:59:17.921 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/34 file after the snapshot 2024-04-21T08:59:17.923 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/35 file after the snapshot 2024-04-21T08:59:17.928 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/36 file after the snapshot 2024-04-21T08:59:17.931 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/37 file after the snapshot 2024-04-21T08:59:17.936 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/38 file after the snapshot 2024-04-21T08:59:17.941 INFO:tasks.workunit.client.0.smithi026.stdout: create 243/39 file after the snapshot 2024-04-21T08:59:17.945 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/.snap/snap-subdir-test 2024-04-21T08:59:17.973 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/30 file after the snapshot 2024-04-21T08:59:17.977 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/31 file after the snapshot 2024-04-21T08:59:17.981 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/32 file after the snapshot 2024-04-21T08:59:17.985 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/33 file after the snapshot 2024-04-21T08:59:17.989 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/34 file after the snapshot 2024-04-21T08:59:17.993 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/35 file after the snapshot 2024-04-21T08:59:17.996 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/36 file after the snapshot 2024-04-21T08:59:18.000 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/37 file after the snapshot 2024-04-21T08:59:18.004 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/38 file after the snapshot 2024-04-21T08:59:18.008 INFO:tasks.workunit.client.0.smithi026.stdout: create 244/39 file after the snapshot 2024-04-21T08:59:18.012 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/.snap/snap-subdir-test 2024-04-21T08:59:18.039 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/30 file after the snapshot 2024-04-21T08:59:18.043 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/31 file after the snapshot 2024-04-21T08:59:18.046 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/32 file after the snapshot 2024-04-21T08:59:18.050 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/33 file after the snapshot 2024-04-21T08:59:18.054 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/34 file after the snapshot 2024-04-21T08:59:18.058 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/35 file after the snapshot 2024-04-21T08:59:18.062 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/36 file after the snapshot 2024-04-21T08:59:18.067 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/37 file after the snapshot 2024-04-21T08:59:18.070 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/38 file after the snapshot 2024-04-21T08:59:18.076 INFO:tasks.workunit.client.0.smithi026.stdout: create 245/39 file after the snapshot 2024-04-21T08:59:18.081 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/.snap/snap-subdir-test 2024-04-21T08:59:18.114 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/30 file after the snapshot 2024-04-21T08:59:18.119 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/31 file after the snapshot 2024-04-21T08:59:18.124 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/32 file after the snapshot 2024-04-21T08:59:18.129 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/33 file after the snapshot 2024-04-21T08:59:18.133 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/34 file after the snapshot 2024-04-21T08:59:18.138 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/35 file after the snapshot 2024-04-21T08:59:18.143 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/36 file after the snapshot 2024-04-21T08:59:18.148 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/37 file after the snapshot 2024-04-21T08:59:18.153 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/38 file after the snapshot 2024-04-21T08:59:18.158 INFO:tasks.workunit.client.0.smithi026.stdout: create 246/39 file after the snapshot 2024-04-21T08:59:18.163 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/.snap/snap-subdir-test 2024-04-21T08:59:18.196 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/30 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/31 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/32 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/33 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/34 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/35 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/36 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/37 file after the snapshot 2024-04-21T08:59:18.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/38 file after the snapshot 2024-04-21T08:59:18.231 INFO:tasks.workunit.client.0.smithi026.stdout: create 247/39 file after the snapshot 2024-04-21T08:59:18.234 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/.snap/snap-subdir-test 2024-04-21T08:59:18.262 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/30 file after the snapshot 2024-04-21T08:59:18.265 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/31 file after the snapshot 2024-04-21T08:59:18.269 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/32 file after the snapshot 2024-04-21T08:59:18.273 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/33 file after the snapshot 2024-04-21T08:59:18.276 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/34 file after the snapshot 2024-04-21T08:59:18.280 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/35 file after the snapshot 2024-04-21T08:59:18.283 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/36 file after the snapshot 2024-04-21T08:59:18.287 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/37 file after the snapshot 2024-04-21T08:59:18.291 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/38 file after the snapshot 2024-04-21T08:59:18.295 INFO:tasks.workunit.client.0.smithi026.stdout: create 248/39 file after the snapshot 2024-04-21T08:59:18.298 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/.snap/snap-subdir-test 2024-04-21T08:59:18.336 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/30 file after the snapshot 2024-04-21T08:59:18.339 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/31 file after the snapshot 2024-04-21T08:59:18.344 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/32 file after the snapshot 2024-04-21T08:59:18.347 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/33 file after the snapshot 2024-04-21T08:59:18.351 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/34 file after the snapshot 2024-04-21T08:59:18.355 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/35 file after the snapshot 2024-04-21T08:59:18.359 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/36 file after the snapshot 2024-04-21T08:59:18.363 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/37 file after the snapshot 2024-04-21T08:59:18.366 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/38 file after the snapshot 2024-04-21T08:59:18.370 INFO:tasks.workunit.client.0.smithi026.stdout: create 249/39 file after the snapshot 2024-04-21T08:59:18.374 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/.snap/snap-subdir-test 2024-04-21T08:59:18.449 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/30 file after the snapshot 2024-04-21T08:59:18.513 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/31 file after the snapshot 2024-04-21T08:59:18.518 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/32 file after the snapshot 2024-04-21T08:59:18.522 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/33 file after the snapshot 2024-04-21T08:59:18.526 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/34 file after the snapshot 2024-04-21T08:59:18.529 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/35 file after the snapshot 2024-04-21T08:59:18.534 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/36 file after the snapshot 2024-04-21T08:59:18.539 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/37 file after the snapshot 2024-04-21T08:59:18.544 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/38 file after the snapshot 2024-04-21T08:59:18.548 INFO:tasks.workunit.client.0.smithi026.stdout: create 250/39 file after the snapshot 2024-04-21T08:59:18.553 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/.snap/snap-subdir-test 2024-04-21T08:59:18.625 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/30 file after the snapshot 2024-04-21T08:59:18.630 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/31 file after the snapshot 2024-04-21T08:59:18.635 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/32 file after the snapshot 2024-04-21T08:59:18.640 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/33 file after the snapshot 2024-04-21T08:59:18.644 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/34 file after the snapshot 2024-04-21T08:59:18.648 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/35 file after the snapshot 2024-04-21T08:59:18.653 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/36 file after the snapshot 2024-04-21T08:59:18.658 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/37 file after the snapshot 2024-04-21T08:59:18.661 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/38 file after the snapshot 2024-04-21T08:59:18.666 INFO:tasks.workunit.client.0.smithi026.stdout: create 251/39 file after the snapshot 2024-04-21T08:59:18.671 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/.snap/snap-subdir-test 2024-04-21T08:59:18.700 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/30 file after the snapshot 2024-04-21T08:59:18.704 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/31 file after the snapshot 2024-04-21T08:59:18.709 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/32 file after the snapshot 2024-04-21T08:59:18.713 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/33 file after the snapshot 2024-04-21T08:59:18.717 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/34 file after the snapshot 2024-04-21T08:59:18.722 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/35 file after the snapshot 2024-04-21T08:59:18.725 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/36 file after the snapshot 2024-04-21T08:59:18.729 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/37 file after the snapshot 2024-04-21T08:59:18.733 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/38 file after the snapshot 2024-04-21T08:59:18.738 INFO:tasks.workunit.client.0.smithi026.stdout: create 252/39 file after the snapshot 2024-04-21T08:59:18.743 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/.snap/snap-subdir-test 2024-04-21T08:59:18.773 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/30 file after the snapshot 2024-04-21T08:59:18.777 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/31 file after the snapshot 2024-04-21T08:59:18.781 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/32 file after the snapshot 2024-04-21T08:59:18.785 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/33 file after the snapshot 2024-04-21T08:59:18.789 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/34 file after the snapshot 2024-04-21T08:59:18.794 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/35 file after the snapshot 2024-04-21T08:59:18.798 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/36 file after the snapshot 2024-04-21T08:59:18.802 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/37 file after the snapshot 2024-04-21T08:59:18.807 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/38 file after the snapshot 2024-04-21T08:59:18.811 INFO:tasks.workunit.client.0.smithi026.stdout: create 253/39 file after the snapshot 2024-04-21T08:59:18.815 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/.snap/snap-subdir-test 2024-04-21T08:59:18.846 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/30 file after the snapshot 2024-04-21T08:59:18.851 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/31 file after the snapshot 2024-04-21T08:59:18.855 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/32 file after the snapshot 2024-04-21T08:59:18.859 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/33 file after the snapshot 2024-04-21T08:59:18.863 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/34 file after the snapshot 2024-04-21T08:59:18.867 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/35 file after the snapshot 2024-04-21T08:59:18.870 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/36 file after the snapshot 2024-04-21T08:59:18.874 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/37 file after the snapshot 2024-04-21T08:59:18.879 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/38 file after the snapshot 2024-04-21T08:59:18.883 INFO:tasks.workunit.client.0.smithi026.stdout: create 254/39 file after the snapshot 2024-04-21T08:59:18.887 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/.snap/snap-subdir-test 2024-04-21T08:59:18.915 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/30 file after the snapshot 2024-04-21T08:59:18.919 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/31 file after the snapshot 2024-04-21T08:59:18.923 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/32 file after the snapshot 2024-04-21T08:59:18.926 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/33 file after the snapshot 2024-04-21T08:59:18.930 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/34 file after the snapshot 2024-04-21T08:59:18.934 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/35 file after the snapshot 2024-04-21T08:59:18.938 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/36 file after the snapshot 2024-04-21T08:59:18.941 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/37 file after the snapshot 2024-04-21T08:59:18.945 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/38 file after the snapshot 2024-04-21T08:59:18.949 INFO:tasks.workunit.client.0.smithi026.stdout: create 255/39 file after the snapshot 2024-04-21T08:59:18.952 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/.snap/snap-subdir-test 2024-04-21T08:59:18.988 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/30 file after the snapshot 2024-04-21T08:59:18.992 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/31 file after the snapshot 2024-04-21T08:59:18.996 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/32 file after the snapshot 2024-04-21T08:59:19.000 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/33 file after the snapshot 2024-04-21T08:59:19.004 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/34 file after the snapshot 2024-04-21T08:59:19.008 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/35 file after the snapshot 2024-04-21T08:59:19.013 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/36 file after the snapshot 2024-04-21T08:59:19.017 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/37 file after the snapshot 2024-04-21T08:59:19.021 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/38 file after the snapshot 2024-04-21T08:59:19.025 INFO:tasks.workunit.client.0.smithi026.stdout: create 256/39 file after the snapshot 2024-04-21T08:59:19.029 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/.snap/snap-subdir-test 2024-04-21T08:59:19.058 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/30 file after the snapshot 2024-04-21T08:59:19.063 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/31 file after the snapshot 2024-04-21T08:59:19.068 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/32 file after the snapshot 2024-04-21T08:59:19.073 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/33 file after the snapshot 2024-04-21T08:59:19.079 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/34 file after the snapshot 2024-04-21T08:59:19.084 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/35 file after the snapshot 2024-04-21T08:59:19.089 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/36 file after the snapshot 2024-04-21T08:59:19.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/37 file after the snapshot 2024-04-21T08:59:19.098 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/38 file after the snapshot 2024-04-21T08:59:19.103 INFO:tasks.workunit.client.0.smithi026.stdout: create 257/39 file after the snapshot 2024-04-21T08:59:19.107 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/.snap/snap-subdir-test 2024-04-21T08:59:19.136 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/30 file after the snapshot 2024-04-21T08:59:19.140 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/31 file after the snapshot 2024-04-21T08:59:19.145 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/32 file after the snapshot 2024-04-21T08:59:19.150 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/33 file after the snapshot 2024-04-21T08:59:19.154 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/34 file after the snapshot 2024-04-21T08:59:19.159 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/35 file after the snapshot 2024-04-21T08:59:19.163 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/36 file after the snapshot 2024-04-21T08:59:19.166 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/37 file after the snapshot 2024-04-21T08:59:19.170 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/38 file after the snapshot 2024-04-21T08:59:19.175 INFO:tasks.workunit.client.0.smithi026.stdout: create 258/39 file after the snapshot 2024-04-21T08:59:19.179 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/.snap/snap-subdir-test 2024-04-21T08:59:19.212 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/30 file after the snapshot 2024-04-21T08:59:19.215 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/31 file after the snapshot 2024-04-21T08:59:19.219 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/32 file after the snapshot 2024-04-21T08:59:19.223 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/33 file after the snapshot 2024-04-21T08:59:19.227 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/34 file after the snapshot 2024-04-21T08:59:19.231 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/35 file after the snapshot 2024-04-21T08:59:19.234 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/36 file after the snapshot 2024-04-21T08:59:19.238 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/37 file after the snapshot 2024-04-21T08:59:19.241 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/38 file after the snapshot 2024-04-21T08:59:19.245 INFO:tasks.workunit.client.0.smithi026.stdout: create 259/39 file after the snapshot 2024-04-21T08:59:19.249 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/.snap/snap-subdir-test 2024-04-21T08:59:19.280 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/30 file after the snapshot 2024-04-21T08:59:19.283 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/31 file after the snapshot 2024-04-21T08:59:19.287 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/32 file after the snapshot 2024-04-21T08:59:19.291 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/33 file after the snapshot 2024-04-21T08:59:19.295 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/34 file after the snapshot 2024-04-21T08:59:19.299 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/35 file after the snapshot 2024-04-21T08:59:19.304 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/36 file after the snapshot 2024-04-21T08:59:19.308 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/37 file after the snapshot 2024-04-21T08:59:19.312 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/38 file after the snapshot 2024-04-21T08:59:19.316 INFO:tasks.workunit.client.0.smithi026.stdout: create 260/39 file after the snapshot 2024-04-21T08:59:19.319 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/.snap/snap-subdir-test 2024-04-21T08:59:19.347 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/30 file after the snapshot 2024-04-21T08:59:19.351 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/31 file after the snapshot 2024-04-21T08:59:19.355 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/32 file after the snapshot 2024-04-21T08:59:19.359 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/33 file after the snapshot 2024-04-21T08:59:19.363 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/34 file after the snapshot 2024-04-21T08:59:19.367 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/35 file after the snapshot 2024-04-21T08:59:19.371 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/36 file after the snapshot 2024-04-21T08:59:19.375 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/37 file after the snapshot 2024-04-21T08:59:19.378 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/38 file after the snapshot 2024-04-21T08:59:19.382 INFO:tasks.workunit.client.0.smithi026.stdout: create 261/39 file after the snapshot 2024-04-21T08:59:19.385 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/.snap/snap-subdir-test 2024-04-21T08:59:19.462 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/30 file after the snapshot 2024-04-21T08:59:19.526 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/31 file after the snapshot 2024-04-21T08:59:19.530 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/32 file after the snapshot 2024-04-21T08:59:19.534 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/33 file after the snapshot 2024-04-21T08:59:19.539 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/34 file after the snapshot 2024-04-21T08:59:19.544 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/35 file after the snapshot 2024-04-21T08:59:19.548 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/36 file after the snapshot 2024-04-21T08:59:19.553 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/37 file after the snapshot 2024-04-21T08:59:19.558 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/38 file after the snapshot 2024-04-21T08:59:19.563 INFO:tasks.workunit.client.0.smithi026.stdout: create 262/39 file after the snapshot 2024-04-21T08:59:19.568 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/.snap/snap-subdir-test 2024-04-21T08:59:19.655 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/30 file after the snapshot 2024-04-21T08:59:19.659 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/31 file after the snapshot 2024-04-21T08:59:19.663 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/32 file after the snapshot 2024-04-21T08:59:19.667 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/33 file after the snapshot 2024-04-21T08:59:19.672 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/34 file after the snapshot 2024-04-21T08:59:19.676 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/35 file after the snapshot 2024-04-21T08:59:19.681 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/36 file after the snapshot 2024-04-21T08:59:19.687 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/37 file after the snapshot 2024-04-21T08:59:19.692 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/38 file after the snapshot 2024-04-21T08:59:19.697 INFO:tasks.workunit.client.0.smithi026.stdout: create 263/39 file after the snapshot 2024-04-21T08:59:19.701 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/.snap/snap-subdir-test 2024-04-21T08:59:19.732 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/30 file after the snapshot 2024-04-21T08:59:19.736 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/31 file after the snapshot 2024-04-21T08:59:19.741 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/32 file after the snapshot 2024-04-21T08:59:19.745 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/33 file after the snapshot 2024-04-21T08:59:19.750 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/34 file after the snapshot 2024-04-21T08:59:19.754 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/35 file after the snapshot 2024-04-21T08:59:19.759 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/36 file after the snapshot 2024-04-21T08:59:19.763 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/37 file after the snapshot 2024-04-21T08:59:19.768 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/38 file after the snapshot 2024-04-21T08:59:19.773 INFO:tasks.workunit.client.0.smithi026.stdout: create 264/39 file after the snapshot 2024-04-21T08:59:19.777 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/.snap/snap-subdir-test 2024-04-21T08:59:19.811 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/30 file after the snapshot 2024-04-21T08:59:19.815 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/31 file after the snapshot 2024-04-21T08:59:19.821 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/32 file after the snapshot 2024-04-21T08:59:19.824 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/33 file after the snapshot 2024-04-21T08:59:19.829 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/34 file after the snapshot 2024-04-21T08:59:19.833 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/35 file after the snapshot 2024-04-21T08:59:19.837 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/36 file after the snapshot 2024-04-21T08:59:19.841 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/37 file after the snapshot 2024-04-21T08:59:19.844 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/38 file after the snapshot 2024-04-21T08:59:19.848 INFO:tasks.workunit.client.0.smithi026.stdout: create 265/39 file after the snapshot 2024-04-21T08:59:19.853 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/.snap/snap-subdir-test 2024-04-21T08:59:19.888 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/30 file after the snapshot 2024-04-21T08:59:19.892 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/31 file after the snapshot 2024-04-21T08:59:19.898 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/32 file after the snapshot 2024-04-21T08:59:19.903 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/33 file after the snapshot 2024-04-21T08:59:19.907 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/34 file after the snapshot 2024-04-21T08:59:19.911 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/35 file after the snapshot 2024-04-21T08:59:19.915 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/36 file after the snapshot 2024-04-21T08:59:19.920 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/37 file after the snapshot 2024-04-21T08:59:19.924 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/38 file after the snapshot 2024-04-21T08:59:19.928 INFO:tasks.workunit.client.0.smithi026.stdout: create 266/39 file after the snapshot 2024-04-21T08:59:19.933 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/.snap/snap-subdir-test 2024-04-21T08:59:19.968 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/30 file after the snapshot 2024-04-21T08:59:19.972 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/31 file after the snapshot 2024-04-21T08:59:19.976 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/32 file after the snapshot 2024-04-21T08:59:19.980 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/33 file after the snapshot 2024-04-21T08:59:19.985 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/34 file after the snapshot 2024-04-21T08:59:19.988 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/35 file after the snapshot 2024-04-21T08:59:19.993 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/36 file after the snapshot 2024-04-21T08:59:19.996 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/37 file after the snapshot 2024-04-21T08:59:20.000 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/38 file after the snapshot 2024-04-21T08:59:20.004 INFO:tasks.workunit.client.0.smithi026.stdout: create 267/39 file after the snapshot 2024-04-21T08:59:20.008 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/.snap/snap-subdir-test 2024-04-21T08:59:20.031 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/30 file after the snapshot 2024-04-21T08:59:20.035 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/31 file after the snapshot 2024-04-21T08:59:20.040 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/32 file after the snapshot 2024-04-21T08:59:20.044 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/33 file after the snapshot 2024-04-21T08:59:20.049 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/34 file after the snapshot 2024-04-21T08:59:20.053 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/35 file after the snapshot 2024-04-21T08:59:20.057 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/36 file after the snapshot 2024-04-21T08:59:20.060 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/37 file after the snapshot 2024-04-21T08:59:20.064 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/38 file after the snapshot 2024-04-21T08:59:20.068 INFO:tasks.workunit.client.0.smithi026.stdout: create 268/39 file after the snapshot 2024-04-21T08:59:20.073 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/.snap/snap-subdir-test 2024-04-21T08:59:20.098 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/30 file after the snapshot 2024-04-21T08:59:20.102 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/31 file after the snapshot 2024-04-21T08:59:20.106 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/32 file after the snapshot 2024-04-21T08:59:20.110 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/33 file after the snapshot 2024-04-21T08:59:20.115 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/34 file after the snapshot 2024-04-21T08:59:20.120 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/35 file after the snapshot 2024-04-21T08:59:20.125 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/36 file after the snapshot 2024-04-21T08:59:20.130 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/37 file after the snapshot 2024-04-21T08:59:20.135 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/38 file after the snapshot 2024-04-21T08:59:20.139 INFO:tasks.workunit.client.0.smithi026.stdout: create 269/39 file after the snapshot 2024-04-21T08:59:20.145 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/.snap/snap-subdir-test 2024-04-21T08:59:20.177 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/30 file after the snapshot 2024-04-21T08:59:20.182 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/31 file after the snapshot 2024-04-21T08:59:20.187 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/32 file after the snapshot 2024-04-21T08:59:20.191 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/33 file after the snapshot 2024-04-21T08:59:20.196 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/34 file after the snapshot 2024-04-21T08:59:20.200 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/35 file after the snapshot 2024-04-21T08:59:20.205 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/36 file after the snapshot 2024-04-21T08:59:20.210 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/37 file after the snapshot 2024-04-21T08:59:20.214 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/38 file after the snapshot 2024-04-21T08:59:20.218 INFO:tasks.workunit.client.0.smithi026.stdout: create 270/39 file after the snapshot 2024-04-21T08:59:20.221 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/.snap/snap-subdir-test 2024-04-21T08:59:20.252 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/30 file after the snapshot 2024-04-21T08:59:20.256 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/31 file after the snapshot 2024-04-21T08:59:20.259 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/32 file after the snapshot 2024-04-21T08:59:20.263 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/33 file after the snapshot 2024-04-21T08:59:20.268 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/34 file after the snapshot 2024-04-21T08:59:20.272 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/35 file after the snapshot 2024-04-21T08:59:20.277 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/36 file after the snapshot 2024-04-21T08:59:20.281 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/37 file after the snapshot 2024-04-21T08:59:20.286 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/38 file after the snapshot 2024-04-21T08:59:20.290 INFO:tasks.workunit.client.0.smithi026.stdout: create 271/39 file after the snapshot 2024-04-21T08:59:20.296 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/.snap/snap-subdir-test 2024-04-21T08:59:20.326 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/30 file after the snapshot 2024-04-21T08:59:20.330 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/31 file after the snapshot 2024-04-21T08:59:20.335 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/32 file after the snapshot 2024-04-21T08:59:20.355 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/33 file after the snapshot 2024-04-21T08:59:20.373 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/34 file after the snapshot 2024-04-21T08:59:20.377 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/35 file after the snapshot 2024-04-21T08:59:20.382 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/36 file after the snapshot 2024-04-21T08:59:20.387 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/37 file after the snapshot 2024-04-21T08:59:20.391 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/38 file after the snapshot 2024-04-21T08:59:20.395 INFO:tasks.workunit.client.0.smithi026.stdout: create 272/39 file after the snapshot 2024-04-21T08:59:20.399 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/.snap/snap-subdir-test 2024-04-21T08:59:20.533 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/30 file after the snapshot 2024-04-21T08:59:20.536 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/31 file after the snapshot 2024-04-21T08:59:20.541 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/32 file after the snapshot 2024-04-21T08:59:20.546 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/33 file after the snapshot 2024-04-21T08:59:20.551 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/34 file after the snapshot 2024-04-21T08:59:20.555 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/35 file after the snapshot 2024-04-21T08:59:20.559 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/36 file after the snapshot 2024-04-21T08:59:20.563 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/37 file after the snapshot 2024-04-21T08:59:20.567 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/38 file after the snapshot 2024-04-21T08:59:20.571 INFO:tasks.workunit.client.0.smithi026.stdout: create 273/39 file after the snapshot 2024-04-21T08:59:20.575 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/.snap/snap-subdir-test 2024-04-21T08:59:20.603 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/30 file after the snapshot 2024-04-21T08:59:20.607 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/31 file after the snapshot 2024-04-21T08:59:20.610 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/32 file after the snapshot 2024-04-21T08:59:20.614 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/33 file after the snapshot 2024-04-21T08:59:20.617 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/34 file after the snapshot 2024-04-21T08:59:20.620 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/35 file after the snapshot 2024-04-21T08:59:20.624 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/36 file after the snapshot 2024-04-21T08:59:20.627 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/37 file after the snapshot 2024-04-21T08:59:20.630 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/38 file after the snapshot 2024-04-21T08:59:20.634 INFO:tasks.workunit.client.0.smithi026.stdout: create 274/39 file after the snapshot 2024-04-21T08:59:20.637 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/.snap/snap-subdir-test 2024-04-21T08:59:20.666 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/30 file after the snapshot 2024-04-21T08:59:20.670 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/31 file after the snapshot 2024-04-21T08:59:20.675 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/32 file after the snapshot 2024-04-21T08:59:20.678 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/33 file after the snapshot 2024-04-21T08:59:20.682 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/34 file after the snapshot 2024-04-21T08:59:20.686 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/35 file after the snapshot 2024-04-21T08:59:20.691 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/36 file after the snapshot 2024-04-21T08:59:20.694 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/37 file after the snapshot 2024-04-21T08:59:20.698 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/38 file after the snapshot 2024-04-21T08:59:20.702 INFO:tasks.workunit.client.0.smithi026.stdout: create 275/39 file after the snapshot 2024-04-21T08:59:20.707 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/.snap/snap-subdir-test 2024-04-21T08:59:20.737 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/30 file after the snapshot 2024-04-21T08:59:20.741 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/31 file after the snapshot 2024-04-21T08:59:20.744 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/32 file after the snapshot 2024-04-21T08:59:20.748 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/33 file after the snapshot 2024-04-21T08:59:20.752 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/34 file after the snapshot 2024-04-21T08:59:20.757 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/35 file after the snapshot 2024-04-21T08:59:20.760 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/36 file after the snapshot 2024-04-21T08:59:20.764 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/37 file after the snapshot 2024-04-21T08:59:20.768 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/38 file after the snapshot 2024-04-21T08:59:20.772 INFO:tasks.workunit.client.0.smithi026.stdout: create 276/39 file after the snapshot 2024-04-21T08:59:20.777 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/.snap/snap-subdir-test 2024-04-21T08:59:20.807 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/30 file after the snapshot 2024-04-21T08:59:20.811 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/31 file after the snapshot 2024-04-21T08:59:20.814 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/32 file after the snapshot 2024-04-21T08:59:20.819 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/33 file after the snapshot 2024-04-21T08:59:20.822 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/34 file after the snapshot 2024-04-21T08:59:20.826 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/35 file after the snapshot 2024-04-21T08:59:20.830 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/36 file after the snapshot 2024-04-21T08:59:20.834 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/37 file after the snapshot 2024-04-21T08:59:20.838 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/38 file after the snapshot 2024-04-21T08:59:20.842 INFO:tasks.workunit.client.0.smithi026.stdout: create 277/39 file after the snapshot 2024-04-21T08:59:20.845 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/.snap/snap-subdir-test 2024-04-21T08:59:20.875 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/30 file after the snapshot 2024-04-21T08:59:20.878 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/31 file after the snapshot 2024-04-21T08:59:20.882 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/32 file after the snapshot 2024-04-21T08:59:20.886 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/33 file after the snapshot 2024-04-21T08:59:20.890 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/34 file after the snapshot 2024-04-21T08:59:20.894 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/35 file after the snapshot 2024-04-21T08:59:20.897 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/36 file after the snapshot 2024-04-21T08:59:20.901 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/37 file after the snapshot 2024-04-21T08:59:20.905 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/38 file after the snapshot 2024-04-21T08:59:20.909 INFO:tasks.workunit.client.0.smithi026.stdout: create 278/39 file after the snapshot 2024-04-21T08:59:20.914 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/.snap/snap-subdir-test 2024-04-21T08:59:20.947 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/30 file after the snapshot 2024-04-21T08:59:20.952 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/31 file after the snapshot 2024-04-21T08:59:20.957 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/32 file after the snapshot 2024-04-21T08:59:20.961 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/33 file after the snapshot 2024-04-21T08:59:20.966 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/34 file after the snapshot 2024-04-21T08:59:20.970 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/35 file after the snapshot 2024-04-21T08:59:20.975 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/36 file after the snapshot 2024-04-21T08:59:20.978 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/37 file after the snapshot 2024-04-21T08:59:20.982 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/38 file after the snapshot 2024-04-21T08:59:20.986 INFO:tasks.workunit.client.0.smithi026.stdout: create 279/39 file after the snapshot 2024-04-21T08:59:20.990 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/.snap/snap-subdir-test 2024-04-21T08:59:21.021 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/30 file after the snapshot 2024-04-21T08:59:21.025 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/31 file after the snapshot 2024-04-21T08:59:21.029 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/32 file after the snapshot 2024-04-21T08:59:21.034 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/33 file after the snapshot 2024-04-21T08:59:21.038 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/34 file after the snapshot 2024-04-21T08:59:21.042 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/35 file after the snapshot 2024-04-21T08:59:21.046 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/36 file after the snapshot 2024-04-21T08:59:21.051 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/37 file after the snapshot 2024-04-21T08:59:21.055 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/38 file after the snapshot 2024-04-21T08:59:21.060 INFO:tasks.workunit.client.0.smithi026.stdout: create 280/39 file after the snapshot 2024-04-21T08:59:21.064 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/.snap/snap-subdir-test 2024-04-21T08:59:21.094 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/30 file after the snapshot 2024-04-21T08:59:21.098 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/31 file after the snapshot 2024-04-21T08:59:21.102 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/32 file after the snapshot 2024-04-21T08:59:21.106 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/33 file after the snapshot 2024-04-21T08:59:21.109 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/34 file after the snapshot 2024-04-21T08:59:21.113 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/35 file after the snapshot 2024-04-21T08:59:21.117 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/36 file after the snapshot 2024-04-21T08:59:21.121 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/37 file after the snapshot 2024-04-21T08:59:21.125 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/38 file after the snapshot 2024-04-21T08:59:21.129 INFO:tasks.workunit.client.0.smithi026.stdout: create 281/39 file after the snapshot 2024-04-21T08:59:21.133 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/.snap/snap-subdir-test 2024-04-21T08:59:21.162 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/30 file after the snapshot 2024-04-21T08:59:21.166 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/31 file after the snapshot 2024-04-21T08:59:21.170 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/32 file after the snapshot 2024-04-21T08:59:21.174 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/33 file after the snapshot 2024-04-21T08:59:21.177 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/34 file after the snapshot 2024-04-21T08:59:21.181 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/35 file after the snapshot 2024-04-21T08:59:21.185 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/36 file after the snapshot 2024-04-21T08:59:21.189 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/37 file after the snapshot 2024-04-21T08:59:21.193 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/38 file after the snapshot 2024-04-21T08:59:21.197 INFO:tasks.workunit.client.0.smithi026.stdout: create 282/39 file after the snapshot 2024-04-21T08:59:21.201 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/.snap/snap-subdir-test 2024-04-21T08:59:21.230 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/30 file after the snapshot 2024-04-21T08:59:21.234 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/31 file after the snapshot 2024-04-21T08:59:21.238 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/32 file after the snapshot 2024-04-21T08:59:21.242 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/33 file after the snapshot 2024-04-21T08:59:21.246 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/34 file after the snapshot 2024-04-21T08:59:21.250 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/35 file after the snapshot 2024-04-21T08:59:21.254 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/36 file after the snapshot 2024-04-21T08:59:21.257 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/37 file after the snapshot 2024-04-21T08:59:21.261 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/38 file after the snapshot 2024-04-21T08:59:21.264 INFO:tasks.workunit.client.0.smithi026.stdout: create 283/39 file after the snapshot 2024-04-21T08:59:21.269 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/.snap/snap-subdir-test 2024-04-21T08:59:21.301 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/30 file after the snapshot 2024-04-21T08:59:21.306 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/31 file after the snapshot 2024-04-21T08:59:21.311 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/32 file after the snapshot 2024-04-21T08:59:21.316 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/33 file after the snapshot 2024-04-21T08:59:21.320 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/34 file after the snapshot 2024-04-21T08:59:21.324 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/35 file after the snapshot 2024-04-21T08:59:21.328 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/36 file after the snapshot 2024-04-21T08:59:21.332 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/37 file after the snapshot 2024-04-21T08:59:21.337 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/38 file after the snapshot 2024-04-21T08:59:21.341 INFO:tasks.workunit.client.0.smithi026.stdout: create 284/39 file after the snapshot 2024-04-21T08:59:21.346 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/.snap/snap-subdir-test 2024-04-21T08:59:21.376 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/30 file after the snapshot 2024-04-21T08:59:21.380 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/31 file after the snapshot 2024-04-21T08:59:21.385 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/32 file after the snapshot 2024-04-21T08:59:21.388 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/33 file after the snapshot 2024-04-21T08:59:21.391 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/34 file after the snapshot 2024-04-21T08:59:21.394 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/35 file after the snapshot 2024-04-21T08:59:21.397 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/36 file after the snapshot 2024-04-21T08:59:21.400 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/37 file after the snapshot 2024-04-21T08:59:21.403 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/38 file after the snapshot 2024-04-21T08:59:21.406 INFO:tasks.workunit.client.0.smithi026.stdout: create 285/39 file after the snapshot 2024-04-21T08:59:21.409 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/.snap/snap-subdir-test 2024-04-21T08:59:21.567 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/30 file after the snapshot 2024-04-21T08:59:21.571 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/31 file after the snapshot 2024-04-21T08:59:21.576 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/32 file after the snapshot 2024-04-21T08:59:21.581 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/33 file after the snapshot 2024-04-21T08:59:21.586 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/34 file after the snapshot 2024-04-21T08:59:21.591 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/35 file after the snapshot 2024-04-21T08:59:21.596 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/36 file after the snapshot 2024-04-21T08:59:21.601 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/37 file after the snapshot 2024-04-21T08:59:21.605 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/38 file after the snapshot 2024-04-21T08:59:21.610 INFO:tasks.workunit.client.0.smithi026.stdout: create 286/39 file after the snapshot 2024-04-21T08:59:21.615 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/.snap/snap-subdir-test 2024-04-21T08:59:21.649 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/30 file after the snapshot 2024-04-21T08:59:21.653 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/31 file after the snapshot 2024-04-21T08:59:21.657 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/32 file after the snapshot 2024-04-21T08:59:21.661 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/33 file after the snapshot 2024-04-21T08:59:21.666 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/34 file after the snapshot 2024-04-21T08:59:21.670 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/35 file after the snapshot 2024-04-21T08:59:21.675 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/36 file after the snapshot 2024-04-21T08:59:21.681 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/37 file after the snapshot 2024-04-21T08:59:21.686 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/38 file after the snapshot 2024-04-21T08:59:21.691 INFO:tasks.workunit.client.0.smithi026.stdout: create 287/39 file after the snapshot 2024-04-21T08:59:21.695 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/.snap/snap-subdir-test 2024-04-21T08:59:21.728 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/30 file after the snapshot 2024-04-21T08:59:21.732 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/31 file after the snapshot 2024-04-21T08:59:21.737 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/32 file after the snapshot 2024-04-21T08:59:21.742 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/33 file after the snapshot 2024-04-21T08:59:21.746 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/34 file after the snapshot 2024-04-21T08:59:21.750 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/35 file after the snapshot 2024-04-21T08:59:21.756 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/36 file after the snapshot 2024-04-21T08:59:21.760 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/37 file after the snapshot 2024-04-21T08:59:21.764 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/38 file after the snapshot 2024-04-21T08:59:21.768 INFO:tasks.workunit.client.0.smithi026.stdout: create 288/39 file after the snapshot 2024-04-21T08:59:21.772 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/.snap/snap-subdir-test 2024-04-21T08:59:21.805 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/30 file after the snapshot 2024-04-21T08:59:21.809 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/31 file after the snapshot 2024-04-21T08:59:21.813 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/32 file after the snapshot 2024-04-21T08:59:21.817 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/33 file after the snapshot 2024-04-21T08:59:21.820 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/34 file after the snapshot 2024-04-21T08:59:21.824 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/35 file after the snapshot 2024-04-21T08:59:21.828 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/36 file after the snapshot 2024-04-21T08:59:21.832 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/37 file after the snapshot 2024-04-21T08:59:21.836 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/38 file after the snapshot 2024-04-21T08:59:21.840 INFO:tasks.workunit.client.0.smithi026.stdout: create 289/39 file after the snapshot 2024-04-21T08:59:21.844 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/.snap/snap-subdir-test 2024-04-21T08:59:21.876 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/30 file after the snapshot 2024-04-21T08:59:21.879 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/31 file after the snapshot 2024-04-21T08:59:21.883 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/32 file after the snapshot 2024-04-21T08:59:21.887 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/33 file after the snapshot 2024-04-21T08:59:21.891 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/34 file after the snapshot 2024-04-21T08:59:21.894 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/35 file after the snapshot 2024-04-21T08:59:21.898 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/36 file after the snapshot 2024-04-21T08:59:21.903 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/37 file after the snapshot 2024-04-21T08:59:21.906 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/38 file after the snapshot 2024-04-21T08:59:21.911 INFO:tasks.workunit.client.0.smithi026.stdout: create 290/39 file after the snapshot 2024-04-21T08:59:21.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:21.916 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/.snap/snap-subdir-test 2024-04-21T08:59:21.918 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:21.948 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/30 file after the snapshot 2024-04-21T08:59:21.951 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/31 file after the snapshot 2024-04-21T08:59:21.955 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/32 file after the snapshot 2024-04-21T08:59:21.959 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/33 file after the snapshot 2024-04-21T08:59:21.963 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/34 file after the snapshot 2024-04-21T08:59:21.967 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/35 file after the snapshot 2024-04-21T08:59:21.971 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/36 file after the snapshot 2024-04-21T08:59:21.975 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/37 file after the snapshot 2024-04-21T08:59:21.979 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/38 file after the snapshot 2024-04-21T08:59:21.982 INFO:tasks.workunit.client.0.smithi026.stdout: create 291/39 file after the snapshot 2024-04-21T08:59:21.986 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/.snap/snap-subdir-test 2024-04-21T08:59:22.016 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/30 file after the snapshot 2024-04-21T08:59:22.019 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/31 file after the snapshot 2024-04-21T08:59:22.022 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/32 file after the snapshot 2024-04-21T08:59:22.026 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/33 file after the snapshot 2024-04-21T08:59:22.028 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/34 file after the snapshot 2024-04-21T08:59:22.031 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/35 file after the snapshot 2024-04-21T08:59:22.034 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/36 file after the snapshot 2024-04-21T08:59:22.037 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/37 file after the snapshot 2024-04-21T08:59:22.040 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/38 file after the snapshot 2024-04-21T08:59:22.042 INFO:tasks.workunit.client.0.smithi026.stdout: create 292/39 file after the snapshot 2024-04-21T08:59:22.045 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/.snap/snap-subdir-test 2024-04-21T08:59:22.075 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/30 file after the snapshot 2024-04-21T08:59:22.078 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/31 file after the snapshot 2024-04-21T08:59:22.082 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/32 file after the snapshot 2024-04-21T08:59:22.085 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/33 file after the snapshot 2024-04-21T08:59:22.089 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/34 file after the snapshot 2024-04-21T08:59:22.093 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/35 file after the snapshot 2024-04-21T08:59:22.097 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/36 file after the snapshot 2024-04-21T08:59:22.100 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/37 file after the snapshot 2024-04-21T08:59:22.103 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/38 file after the snapshot 2024-04-21T08:59:22.107 INFO:tasks.workunit.client.0.smithi026.stdout: create 293/39 file after the snapshot 2024-04-21T08:59:22.109 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/.snap/snap-subdir-test 2024-04-21T08:59:22.139 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/30 file after the snapshot 2024-04-21T08:59:22.143 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/31 file after the snapshot 2024-04-21T08:59:22.147 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/32 file after the snapshot 2024-04-21T08:59:22.150 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/33 file after the snapshot 2024-04-21T08:59:22.154 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/34 file after the snapshot 2024-04-21T08:59:22.158 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/35 file after the snapshot 2024-04-21T08:59:22.161 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/36 file after the snapshot 2024-04-21T08:59:22.166 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/37 file after the snapshot 2024-04-21T08:59:22.170 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/38 file after the snapshot 2024-04-21T08:59:22.174 INFO:tasks.workunit.client.0.smithi026.stdout: create 294/39 file after the snapshot 2024-04-21T08:59:22.177 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/.snap/snap-subdir-test 2024-04-21T08:59:22.206 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/30 file after the snapshot 2024-04-21T08:59:22.210 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/31 file after the snapshot 2024-04-21T08:59:22.214 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/32 file after the snapshot 2024-04-21T08:59:22.218 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/33 file after the snapshot 2024-04-21T08:59:22.221 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/34 file after the snapshot 2024-04-21T08:59:22.225 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/35 file after the snapshot 2024-04-21T08:59:22.229 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/36 file after the snapshot 2024-04-21T08:59:22.233 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/37 file after the snapshot 2024-04-21T08:59:22.238 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/38 file after the snapshot 2024-04-21T08:59:22.241 INFO:tasks.workunit.client.0.smithi026.stdout: create 295/39 file after the snapshot 2024-04-21T08:59:22.245 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/.snap/snap-subdir-test 2024-04-21T08:59:22.275 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/30 file after the snapshot 2024-04-21T08:59:22.279 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/31 file after the snapshot 2024-04-21T08:59:22.283 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/32 file after the snapshot 2024-04-21T08:59:22.287 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/33 file after the snapshot 2024-04-21T08:59:22.291 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/34 file after the snapshot 2024-04-21T08:59:22.295 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/35 file after the snapshot 2024-04-21T08:59:22.298 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/36 file after the snapshot 2024-04-21T08:59:22.303 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/37 file after the snapshot 2024-04-21T08:59:22.308 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/38 file after the snapshot 2024-04-21T08:59:22.313 INFO:tasks.workunit.client.0.smithi026.stdout: create 296/39 file after the snapshot 2024-04-21T08:59:22.317 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/.snap/snap-subdir-test 2024-04-21T08:59:22.348 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/30 file after the snapshot 2024-04-21T08:59:22.352 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/31 file after the snapshot 2024-04-21T08:59:22.357 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/32 file after the snapshot 2024-04-21T08:59:22.360 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/33 file after the snapshot 2024-04-21T08:59:22.364 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/34 file after the snapshot 2024-04-21T08:59:22.368 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/35 file after the snapshot 2024-04-21T08:59:22.371 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/36 file after the snapshot 2024-04-21T08:59:22.374 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/37 file after the snapshot 2024-04-21T08:59:22.378 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/38 file after the snapshot 2024-04-21T08:59:22.381 INFO:tasks.workunit.client.0.smithi026.stdout: create 297/39 file after the snapshot 2024-04-21T08:59:22.385 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/.snap/snap-subdir-test 2024-04-21T08:59:22.420 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/30 file after the snapshot 2024-04-21T08:59:22.520 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/31 file after the snapshot 2024-04-21T08:59:22.524 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/32 file after the snapshot 2024-04-21T08:59:22.529 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/33 file after the snapshot 2024-04-21T08:59:22.533 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/34 file after the snapshot 2024-04-21T08:59:22.538 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/35 file after the snapshot 2024-04-21T08:59:22.542 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/36 file after the snapshot 2024-04-21T08:59:22.547 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/37 file after the snapshot 2024-04-21T08:59:22.552 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/38 file after the snapshot 2024-04-21T08:59:22.556 INFO:tasks.workunit.client.0.smithi026.stdout: create 298/39 file after the snapshot 2024-04-21T08:59:22.561 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/.snap/snap-subdir-test 2024-04-21T08:59:22.646 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/30 file after the snapshot 2024-04-21T08:59:22.650 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/31 file after the snapshot 2024-04-21T08:59:22.655 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/32 file after the snapshot 2024-04-21T08:59:22.660 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/33 file after the snapshot 2024-04-21T08:59:22.665 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/34 file after the snapshot 2024-04-21T08:59:22.669 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/35 file after the snapshot 2024-04-21T08:59:22.674 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/36 file after the snapshot 2024-04-21T08:59:22.679 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/37 file after the snapshot 2024-04-21T08:59:22.683 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/38 file after the snapshot 2024-04-21T08:59:22.688 INFO:tasks.workunit.client.0.smithi026.stdout: create 299/39 file after the snapshot 2024-04-21T08:59:22.693 INFO:tasks.workunit.client.0.smithi026.stdout:Take second snapshot .snap/test2 2024-04-21T08:59:22.804 INFO:tasks.workunit.client.0.smithi026.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2024-04-21T08:59:25.027 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2024-04-21T08:59:25.028 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2024-04-21T08:59:25.029 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2024-04-21T08:59:25.030 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2024-04-21T08:59:25.031 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2024-04-21T08:59:25.032 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2024-04-21T08:59:25.033 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2024-04-21T08:59:26.942 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2024-04-21T08:59:26.943 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2024-04-21T08:59:26.944 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2024-04-21T08:59:26.945 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2024-04-21T08:59:26.946 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2024-04-21T08:59:26.947 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2024-04-21T08:59:28.801 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2024-04-21T08:59:28.801 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2024-04-21T08:59:28.801 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2024-04-21T08:59:28.801 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2024-04-21T08:59:28.802 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2024-04-21T08:59:28.803 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2024-04-21T08:59:28.804 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2024-04-21T08:59:28.805 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2024-04-21T08:59:28.806 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2024-04-21T08:59:28.807 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2024-04-21T08:59:30.918 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2024-04-21T08:59:30.918 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2024-04-21T08:59:30.918 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2024-04-21T08:59:30.918 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2024-04-21T08:59:30.918 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2024-04-21T08:59:30.918 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2024-04-21T08:59:30.918 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2024-04-21T08:59:30.919 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2024-04-21T08:59:30.920 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2024-04-21T08:59:30.921 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2024-04-21T08:59:30.922 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2024-04-21T08:59:30.923 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2024-04-21T08:59:30.924 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2024-04-21T08:59:30.924 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2024-04-21T08:59:30.924 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2024-04-21T08:59:32.682 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2024-04-21T08:59:32.682 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2024-04-21T08:59:32.683 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2024-04-21T08:59:32.684 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2024-04-21T08:59:32.685 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2024-04-21T08:59:32.686 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2024-04-21T08:59:32.687 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2024-04-21T08:59:32.688 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2024-04-21T08:59:32.689 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2024-04-21T08:59:34.504 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2024-04-21T08:59:34.505 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2024-04-21T08:59:34.506 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2024-04-21T08:59:34.507 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2024-04-21T08:59:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2024-04-21T08:59:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2024-04-21T08:59:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2024-04-21T08:59:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2024-04-21T08:59:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2024-04-21T08:59:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2024-04-21T08:59:34.508 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2024-04-21T08:59:34.509 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2024-04-21T08:59:34.510 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2024-04-21T08:59:34.510 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2024-04-21T08:59:34.510 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2024-04-21T08:59:34.510 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2024-04-21T08:59:34.510 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2024-04-21T08:59:34.510 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2024-04-21T08:59:34.510 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2024-04-21T08:59:36.352 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2024-04-21T08:59:36.353 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2024-04-21T08:59:36.354 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2024-04-21T08:59:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2024-04-21T08:59:36.356 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2024-04-21T08:59:36.357 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2024-04-21T08:59:36.358 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2024-04-21T08:59:36.358 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2024-04-21T08:59:38.189 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2024-04-21T08:59:38.190 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2024-04-21T08:59:38.191 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2024-04-21T08:59:38.192 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2024-04-21T08:59:38.193 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2024-04-21T08:59:38.194 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2024-04-21T08:59:38.195 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2024-04-21T08:59:40.007 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2024-04-21T08:59:40.007 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2024-04-21T08:59:40.007 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2024-04-21T08:59:40.007 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2024-04-21T08:59:40.008 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2024-04-21T08:59:40.009 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2024-04-21T08:59:40.010 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2024-04-21T08:59:40.011 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2024-04-21T08:59:40.012 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2024-04-21T08:59:42.100 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2024-04-21T08:59:42.101 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2024-04-21T08:59:42.102 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2024-04-21T08:59:42.103 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2024-04-21T08:59:42.104 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2024-04-21T08:59:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2024-04-21T08:59:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2024-04-21T08:59:43.939 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2024-04-21T08:59:43.973 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2024-04-21T08:59:43.973 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2024-04-21T08:59:43.973 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2024-04-21T08:59:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2024-04-21T08:59:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2024-04-21T08:59:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2024-04-21T08:59:43.977 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2024-04-21T08:59:43.978 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2024-04-21T08:59:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2024-04-21T08:59:45.838 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2024-04-21T08:59:45.838 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2024-04-21T08:59:45.839 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2024-04-21T08:59:45.840 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2024-04-21T08:59:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2024-04-21T08:59:45.842 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2024-04-21T08:59:45.843 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2024-04-21T08:59:45.844 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2024-04-21T08:59:47.618 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2024-04-21T08:59:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2024-04-21T08:59:47.620 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2024-04-21T08:59:47.621 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2024-04-21T08:59:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2024-04-21T08:59:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2024-04-21T08:59:47.624 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2024-04-21T08:59:47.625 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2024-04-21T08:59:47.625 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2024-04-21T08:59:49.458 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2024-04-21T08:59:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2024-04-21T08:59:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2024-04-21T08:59:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2024-04-21T08:59:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2024-04-21T08:59:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2024-04-21T08:59:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2024-04-21T08:59:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2024-04-21T08:59:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2024-04-21T08:59:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2024-04-21T08:59:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2024-04-21T08:59:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2024-04-21T08:59:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2024-04-21T08:59:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2024-04-21T08:59:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2024-04-21T08:59:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2024-04-21T08:59:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2024-04-21T08:59:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2024-04-21T08:59:51.114 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2024-04-21T08:59:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2024-04-21T08:59:51.116 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2024-04-21T08:59:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2024-04-21T08:59:51.118 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2024-04-21T08:59:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:Take third snapshot .snap/test3 2024-04-21T08:59:51.274 INFO:tasks.workunit.client.0.smithi026.stdout:Delete the snapshots... 2024-04-21T08:59:51.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:51.956 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T08:59:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:.//.snap/test1 2024-04-21T08:59:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:.//.snap/test2 2024-04-21T08:59:54.378 INFO:tasks.workunit.client.0.smithi026.stdout:.//.snap/test3 2024-04-21T08:59:54.403 INFO:tasks.workunit.client.0.smithi026.stdout:./274/.snap/snap-subdir-test 2024-04-21T08:59:54.429 INFO:tasks.workunit.client.0.smithi026.stdout:./166/.snap/snap-subdir-test 2024-04-21T08:59:54.454 INFO:tasks.workunit.client.0.smithi026.stdout:./256/.snap/snap-subdir-test 2024-04-21T08:59:54.480 INFO:tasks.workunit.client.0.smithi026.stdout:./247/.snap/snap-subdir-test 2024-04-21T08:59:54.505 INFO:tasks.workunit.client.0.smithi026.stdout:./248/.snap/snap-subdir-test 2024-04-21T08:59:54.533 INFO:tasks.workunit.client.0.smithi026.stdout:./147/.snap/snap-subdir-test 2024-04-21T08:59:54.560 INFO:tasks.workunit.client.0.smithi026.stdout:./151/.snap/snap-subdir-test 2024-04-21T08:59:54.587 INFO:tasks.workunit.client.0.smithi026.stdout:./170/.snap/snap-subdir-test 2024-04-21T08:59:54.614 INFO:tasks.workunit.client.0.smithi026.stdout:./167/.snap/snap-subdir-test 2024-04-21T08:59:54.641 INFO:tasks.workunit.client.0.smithi026.stdout:./140/.snap/snap-subdir-test 2024-04-21T08:59:54.667 INFO:tasks.workunit.client.0.smithi026.stdout:./142/.snap/snap-subdir-test 2024-04-21T08:59:54.693 INFO:tasks.workunit.client.0.smithi026.stdout:./150/.snap/snap-subdir-test 2024-04-21T08:59:54.718 INFO:tasks.workunit.client.0.smithi026.stdout:./273/.snap/snap-subdir-test 2024-04-21T08:59:54.741 INFO:tasks.workunit.client.0.smithi026.stdout:./269/.snap/snap-subdir-test 2024-04-21T08:59:54.804 INFO:tasks.workunit.client.0.smithi026.stdout:./105/.snap/snap-subdir-test 2024-04-21T08:59:54.831 INFO:tasks.workunit.client.0.smithi026.stdout:./210/.snap/snap-subdir-test 2024-04-21T08:59:54.855 INFO:tasks.workunit.client.0.smithi026.stdout:./265/.snap/snap-subdir-test 2024-04-21T08:59:54.879 INFO:tasks.workunit.client.0.smithi026.stdout:./218/.snap/snap-subdir-test 2024-04-21T08:59:54.902 INFO:tasks.workunit.client.0.smithi026.stdout:./290/.snap/snap-subdir-test 2024-04-21T08:59:54.927 INFO:tasks.workunit.client.0.smithi026.stdout:./149/.snap/snap-subdir-test 2024-04-21T08:59:54.951 INFO:tasks.workunit.client.0.smithi026.stdout:./109/.snap/snap-subdir-test 2024-04-21T08:59:54.976 INFO:tasks.workunit.client.0.smithi026.stdout:./292/.snap/snap-subdir-test 2024-04-21T08:59:55.000 INFO:tasks.workunit.client.0.smithi026.stdout:./242/.snap/snap-subdir-test 2024-04-21T08:59:55.027 INFO:tasks.workunit.client.0.smithi026.stdout:./158/.snap/snap-subdir-test 2024-04-21T08:59:55.053 INFO:tasks.workunit.client.0.smithi026.stdout:./243/.snap/snap-subdir-test 2024-04-21T08:59:55.079 INFO:tasks.workunit.client.0.smithi026.stdout:./106/.snap/snap-subdir-test 2024-04-21T08:59:55.104 INFO:tasks.workunit.client.0.smithi026.stdout:./250/.snap/snap-subdir-test 2024-04-21T08:59:55.127 INFO:tasks.workunit.client.0.smithi026.stdout:./221/.snap/snap-subdir-test 2024-04-21T08:59:55.152 INFO:tasks.workunit.client.0.smithi026.stdout:./244/.snap/snap-subdir-test 2024-04-21T08:59:55.177 INFO:tasks.workunit.client.0.smithi026.stdout:./258/.snap/snap-subdir-test 2024-04-21T08:59:55.201 INFO:tasks.workunit.client.0.smithi026.stdout:./268/.snap/snap-subdir-test 2024-04-21T08:59:55.226 INFO:tasks.workunit.client.0.smithi026.stdout:./189/.snap/snap-subdir-test 2024-04-21T08:59:55.249 INFO:tasks.workunit.client.0.smithi026.stdout:./285/.snap/snap-subdir-test 2024-04-21T08:59:55.272 INFO:tasks.workunit.client.0.smithi026.stdout:./208/.snap/snap-subdir-test 2024-04-21T08:59:55.295 INFO:tasks.workunit.client.0.smithi026.stdout:./288/.snap/snap-subdir-test 2024-04-21T08:59:55.319 INFO:tasks.workunit.client.0.smithi026.stdout:./209/.snap/snap-subdir-test 2024-04-21T08:59:55.344 INFO:tasks.workunit.client.0.smithi026.stdout:./253/.snap/snap-subdir-test 2024-04-21T08:59:55.374 INFO:tasks.workunit.client.0.smithi026.stdout:./249/.snap/snap-subdir-test 2024-04-21T08:59:55.406 INFO:tasks.workunit.client.0.smithi026.stdout:./133/.snap/snap-subdir-test 2024-04-21T08:59:55.437 INFO:tasks.workunit.client.0.smithi026.stdout:./291/.snap/snap-subdir-test 2024-04-21T08:59:55.468 INFO:tasks.workunit.client.0.smithi026.stdout:./226/.snap/snap-subdir-test 2024-04-21T08:59:55.497 INFO:tasks.workunit.client.0.smithi026.stdout:./173/.snap/snap-subdir-test 2024-04-21T08:59:55.529 INFO:tasks.workunit.client.0.smithi026.stdout:./174/.snap/snap-subdir-test 2024-04-21T08:59:55.558 INFO:tasks.workunit.client.0.smithi026.stdout:./299/.snap/snap-subdir-test 2024-04-21T08:59:55.585 INFO:tasks.workunit.client.0.smithi026.stdout:./262/.snap/snap-subdir-test 2024-04-21T08:59:55.614 INFO:tasks.workunit.client.0.smithi026.stdout:./231/.snap/snap-subdir-test 2024-04-21T08:59:55.643 INFO:tasks.workunit.client.0.smithi026.stdout:./214/.snap/snap-subdir-test 2024-04-21T08:59:55.672 INFO:tasks.workunit.client.0.smithi026.stdout:./281/.snap/snap-subdir-test 2024-04-21T08:59:55.700 INFO:tasks.workunit.client.0.smithi026.stdout:./289/.snap/snap-subdir-test 2024-04-21T08:59:55.729 INFO:tasks.workunit.client.0.smithi026.stdout:./283/.snap/snap-subdir-test 2024-04-21T08:59:55.758 INFO:tasks.workunit.client.0.smithi026.stdout:./232/.snap/snap-subdir-test 2024-04-21T08:59:55.817 INFO:tasks.workunit.client.0.smithi026.stdout:./298/.snap/snap-subdir-test 2024-04-21T08:59:55.844 INFO:tasks.workunit.client.0.smithi026.stdout:./233/.snap/snap-subdir-test 2024-04-21T08:59:55.873 INFO:tasks.workunit.client.0.smithi026.stdout:./155/.snap/snap-subdir-test 2024-04-21T08:59:55.900 INFO:tasks.workunit.client.0.smithi026.stdout:./114/.snap/snap-subdir-test 2024-04-21T08:59:55.925 INFO:tasks.workunit.client.0.smithi026.stdout:./159/.snap/snap-subdir-test 2024-04-21T08:59:55.952 INFO:tasks.workunit.client.0.smithi026.stdout:./187/.snap/snap-subdir-test 2024-04-21T08:59:55.980 INFO:tasks.workunit.client.0.smithi026.stdout:./185/.snap/snap-subdir-test 2024-04-21T08:59:56.004 INFO:tasks.workunit.client.0.smithi026.stdout:./293/.snap/snap-subdir-test 2024-04-21T08:59:56.030 INFO:tasks.workunit.client.0.smithi026.stdout:./228/.snap/snap-subdir-test 2024-04-21T08:59:56.054 INFO:tasks.workunit.client.0.smithi026.stdout:./120/.snap/snap-subdir-test 2024-04-21T08:59:56.079 INFO:tasks.workunit.client.0.smithi026.stdout:./110/.snap/snap-subdir-test 2024-04-21T08:59:56.102 INFO:tasks.workunit.client.0.smithi026.stdout:./267/.snap/snap-subdir-test 2024-04-21T08:59:56.126 INFO:tasks.workunit.client.0.smithi026.stdout:./202/.snap/snap-subdir-test 2024-04-21T08:59:56.149 INFO:tasks.workunit.client.0.smithi026.stdout:./137/.snap/snap-subdir-test 2024-04-21T08:59:56.172 INFO:tasks.workunit.client.0.smithi026.stdout:./246/.snap/snap-subdir-test 2024-04-21T08:59:56.194 INFO:tasks.workunit.client.0.smithi026.stdout:./219/.snap/snap-subdir-test 2024-04-21T08:59:56.217 INFO:tasks.workunit.client.0.smithi026.stdout:./198/.snap/snap-subdir-test 2024-04-21T08:59:56.241 INFO:tasks.workunit.client.0.smithi026.stdout:./136/.snap/snap-subdir-test 2024-04-21T08:59:56.265 INFO:tasks.workunit.client.0.smithi026.stdout:./270/.snap/snap-subdir-test 2024-04-21T08:59:56.290 INFO:tasks.workunit.client.0.smithi026.stdout:./125/.snap/snap-subdir-test 2024-04-21T08:59:56.316 INFO:tasks.workunit.client.0.smithi026.stdout:./194/.snap/snap-subdir-test 2024-04-21T08:59:56.341 INFO:tasks.workunit.client.0.smithi026.stdout:./119/.snap/snap-subdir-test 2024-04-21T08:59:56.365 INFO:tasks.workunit.client.0.smithi026.stdout:./297/.snap/snap-subdir-test 2024-04-21T08:59:56.391 INFO:tasks.workunit.client.0.smithi026.stdout:./230/.snap/snap-subdir-test 2024-04-21T08:59:56.415 INFO:tasks.workunit.client.0.smithi026.stdout:./260/.snap/snap-subdir-test 2024-04-21T08:59:56.438 INFO:tasks.workunit.client.0.smithi026.stdout:./157/.snap/snap-subdir-test 2024-04-21T08:59:56.462 INFO:tasks.workunit.client.0.smithi026.stdout:./172/.snap/snap-subdir-test 2024-04-21T08:59:56.483 INFO:tasks.workunit.client.0.smithi026.stdout:./277/.snap/snap-subdir-test 2024-04-21T08:59:56.507 INFO:tasks.workunit.client.0.smithi026.stdout:./186/.snap/snap-subdir-test 2024-04-21T08:59:56.529 INFO:tasks.workunit.client.0.smithi026.stdout:./237/.snap/snap-subdir-test 2024-04-21T08:59:56.553 INFO:tasks.workunit.client.0.smithi026.stdout:./190/.snap/snap-subdir-test 2024-04-21T08:59:56.574 INFO:tasks.workunit.client.0.smithi026.stdout:./213/.snap/snap-subdir-test 2024-04-21T08:59:56.596 INFO:tasks.workunit.client.0.smithi026.stdout:./104/.snap/snap-subdir-test 2024-04-21T08:59:56.619 INFO:tasks.workunit.client.0.smithi026.stdout:./164/.snap/snap-subdir-test 2024-04-21T08:59:56.642 INFO:tasks.workunit.client.0.smithi026.stdout:./112/.snap/snap-subdir-test 2024-04-21T08:59:56.663 INFO:tasks.workunit.client.0.smithi026.stdout:./295/.snap/snap-subdir-test 2024-04-21T08:59:56.687 INFO:tasks.workunit.client.0.smithi026.stdout:./272/.snap/snap-subdir-test 2024-04-21T08:59:56.710 INFO:tasks.workunit.client.0.smithi026.stdout:./100/.snap/snap-subdir-test 2024-04-21T08:59:56.734 INFO:tasks.workunit.client.0.smithi026.stdout:./134/.snap/snap-subdir-test 2024-04-21T08:59:56.757 INFO:tasks.workunit.client.0.smithi026.stdout:./200/.snap/snap-subdir-test 2024-04-21T08:59:56.799 INFO:tasks.workunit.client.0.smithi026.stdout:./115/.snap/snap-subdir-test 2024-04-21T08:59:56.825 INFO:tasks.workunit.client.0.smithi026.stdout:./284/.snap/snap-subdir-test 2024-04-21T08:59:56.851 INFO:tasks.workunit.client.0.smithi026.stdout:./280/.snap/snap-subdir-test 2024-04-21T08:59:56.878 INFO:tasks.workunit.client.0.smithi026.stdout:./116/.snap/snap-subdir-test 2024-04-21T08:59:56.901 INFO:tasks.workunit.client.0.smithi026.stdout:./245/.snap/snap-subdir-test 2024-04-21T08:59:56.925 INFO:tasks.workunit.client.0.smithi026.stdout:./195/.snap/snap-subdir-test 2024-04-21T08:59:56.950 INFO:tasks.workunit.client.0.smithi026.stdout:./138/.snap/snap-subdir-test 2024-04-21T08:59:56.974 INFO:tasks.workunit.client.0.smithi026.stdout:./135/.snap/snap-subdir-test 2024-04-21T08:59:56.999 INFO:tasks.workunit.client.0.smithi026.stdout:./117/.snap/snap-subdir-test 2024-04-21T08:59:57.023 INFO:tasks.workunit.client.0.smithi026.stdout:./241/.snap/snap-subdir-test 2024-04-21T08:59:57.048 INFO:tasks.workunit.client.0.smithi026.stdout:./143/.snap/snap-subdir-test 2024-04-21T08:59:57.071 INFO:tasks.workunit.client.0.smithi026.stdout:./180/.snap/snap-subdir-test 2024-04-21T08:59:57.095 INFO:tasks.workunit.client.0.smithi026.stdout:./126/.snap/snap-subdir-test 2024-04-21T08:59:57.117 INFO:tasks.workunit.client.0.smithi026.stdout:./161/.snap/snap-subdir-test 2024-04-21T08:59:57.141 INFO:tasks.workunit.client.0.smithi026.stdout:./204/.snap/snap-subdir-test 2024-04-21T08:59:57.164 INFO:tasks.workunit.client.0.smithi026.stdout:./176/.snap/snap-subdir-test 2024-04-21T08:59:57.185 INFO:tasks.workunit.client.0.smithi026.stdout:./255/.snap/snap-subdir-test 2024-04-21T08:59:57.206 INFO:tasks.workunit.client.0.smithi026.stdout:./215/.snap/snap-subdir-test 2024-04-21T08:59:57.227 INFO:tasks.workunit.client.0.smithi026.stdout:./111/.snap/snap-subdir-test 2024-04-21T08:59:57.247 INFO:tasks.workunit.client.0.smithi026.stdout:./238/.snap/snap-subdir-test 2024-04-21T08:59:57.268 INFO:tasks.workunit.client.0.smithi026.stdout:./191/.snap/snap-subdir-test 2024-04-21T08:59:57.289 INFO:tasks.workunit.client.0.smithi026.stdout:./184/.snap/snap-subdir-test 2024-04-21T08:59:57.310 INFO:tasks.workunit.client.0.smithi026.stdout:./192/.snap/snap-subdir-test 2024-04-21T08:59:57.333 INFO:tasks.workunit.client.0.smithi026.stdout:./103/.snap/snap-subdir-test 2024-04-21T08:59:57.356 INFO:tasks.workunit.client.0.smithi026.stdout:./128/.snap/snap-subdir-test 2024-04-21T08:59:57.378 INFO:tasks.workunit.client.0.smithi026.stdout:./229/.snap/snap-subdir-test 2024-04-21T08:59:57.402 INFO:tasks.workunit.client.0.smithi026.stdout:./144/.snap/snap-subdir-test 2024-04-21T08:59:57.427 INFO:tasks.workunit.client.0.smithi026.stdout:./146/.snap/snap-subdir-test 2024-04-21T08:59:57.451 INFO:tasks.workunit.client.0.smithi026.stdout:./227/.snap/snap-subdir-test 2024-04-21T08:59:57.474 INFO:tasks.workunit.client.0.smithi026.stdout:./278/.snap/snap-subdir-test 2024-04-21T08:59:57.498 INFO:tasks.workunit.client.0.smithi026.stdout:./141/.snap/snap-subdir-test 2024-04-21T08:59:57.522 INFO:tasks.workunit.client.0.smithi026.stdout:./234/.snap/snap-subdir-test 2024-04-21T08:59:57.543 INFO:tasks.workunit.client.0.smithi026.stdout:./225/.snap/snap-subdir-test 2024-04-21T08:59:57.567 INFO:tasks.workunit.client.0.smithi026.stdout:./182/.snap/snap-subdir-test 2024-04-21T08:59:57.590 INFO:tasks.workunit.client.0.smithi026.stdout:./107/.snap/snap-subdir-test 2024-04-21T08:59:57.615 INFO:tasks.workunit.client.0.smithi026.stdout:./178/.snap/snap-subdir-test 2024-04-21T08:59:57.637 INFO:tasks.workunit.client.0.smithi026.stdout:./266/.snap/snap-subdir-test 2024-04-21T08:59:57.660 INFO:tasks.workunit.client.0.smithi026.stdout:./240/.snap/snap-subdir-test 2024-04-21T08:59:57.686 INFO:tasks.workunit.client.0.smithi026.stdout:./156/.snap/snap-subdir-test 2024-04-21T08:59:57.711 INFO:tasks.workunit.client.0.smithi026.stdout:./131/.snap/snap-subdir-test 2024-04-21T08:59:57.736 INFO:tasks.workunit.client.0.smithi026.stdout:./123/.snap/snap-subdir-test 2024-04-21T08:59:57.761 INFO:tasks.workunit.client.0.smithi026.stdout:./160/.snap/snap-subdir-test 2024-04-21T08:59:57.788 INFO:tasks.workunit.client.0.smithi026.stdout:./165/.snap/snap-subdir-test 2024-04-21T08:59:57.812 INFO:tasks.workunit.client.0.smithi026.stdout:./101/.snap/snap-subdir-test 2024-04-21T08:59:57.837 INFO:tasks.workunit.client.0.smithi026.stdout:./148/.snap/snap-subdir-test 2024-04-21T08:59:57.863 INFO:tasks.workunit.client.0.smithi026.stdout:./168/.snap/snap-subdir-test 2024-04-21T08:59:57.888 INFO:tasks.workunit.client.0.smithi026.stdout:./179/.snap/snap-subdir-test 2024-04-21T08:59:57.912 INFO:tasks.workunit.client.0.smithi026.stdout:./257/.snap/snap-subdir-test 2024-04-21T08:59:57.933 INFO:tasks.workunit.client.0.smithi026.stdout:./252/.snap/snap-subdir-test 2024-04-21T08:59:57.957 INFO:tasks.workunit.client.0.smithi026.stdout:./132/.snap/snap-subdir-test 2024-04-21T08:59:57.981 INFO:tasks.workunit.client.0.smithi026.stdout:./236/.snap/snap-subdir-test 2024-04-21T08:59:58.002 INFO:tasks.workunit.client.0.smithi026.stdout:./211/.snap/snap-subdir-test 2024-04-21T08:59:58.024 INFO:tasks.workunit.client.0.smithi026.stdout:./199/.snap/snap-subdir-test 2024-04-21T08:59:58.046 INFO:tasks.workunit.client.0.smithi026.stdout:./205/.snap/snap-subdir-test 2024-04-21T08:59:58.069 INFO:tasks.workunit.client.0.smithi026.stdout:./163/.snap/snap-subdir-test 2024-04-21T08:59:58.090 INFO:tasks.workunit.client.0.smithi026.stdout:./261/.snap/snap-subdir-test 2024-04-21T08:59:58.112 INFO:tasks.workunit.client.0.smithi026.stdout:./201/.snap/snap-subdir-test 2024-04-21T08:59:58.132 INFO:tasks.workunit.client.0.smithi026.stdout:./282/.snap/snap-subdir-test 2024-04-21T08:59:58.155 INFO:tasks.workunit.client.0.smithi026.stdout:./296/.snap/snap-subdir-test 2024-04-21T08:59:58.178 INFO:tasks.workunit.client.0.smithi026.stdout:./217/.snap/snap-subdir-test 2024-04-21T08:59:58.202 INFO:tasks.workunit.client.0.smithi026.stdout:./153/.snap/snap-subdir-test 2024-04-21T08:59:58.224 INFO:tasks.workunit.client.0.smithi026.stdout:./206/.snap/snap-subdir-test 2024-04-21T08:59:58.247 INFO:tasks.workunit.client.0.smithi026.stdout:./122/.snap/snap-subdir-test 2024-04-21T08:59:58.270 INFO:tasks.workunit.client.0.smithi026.stdout:./162/.snap/snap-subdir-test 2024-04-21T08:59:58.294 INFO:tasks.workunit.client.0.smithi026.stdout:./197/.snap/snap-subdir-test 2024-04-21T08:59:58.315 INFO:tasks.workunit.client.0.smithi026.stdout:./216/.snap/snap-subdir-test 2024-04-21T08:59:59.991 INFO:tasks.workunit.client.0.smithi026.stdout:./254/.snap/snap-subdir-test 2024-04-21T09:00:00.019 INFO:tasks.workunit.client.0.smithi026.stdout:./113/.snap/snap-subdir-test 2024-04-21T09:00:00.043 INFO:tasks.workunit.client.0.smithi026.stdout:./152/.snap/snap-subdir-test 2024-04-21T09:00:00.066 INFO:tasks.workunit.client.0.smithi026.stdout:./121/.snap/snap-subdir-test 2024-04-21T09:00:00.088 INFO:tasks.workunit.client.0.smithi026.stdout:./118/.snap/snap-subdir-test 2024-04-21T09:00:00.111 INFO:tasks.workunit.client.0.smithi026.stdout:./196/.snap/snap-subdir-test 2024-04-21T09:00:00.133 INFO:tasks.workunit.client.0.smithi026.stdout:./124/.snap/snap-subdir-test 2024-04-21T09:00:00.152 INFO:tasks.workunit.client.0.smithi026.stdout:./239/.snap/snap-subdir-test 2024-04-21T09:00:00.173 INFO:tasks.workunit.client.0.smithi026.stdout:./188/.snap/snap-subdir-test 2024-04-21T09:00:00.194 INFO:tasks.workunit.client.0.smithi026.stdout:./287/.snap/snap-subdir-test 2024-04-21T09:00:00.215 INFO:tasks.workunit.client.0.smithi026.stdout:./275/.snap/snap-subdir-test 2024-04-21T09:00:00.237 INFO:tasks.workunit.client.0.smithi026.stdout:./259/.snap/snap-subdir-test 2024-04-21T09:00:00.257 INFO:tasks.workunit.client.0.smithi026.stdout:./224/.snap/snap-subdir-test 2024-04-21T09:00:00.277 INFO:tasks.workunit.client.0.smithi026.stdout:./264/.snap/snap-subdir-test 2024-04-21T09:00:00.299 INFO:tasks.workunit.client.0.smithi026.stdout:./145/.snap/snap-subdir-test 2024-04-21T09:00:00.320 INFO:tasks.workunit.client.0.smithi026.stdout:./279/.snap/snap-subdir-test 2024-04-21T09:00:00.343 INFO:tasks.workunit.client.0.smithi026.stdout:./263/.snap/snap-subdir-test 2024-04-21T09:00:00.370 INFO:tasks.workunit.client.0.smithi026.stdout:./130/.snap/snap-subdir-test 2024-04-21T09:00:00.407 INFO:tasks.workunit.client.0.smithi026.stdout:./193/.snap/snap-subdir-test 2024-04-21T09:00:00.428 INFO:tasks.workunit.client.0.smithi026.stdout:./223/.snap/snap-subdir-test 2024-04-21T09:00:00.450 INFO:tasks.workunit.client.0.smithi026.stdout:./207/.snap/snap-subdir-test 2024-04-21T09:00:00.473 INFO:tasks.workunit.client.0.smithi026.stdout:./276/.snap/snap-subdir-test 2024-04-21T09:00:00.497 INFO:tasks.workunit.client.0.smithi026.stdout:./271/.snap/snap-subdir-test 2024-04-21T09:00:00.518 INFO:tasks.workunit.client.0.smithi026.stdout:./251/.snap/snap-subdir-test 2024-04-21T09:00:00.541 INFO:tasks.workunit.client.0.smithi026.stdout:./175/.snap/snap-subdir-test 2024-04-21T09:00:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:./222/.snap/snap-subdir-test 2024-04-21T09:00:00.583 INFO:tasks.workunit.client.0.smithi026.stdout:./220/.snap/snap-subdir-test 2024-04-21T09:00:00.603 INFO:tasks.workunit.client.0.smithi026.stdout:./203/.snap/snap-subdir-test 2024-04-21T09:00:00.624 INFO:tasks.workunit.client.0.smithi026.stdout:./181/.snap/snap-subdir-test 2024-04-21T09:00:00.643 INFO:tasks.workunit.client.0.smithi026.stdout:./286/.snap/snap-subdir-test 2024-04-21T09:00:00.665 INFO:tasks.workunit.client.0.smithi026.stdout:./127/.snap/snap-subdir-test 2024-04-21T09:00:00.687 INFO:tasks.workunit.client.0.smithi026.stdout:./108/.snap/snap-subdir-test 2024-04-21T09:00:00.709 INFO:tasks.workunit.client.0.smithi026.stdout:./183/.snap/snap-subdir-test 2024-04-21T09:00:00.730 INFO:tasks.workunit.client.0.smithi026.stdout:./294/.snap/snap-subdir-test 2024-04-21T09:00:00.752 INFO:tasks.workunit.client.0.smithi026.stdout:./235/.snap/snap-subdir-test 2024-04-21T09:00:00.775 INFO:tasks.workunit.client.0.smithi026.stdout:./177/.snap/snap-subdir-test 2024-04-21T09:00:00.799 INFO:tasks.workunit.client.0.smithi026.stdout:./169/.snap/snap-subdir-test 2024-04-21T09:00:00.818 INFO:tasks.workunit.client.0.smithi026.stdout:./212/.snap/snap-subdir-test 2024-04-21T09:00:00.840 INFO:tasks.workunit.client.0.smithi026.stdout:./154/.snap/snap-subdir-test 2024-04-21T09:00:00.860 INFO:tasks.workunit.client.0.smithi026.stdout:./171/.snap/snap-subdir-test 2024-04-21T09:00:00.881 INFO:tasks.workunit.client.0.smithi026.stdout:./139/.snap/snap-subdir-test 2024-04-21T09:00:00.902 INFO:tasks.workunit.client.0.smithi026.stdout:./102/.snap/snap-subdir-test 2024-04-21T09:00:00.923 INFO:tasks.workunit.client.0.smithi026.stdout:./129/.snap/snap-subdir-test 2024-04-21T09:00:06.670 INFO:tasks.workunit.client.0.smithi026.stdout:Delete all the files and directories ... 2024-04-21T09:00:07.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/19' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/15' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/31' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/36' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/20' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/12' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/39' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/10' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/34' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/38' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/11' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/16' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/32' 2024-04-21T09:00:07.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/30' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/14' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/18' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/13' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/33' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/17' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/35' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './100/37' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './100' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/19' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/15' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/31' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/36' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/20' 2024-04-21T09:00:07.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/12' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/39' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/10' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/34' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/38' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/11' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/16' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/32' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/30' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/14' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/18' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/13' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/33' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/17' 2024-04-21T09:00:07.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/35' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './101/37' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './101' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/19' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/15' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/31' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/36' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/20' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/12' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/39' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/10' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/34' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/38' 2024-04-21T09:00:07.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/11' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/16' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/32' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/30' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/14' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/18' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/13' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/33' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/17' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/35' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './102/37' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './102' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/19' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/15' 2024-04-21T09:00:07.812 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/31' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/36' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/20' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/12' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/39' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/10' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/34' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/38' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/11' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/16' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/32' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/30' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/14' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/18' 2024-04-21T09:00:07.813 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/13' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/33' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/17' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/35' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './103/37' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './103' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/19' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/15' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/31' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/36' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/20' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/12' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/39' 2024-04-21T09:00:07.814 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/10' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/34' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/38' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/11' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/16' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/32' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/30' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/14' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/18' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/13' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/33' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/17' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/35' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed './104/37' 2024-04-21T09:00:07.815 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './104' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/19' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/15' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/31' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/36' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/20' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/12' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/39' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/10' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/34' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/38' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/11' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/16' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/32' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/30' 2024-04-21T09:00:07.816 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/14' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/18' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/13' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/33' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/17' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/35' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './105/37' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './105' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/19' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/15' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/31' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/36' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/20' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/12' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/39' 2024-04-21T09:00:07.817 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/10' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/34' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/38' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/11' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/16' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/32' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/30' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/14' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/18' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/13' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/33' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/17' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/35' 2024-04-21T09:00:07.818 INFO:tasks.workunit.client.0.smithi026.stdout:removed './106/37' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './106' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/19' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/15' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/31' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/36' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/20' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/12' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/39' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/10' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/34' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/38' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/11' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/16' 2024-04-21T09:00:07.819 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/32' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/30' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/14' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/18' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/13' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/33' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/17' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/35' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './107/37' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './107' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/19' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/15' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/31' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/36' 2024-04-21T09:00:07.820 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/20' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/12' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/39' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/10' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/34' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/38' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/11' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/16' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/32' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/30' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/14' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/18' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/13' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/33' 2024-04-21T09:00:07.821 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/17' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/35' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './108/37' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './108' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/19' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/15' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/31' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/36' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/20' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/12' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/39' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/10' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/34' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/38' 2024-04-21T09:00:07.822 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/11' 2024-04-21T09:00:07.823 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/16' 2024-04-21T09:00:07.823 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/32' 2024-04-21T09:00:07.823 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/30' 2024-04-21T09:00:07.934 INFO:tasks.quiescer.fs.[cephfs]:Total duration (50.2) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-21T09:00:07.934 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.1 2024-04-21T09:00:07.935 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:00:08.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4058ae9640 1 Processor -- start 2024-04-21T09:00:08.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4058ae9640 1 -- start start 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4058ae9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f40540c52b0 0x7f40540c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4058ae9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40540c6050 con 0x7f40540c5690 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4058ae9640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40540c3470 con 0x7f4054073b50 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4058ae9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f40540c5e00 con 0x7f40540c52b0 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f40540c5690 0x7f405406ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51002/0 (socket says 172.21.15.26:51002) 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 -- 172.21.15.26:0/1626127565 learned_addr learned my addr 172.21.15.26:0/1626127565 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344049224 0 0) 0x7f40540c6050 con 0x7f40540c5690 2024-04-21T09:00:08.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f403c003530 con 0x7f40540c5690 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405259c640 1 --2- 172.21.15.26:0/1626127565 >> v2:172.21.15.169:3300/0 conn(0x7f40540c52b0 0x7f40540c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1570080784 0 0) 0x7f403c003530 con 0x7f40540c5690 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 >> v2:172.21.15.169:3300/0 conn(0x7f40540c52b0 msgr2=0x7f40540c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 --2- 172.21.15.26:0/1626127565 >> v2:172.21.15.169:3300/0 conn(0x7f40540c52b0 0x7f40540c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 >> v1:172.21.15.169:6789/0 conn(0x7f4054073b50 legacy=0x7f40541529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40540c3750 con 0x7f40540c5690 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f404c001a00 con 0x7f40540c5690 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 >> v1:172.21.15.26:6789/0 conn(0x7f40540c5690 legacy=0x7f405406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0039c0 0x7f403c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f403c004810 0x7f403c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403c0053d0 0x7f403c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f40540c5e00 con 0x7f403c0053d0 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f403c00c260 con 0x7f403c004810 2024-04-21T09:00:08.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f403c00c460 con 0x7f403c0039c0 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403c0053d0 0x7f403c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4051d9b640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f403c004810 0x7f403c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f405259c640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0039c0 0x7f403c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 -- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0039c0 msgr2=0x7f403c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0039c0 0x7f403c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 -- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f403c004810 msgr2=0x7f403c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f403c004810 0x7f403c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.044+0000 7f4052d9d640 1 -- 172.21.15.26:0/1626127565 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c003530 con 0x7f403c0053d0 2024-04-21T09:00:08.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4052d9d640 1 -- 172.21.15.26:0/1626127565 reap_dead start 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4052d9d640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403c0053d0 0x7f403c00b9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f404c00a860 tx=0x7f404c01d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4761671df9ed787d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c00a480 con 0x7f403c0053d0 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c0a5e50 con 0x7f403c0053d0 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f405159a640 1 -- 172.21.15.26:0/1626127565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c0ad870 con 0x7f403c0053d0 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 -- 172.21.15.26:0/1626127565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403c0053d0 msgr2=0x7f403c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403c0053d0 0x7f403c00b9d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f404c00a860 tx=0x7f404c01d380 comp rx=0 tx=0).stop 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 -- 172.21.15.26:0/1626127565 shutdown_connections 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 --2- 172.21.15.26:0/1626127565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f403c0053d0 0x7f403c00b9d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 -- 172.21.15.26:0/1626127565 >> 172.21.15.26:0/1626127565 conn(0x7f40540c8960 msgr2=0x7f40540c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 -- 172.21.15.26:0/1626127565 shutdown_connections 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 -- 172.21.15.26:0/1626127565 wait complete. 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 Processor -- start 2024-04-21T09:00:08.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.048+0000 7f4058ae9640 1 -- start start 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0053d0 0x7f4054146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f405414a7d0 0x7f40540c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414abf0 0x7f40540c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f40540c97e0 con 0x7f405414abf0 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f40540c9660 con 0x7f405414a7d0 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f40540c6330 con 0x7f403c0053d0 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414abf0 0x7f40540c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414abf0 0x7f40540c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56716/0 (socket says 172.21.15.26:56716) 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 -- 172.21.15.26:0/366874382 learned_addr learned my addr 172.21.15.26:0/366874382 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f405259c640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0053d0 0x7f4054146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4051d9b640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f405414a7d0 0x7f40540c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 -- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0053d0 msgr2=0x7f4054146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0053d0 0x7f4054146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 -- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f405414a7d0 msgr2=0x7f40540c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f405414a7d0 0x7f40540c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 -- 172.21.15.26:0/366874382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40540ca950 con 0x7f405414abf0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f405259c640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0053d0 0x7f4054146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4052d9d640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414abf0 0x7f40540c7cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f404c01dc20 tx=0x7f403c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4042ffd640 1 -- 172.21.15.26:0/366874382 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c0bc070 con 0x7f405414abf0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4042ffd640 1 -- 172.21.15.26:0/366874382 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c0019c0 con 0x7f405414abf0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4042ffd640 1 -- 172.21.15.26:0/366874382 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c00a480 con 0x7f405414abf0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40540cabf0 con 0x7f405414abf0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40540c6f70 con 0x7f405414abf0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4054075ef0 con 0x7f405414abf0 2024-04-21T09:00:08.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4042ffd640 1 -- 172.21.15.26:0/366874382 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f404c0bf070 con 0x7f405414abf0 2024-04-21T09:00:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4042ffd640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4034068380 0x7f403406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f4042ffd640 1 -- 172.21.15.26:0/366874382 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6258+0+0 (secure 0 0 0) 0x7f404c1207e0 con 0x7f405414abf0 2024-04-21T09:00:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.052+0000 7f405259c640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4034068380 0x7f403406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.056+0000 7f405259c640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4034068380 0x7f403406a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4044003870 tx=0x7f4044008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.056+0000 7f4042ffd640 1 -- 172.21.15.26:0/366874382 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f404c0b4070 con 0x7f405414abf0 2024-04-21T09:00:08.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.252+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40540727e0 con 0x7f405414abf0 2024-04-21T09:00:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.252+0000 7f4042ffd640 1 -- 172.21.15.26:0/366874382 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f40541599e0 con 0x7f405414abf0 2024-04-21T09:00:08.254 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:00:08.254 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:00:08.254 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:00:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4034068380 msgr2=0x7f403406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4034068380 0x7f403406a840 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4044003870 tx=0x7f4044008040 comp rx=0 tx=0).stop 2024-04-21T09:00:08.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414abf0 msgr2=0x7f40540c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414abf0 0x7f40540c7cb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f404c01dc20 tx=0x7f403c005840 comp rx=0 tx=0).stop 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 shutdown_connections 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4034068380 0x7f403406a840 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405414abf0 0x7f40540c7cb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f405414a7d0 0x7f40540c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 --2- 172.21.15.26:0/366874382 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f403c0053d0 0x7f4054146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 >> 172.21.15.26:0/366874382 conn(0x7f40540c8960 msgr2=0x7f405414c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 shutdown_connections 2024-04-21T09:00:08.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.256+0000 7f4058ae9640 1 -- 172.21.15.26:0/366874382 wait complete. 2024-04-21T09:00:08.272 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 85.1 --await' 2024-04-21T09:00:08.272 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 85.1 --await 2024-04-21T09:00:08.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c817a6640 1 Processor -- start 2024-04-21T09:00:08.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c817a6640 1 -- start start 2024-04-21T09:00:08.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c817a6640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0c7c152910 0x7f0c7c06eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c817a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 0x7f0c7c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c817a6640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c7c15bdd0 con 0x7f0c7c152cf0 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c817a6640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0c7c073880 con 0x7f0c7c152910 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c817a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c073520 con 0x7f0c7c0c79a0 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7a7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0c7c152cf0 0x7f0c7c072e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51010/0 (socket says 172.21.15.26:51010) 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/962554604 learned_addr learned my addr 172.21.15.26:0/962554604 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 0x7f0c7c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313764207 0 0) 0x7f0c7c15bdd0 con 0x7f0c7c152cf0 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c68003530 con 0x7f0c7c152cf0 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7affd640 1 --2- 172.21.15.26:0/962554604 >> v2:172.21.15.169:3300/0 conn(0x7f0c7c152910 0x7f0c7c06eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 507459415 0 0) 0x7f0c68003530 con 0x7f0c7c152cf0 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 msgr2=0x7f0c7c15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 0x7f0c7c15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 >> v2:172.21.15.169:3300/0 conn(0x7f0c7c152910 msgr2=0x7f0c7c06eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 --2- 172.21.15.26:0/962554604 >> v2:172.21.15.169:3300/0 conn(0x7f0c7c152910 0x7f0c7c06eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c073b40 con 0x7f0c7c152cf0 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f0c64001680 con 0x7f0c7c152cf0 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 >> v1:172.21.15.26:6789/0 conn(0x7f0c7c152cf0 legacy=0x7f0c7c072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c680039c0 0x7f0c68003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c68004810 0x7f0c68004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 0x7f0c680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c073880 con 0x7f0c68004810 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c073520 con 0x7f0c680039c0 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6800ba80 con 0x7f0c7c0c79a0 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c68004810 0x7f0c68004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7affd640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c680039c0 0x7f0c68003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 msgr2=0x7f0c680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 0x7f0c680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.400+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c7c0c79a0 0x7f0c680051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c680039c0 msgr2=0x7f0c68003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c680039c0 0x7f0c68003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/962554604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c68003530 con 0x7f0c68004810 2024-04-21T09:00:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c68004810 0x7f0c68004c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400c210 tx=0x7f0c6401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00d3ffc6b961a63 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64007d40 con 0x7f0c68004810 2024-04-21T09:00:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c640a9070 con 0x7f0c68004810 2024-04-21T09:00:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c79ffb640 1 -- 172.21.15.26:0/962554604 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c64005d40 con 0x7f0c68004810 2024-04-21T09:00:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c817a6640 1 -- 172.21.15.26:0/962554604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c68004810 msgr2=0x7f0c68004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c817a6640 1 --2- 172.21.15.26:0/962554604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c68004810 0x7f0c68004c90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400c210 tx=0x7f0c6401cca0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/962554604 reap_dead start 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c817a6640 1 -- 172.21.15.26:0/962554604 shutdown_connections 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c817a6640 1 -- 172.21.15.26:0/962554604 >> 172.21.15.26:0/962554604 conn(0x7f0c7c070190 msgr2=0x7f0c7c0705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c817a6640 1 -- 172.21.15.26:0/962554604 shutdown_connections 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.404+0000 7f0c817a6640 1 -- 172.21.15.26:0/962554604 wait complete. 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 Processor -- start 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 -- start start 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c68004810 0x7f0c7c0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c7c1f3470 0x7f0c7c1f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c7c153820 0x7f0c7c1f3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c073e20 con 0x7f0c7c153820 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c15c320 con 0x7f0c7c1f3470 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c15c840 con 0x7f0c68004810 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c7c153820 0x7f0c7c1f3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c7c153820 0x7f0c7c1f3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56732/0 (socket says 172.21.15.26:56732) 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/1500398064 learned_addr learned my addr 172.21.15.26:0/1500398064 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c7c1f3470 0x7f0c7c1f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c68004810 0x7f0c7c0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c68004810 msgr2=0x7f0c7c0b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c68004810 0x7f0c7c0b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c7c1f3470 msgr2=0x7f0c7c1f0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c7c1f3470 0x7f0c7c1f0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/1500398064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c7c1f00d0 con 0x7f0c7c153820 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c7c153820 0x7f0c7c1f3dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0714a0 tx=0x7f0c6c010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c737fe640 1 -- 172.21.15.26:0/1500398064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00f040 con 0x7f0c7c153820 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c737fe640 1 -- 172.21.15.26:0/1500398064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c00e840 con 0x7f0c7c153820 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c7c154590 con 0x7f0c7c153820 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c737fe640 1 -- 172.21.15.26:0/1500398064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00ec30 con 0x7f0c7c153820 2024-04-21T09:00:08.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c7c153fd0 con 0x7f0c7c153820 2024-04-21T09:00:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c737fe640 1 -- 172.21.15.26:0/1500398064 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c6c01c400 con 0x7f0c7c153820 2024-04-21T09:00:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.408+0000 7f0c737fe640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c5c068380 0x7f0c5c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c737fe640 1 -- 172.21.15.26:0/1500398064 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6258+0+0 (secure 0 0 0) 0x7f0c6c086e50 con 0x7f0c7c153820 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c5c068380 0x7f0c5c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 Processor -- start 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- start start 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c5c068380 0x7f0c5c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c74004330 tx=0x7f0c7400b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc2613fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc264f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc264fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55efc24f5650 con 0x55efc264a5a0 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55efc245dbf0 con 0x55efc264f990 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55efc24030c0 con 0x55efc2614500 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc2613fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc2613fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56734/0 (socket says 172.21.15.26:56734) 2024-04-21T09:00:08.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 -- 172.21.15.26:0/3191880448 learned_addr learned my addr 172.21.15.26:0/3191880448 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 -- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 msgr2=0x55efc264f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc264f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc264fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc264f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 -- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 msgr2=0x55efc264fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc264fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 -- 172.21.15.26:0/3191880448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc241ffe0 con 0x55efc264a5a0 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c7affd640 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc2613fc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c740040d0 tx=0x7f0c74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a41be0f3b53a52 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c70ff9640 1 -- 172.21.15.26:0/3191880448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7401d050 con 0x55efc264a5a0 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c70ff9640 1 -- 172.21.15.26:0/3191880448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74027070 con 0x55efc264a5a0 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c70ff9640 1 -- 172.21.15.26:0/3191880448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c74017810 con 0x55efc264a5a0 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- 172.21.15.26:0/3191880448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 msgr2=0x55efc2613fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc2613fc0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c740040d0 tx=0x7f0c74014000 comp rx=0 tx=0).stop 2024-04-21T09:00:08.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- 172.21.15.26:0/3191880448 shutdown_connections 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc264fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc264f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 --2- 172.21.15.26:0/3191880448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc2613fc0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- 172.21.15.26:0/3191880448 >> 172.21.15.26:0/3191880448 conn(0x55efc264b200 msgr2=0x55efc264d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- 172.21.15.26:0/3191880448 shutdown_connections 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- 172.21.15.26:0/3191880448 wait complete. 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 -- start start 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.412+0000 7f0c84928000 1 Processor -- start 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc260bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc260c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc260c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55efc2419540 con 0x55efc264a5a0 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55efc245cf00 con 0x55efc264f990 2024-04-21T09:00:08.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55efc2462220 con 0x55efc2614500 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 10 client.0 _ll_register_callbacks cb 0x55efc25f99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc260c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc260c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56740/0 (socket says 172.21.15.26:56740) 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/1638559626 learned_addr learned my addr 172.21.15.26:0/1638559626 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc260bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc260c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 msgr2=0x55efc260bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc260bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 msgr2=0x55efc260c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc260c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 -- 172.21.15.26:0/1638559626 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc246a570 con 0x55efc264a5a0 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc260c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:00:08.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc260c190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400c210 tx=0x7f0c6401b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fee92fe682eea3bd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c59ffb640 1 -- 172.21.15.26:0/1638559626 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c640a5ac0 con 0x55efc264a5a0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c59ffb640 1 -- 172.21.15.26:0/1638559626 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6258+0+0 (secure 0 0 0) 0x7f0c640bacd0 con 0x55efc264a5a0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c74027070 con 0x55efc264a5a0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c59ffb640 1 -- 172.21.15.26:0/1638559626 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0c640a5c60 con 0x55efc264a5a0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 10 client.4821 fetch_fsmap learned FSMap version 8 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55efc2403310 con 0x55efc264a5a0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c59ffb640 1 -- 172.21.15.26:0/1638559626 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74027070 con 0x55efc264a5a0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c59ffb640 1 -- 172.21.15.26:0/1638559626 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0c640c1050 con 0x55efc264a5a0 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 10 client.4821 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 10 client.4821 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 20 client.4821 populate_metadata read hostname 'smithi026' 2024-04-21T09:00:08.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc2663150 0x55efc2665540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 4 client.4821 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:00:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55efc23f7880 con 0x55efc2663150 2024-04-21T09:00:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc2663150 0x55efc2665540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc2663150 0x55efc2665540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8898403ee4e526de server_cookie=164bd1ce3e47a9b7 in_seq=0 out_seq=0 2024-04-21T09:00:08.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.416+0000 7f0c59ffb640 10 client.4821 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c59ffb640 1 -- 172.21.15.26:0/1638559626 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55efc23f7880 con 0x55efc2663150 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c59ffb640 10 client.4821 handle_command_reply: tid=0 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 client.4821 shutdown 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 msgr2=0x55efc260c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc260c190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0c6400c210 tx=0x7f0c6401b4e0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 shutdown_connections 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc2663150 0x55efc2665540 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264f990 0x55efc260c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264a5a0 0x55efc260c190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 --2- 172.21.15.26:0/1638559626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc260bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c59ffb640 0 client.4821 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 >> 172.21.15.26:0/1638559626 conn(0x55efc264b200 msgr2=0x55efc2649bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 shutdown_connections 2024-04-21T09:00:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 1 -- 172.21.15.26:0/1638559626 wait complete. 2024-04-21T09:00:08.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.420+0000 7f0c84928000 20 client.4821 trim_cache size 0 max 16384 2024-04-21T09:00:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 Processor -- start 2024-04-21T09:00:08.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- start start 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc2614500 0x55efc260f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc260f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc264f990 0x55efc260ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1fd290 con 0x55efc2614500 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0c7c1fc5d0 con 0x55efc264a5a0 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0c7c1fcc20 con 0x55efc264f990 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc2614500 0x55efc260f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc2614500 0x55efc260f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56752/0 (socket says 172.21.15.26:56752) 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 -- 172.21.15.26:0/1204799826 learned_addr learned my addr 172.21.15.26:0/1204799826 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 -- 172.21.15.26:0/1204799826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc264f990 msgr2=0x55efc260ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1204799826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc264f990 0x55efc260ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 -- 172.21.15.26:0/1204799826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 msgr2=0x55efc260f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1204799826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc260f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 -- 172.21.15.26:0/1204799826 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55efc2429ab0 con 0x55efc2614500 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c7affd640 1 --2- 172.21.15.26:0/1204799826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc2614500 0x55efc260f480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c74023000 tx=0x7f0c74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3227398091f8a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c5bfff640 1 -- 172.21.15.26:0/1204799826 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7403c070 con 0x55efc2614500 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c5bfff640 1 -- 172.21.15.26:0/1204799826 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74027050 con 0x55efc2614500 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c5bfff640 1 -- 172.21.15.26:0/1204799826 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7401d040 con 0x55efc2614500 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- 172.21.15.26:0/1204799826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc2614500 msgr2=0x55efc260f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 --2- 172.21.15.26:0/1204799826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc2614500 0x55efc260f480 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0c74023000 tx=0x7f0c74016000 comp rx=0 tx=0).stop 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- 172.21.15.26:0/1204799826 shutdown_connections 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 --2- 172.21.15.26:0/1204799826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc264f990 0x55efc260ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 --2- 172.21.15.26:0/1204799826 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc260f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 --2- 172.21.15.26:0/1204799826 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc2614500 0x55efc260f480 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- 172.21.15.26:0/1204799826 >> 172.21.15.26:0/1204799826 conn(0x55efc264b200 msgr2=0x55efc2645860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:08.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- 172.21.15.26:0/1204799826 shutdown_connections 2024-04-21T09:00:08.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.436+0000 7f0c84928000 1 -- 172.21.15.26:0/1204799826 wait complete. 2024-04-21T09:00:08.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 -- start start 2024-04-21T09:00:08.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 Processor -- start 2024-04-21T09:00:08.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc2613000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc2685100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264f990 0x55efc2685640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55efc23f4470 con 0x55efc264f990 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55efc246ae00 con 0x55efc264a5a0 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55efc2421b70 con 0x55efc2614500 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 10 client.0 _ll_register_callbacks cb 0x7f0c68003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264f990 0x55efc2685640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264f990 0x55efc2685640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56756/0 (socket says 172.21.15.26:56756) 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/845231157 learned_addr learned my addr 172.21.15.26:0/845231157 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7affd640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc2613000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc2685100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 msgr2=0x55efc2613000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc2613000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 msgr2=0x55efc2685100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc2685100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 -- 172.21.15.26:0/845231157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55efc24de660 con 0x55efc264f990 2024-04-21T09:00:08.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7a7fc640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc2685100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7b7fe640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264f990 0x55efc2685640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c05f220 tx=0x7f0c6c056d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b211691a64276b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c59ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c59ffb640 1 -- 172.21.15.26:0/845231157 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c06f070 con 0x55efc264f990 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c59ffb640 1 -- 172.21.15.26:0/845231157 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6258+0+0 (secure 0 0 0) 0x7f0c6c072ce0 con 0x55efc264f990 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0c74027050 con 0x55efc264f990 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c59ffb640 1 -- 172.21.15.26:0/845231157 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0c6c05f2c0 con 0x55efc264f990 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 10 client.4827 fetch_fsmap learned FSMap version 8 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55efc23f36a0 con 0x55efc264f990 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c59ffb640 1 -- 172.21.15.26:0/845231157 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c74027050 con 0x55efc264f990 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c59ffb640 1 -- 172.21.15.26:0/845231157 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0c6c07eb40 con 0x55efc264f990 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 10 client.4827 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 10 client.4827 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 20 client.4827 populate_metadata read hostname 'smithi026' 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc26c44f0 0x55efc26c4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:08.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 4 client.4827 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.1, "await": true}] 2024-04-21T09:00:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.1, "await": true}) -- 0x55efc246b610 con 0x55efc26c44f0 2024-04-21T09:00:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7affd640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc26c44f0 0x55efc26c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c59ffb640 10 client.4827 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:08.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:08.440+0000 7f0c7affd640 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc26c44f0 0x55efc26c4900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=668e558afaec8c9f server_cookie=30dc853ef7ee76b in_seq=0 out_seq=0 2024-04-21T09:00:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c59ffb640 1 -- 172.21.15.26:0/845231157 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x55efc246b610 con 0x55efc26c44f0 2024-04-21T09:00:12.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c59ffb640 10 client.4827 handle_command_reply: tid=0 2024-04-21T09:00:12.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 client.4827 shutdown 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264f990 msgr2=0x55efc2685640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264f990 0x55efc2685640 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c05f220 tx=0x7f0c6c056d60 comp rx=0 tx=0).stop 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 shutdown_connections 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55efc26c44f0 0x55efc26c4900 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55efc264f990 0x55efc2685640 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55efc264a5a0 0x55efc2685100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c59ffb640 0 client.4827 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 --2- 172.21.15.26:0/845231157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55efc2614500 0x55efc2613000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 >> 172.21.15.26:0/845231157 conn(0x55efc264b200 msgr2=0x55efc2669560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 shutdown_connections 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 1 -- 172.21.15.26:0/845231157 wait complete. 2024-04-21T09:00:12.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c84928000 20 client.4827 trim_cache size 0 max 16384 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 2, 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "c18cc09d": { 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 2, 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:00:12.659 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 85.1, 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:12.660 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:00:12.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c5c068380 msgr2=0x7f0c5c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:12.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c5c068380 0x7f0c5c06a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0c74004330 tx=0x7f0c7400b040 comp rx=0 tx=0).stop 2024-04-21T09:00:12.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c7c153820 msgr2=0x7f0c7c1f3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c7c153820 0x7f0c7c1f3dd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0714a0 tx=0x7f0c6c010c20 comp rx=0 tx=0).stop 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 shutdown_connections 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f0c5c068380 0x7f0c5c06a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c7c153820 0x7f0c7c1f3dd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c7c1f3470 0x7f0c7c1f0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 --2- 172.21.15.26:0/1500398064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c68004810 0x7f0c7c0b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 >> 172.21.15.26:0/1500398064 conn(0x7f0c7c070190 msgr2=0x7f0c7c0c3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 shutdown_connections 2024-04-21T09:00:12.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:12.656+0000 7f0c817a6640 1 -- 172.21.15.26:0/1500398064 wait complete. 2024-04-21T09:00:12.684 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: c18cc09d, quiesce duration: 25.1 2024-04-21T09:00:22.001 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:00:22.003 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:00:37.785 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:00:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 Processor -- start 2024-04-21T09:00:37.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 -- start start 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe840c52b0 0x7fbe840c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe84073b50 0x7fbe841595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe840c5690 0x7fbe841529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbe840c5e00 con 0x7fbe840c5690 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fbe840c6330 con 0x7fbe840c52b0 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe8b651640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbe840c6050 con 0x7fbe84073b50 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe840c5690 0x7fbe841529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe840c5690 0x7fbe841529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56738/0 (socket says 172.21.15.26:56738) 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 -- 172.21.15.26:0/1604324049 learned_addr learned my addr 172.21.15.26:0/1604324049 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:37.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe88bec640 1 --2- 172.21.15.26:0/1604324049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe84073b50 0x7fbe841595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe893ed640 1 --2- 172.21.15.26:0/1604324049 >> v2:172.21.15.169:3300/0 conn(0x7fbe840c52b0 0x7fbe840c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 -- 172.21.15.26:0/1604324049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe84073b50 msgr2=0x7fbe841595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 --2- 172.21.15.26:0/1604324049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe84073b50 0x7fbe841595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 -- 172.21.15.26:0/1604324049 >> v2:172.21.15.169:3300/0 conn(0x7fbe840c52b0 msgr2=0x7fbe840c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 --2- 172.21.15.26:0/1604324049 >> v2:172.21.15.169:3300/0 conn(0x7fbe840c52b0 0x7fbe840c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe89bee640 1 -- 172.21.15.26:0/1604324049 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840c3470 con 0x7fbe840c5690 2024-04-21T09:00:37.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.919+0000 7fbe88bec640 1 --2- 172.21.15.26:0/1604324049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe84073b50 0x7fbe841595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:00:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe89bee640 1 --2- 172.21.15.26:0/1604324049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe840c5690 0x7fbe841529d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe84070e40 tx=0x7fbe7c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f491d9db54a818f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe7bfff640 1 -- 172.21.15.26:0/1604324049 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0a5660 con 0x7fbe840c5690 2024-04-21T09:00:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe7bfff640 1 -- 172.21.15.26:0/1604324049 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0a5800 con 0x7fbe840c5690 2024-04-21T09:00:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe7bfff640 1 -- 172.21.15.26:0/1604324049 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0a5bd0 con 0x7fbe840c5690 2024-04-21T09:00:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- 172.21.15.26:0/1604324049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe840c5690 msgr2=0x7fbe841529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:37.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 --2- 172.21.15.26:0/1604324049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe840c5690 0x7fbe841529d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbe84070e40 tx=0x7fbe7c01c8d0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- 172.21.15.26:0/1604324049 shutdown_connections 2024-04-21T09:00:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 --2- 172.21.15.26:0/1604324049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe840c5690 0x7fbe841529d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 --2- 172.21.15.26:0/1604324049 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe84073b50 0x7fbe841595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 --2- 172.21.15.26:0/1604324049 >> v2:172.21.15.169:3300/0 conn(0x7fbe840c52b0 0x7fbe840c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- 172.21.15.26:0/1604324049 >> 172.21.15.26:0/1604324049 conn(0x7fbe840c8960 msgr2=0x7fbe840c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- 172.21.15.26:0/1604324049 shutdown_connections 2024-04-21T09:00:37.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- 172.21.15.26:0/1604324049 wait complete. 2024-04-21T09:00:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 Processor -- start 2024-04-21T09:00:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- start start 2024-04-21T09:00:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe84073b50 0x7fbe8414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe840c52b0 0x7fbe841626b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:37.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe840c5690 0x7fbe840cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8415c480 con 0x7fbe84073b50 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8415c300 con 0x7fbe840c5690 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe8b651640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8415c600 con 0x7fbe840c52b0 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe84073b50 0x7fbe8414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe84073b50 0x7fbe8414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56754/0 (socket says 172.21.15.26:56754) 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 -- 172.21.15.26:0/2993231554 learned_addr learned my addr 172.21.15.26:0/2993231554 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe89bee640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe840c5690 0x7fbe840cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe88bec640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe840c52b0 0x7fbe841626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 -- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe840c52b0 msgr2=0x7fbe841626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe840c52b0 0x7fbe841626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 -- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe840c5690 msgr2=0x7fbe840cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe840c5690 0x7fbe840cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.923+0000 7fbe893ed640 1 -- 172.21.15.26:0/2993231554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840c9620 con 0x7fbe84073b50 2024-04-21T09:00:37.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe893ed640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe84073b50 0x7fbe8414b2e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000d800 tx=0x7fbe8000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe79ffb640 1 -- 172.21.15.26:0/2993231554 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000b6c0 con 0x7fbe84073b50 2024-04-21T09:00:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe79ffb640 1 -- 172.21.15.26:0/2993231554 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe80019070 con 0x7fbe84073b50 2024-04-21T09:00:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8414b8a0 con 0x7fbe84073b50 2024-04-21T09:00:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe79ffb640 1 -- 172.21.15.26:0/2993231554 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8000ba60 con 0x7fbe84073b50 2024-04-21T09:00:37.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe841623a0 con 0x7fbe84073b50 2024-04-21T09:00:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe84075ef0 con 0x7fbe84073b50 2024-04-21T09:00:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe79ffb640 1 -- 172.21.15.26:0/2993231554 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe8000bc00 con 0x7fbe84073b50 2024-04-21T09:00:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe79ffb640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbe68068380 0x7fbe6806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe79ffb640 1 -- 172.21.15.26:0/2993231554 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7fbe80086fe0 con 0x7fbe84073b50 2024-04-21T09:00:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe88bec640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbe68068380 0x7fbe6806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:37.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.927+0000 7fbe88bec640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbe68068380 0x7fbe6806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe840c4680 tx=0x7fbe74008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:37.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:37.931+0000 7fbe79ffb640 1 -- 172.21.15.26:0/2993231554 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe80057420 con 0x7fbe84073b50 2024-04-21T09:00:38.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.131+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe8415af90 con 0x7fbe84073b50 2024-04-21T09:00:38.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.131+0000 7fbe79ffb640 1 -- 172.21.15.26:0/2993231554 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fbe80056d20 con 0x7fbe84073b50 2024-04-21T09:00:38.133 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:00:38.133 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:00:38.133 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:00:38.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.131+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbe68068380 msgr2=0x7fbe6806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbe68068380 0x7fbe6806a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbe840c4680 tx=0x7fbe74008040 comp rx=0 tx=0).stop 2024-04-21T09:00:38.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe84073b50 msgr2=0x7fbe8414b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe84073b50 0x7fbe8414b2e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000d800 tx=0x7fbe8000dcc0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 shutdown_connections 2024-04-21T09:00:38.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe840c5690 0x7fbe840cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe840c52b0 0x7fbe841626b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbe68068380 0x7fbe6806a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 --2- 172.21.15.26:0/2993231554 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe84073b50 0x7fbe8414b2e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 >> 172.21.15.26:0/2993231554 conn(0x7fbe840c8960 msgr2=0x7fbe84159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 shutdown_connections 2024-04-21T09:00:38.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.135+0000 7fbe8b651640 1 -- 172.21.15.26:0/2993231554 wait complete. 2024-04-21T09:00:38.151 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id c18cc09d --release --await' 2024-04-21T09:00:38.151 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id c18cc09d --release --await 2024-04-21T09:00:38.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89db4d9640 1 Processor -- start 2024-04-21T09:00:38.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89db4d9640 1 -- start start 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89db4d9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 0x7f89d415b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89db4d9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f89d40cc8d0 0x7f89d40d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89db4d9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d415e260 con 0x7f89d40cb340 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89db4d9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f89d415e540 con 0x7f89d40cc8d0 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89db4d9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f89d415e820 con 0x7f89d4154e70 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f89d40cb340 0x7f89d40c8990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46398/0 (socket says 172.21.15.26:46398) 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 -- 172.21.15.26:0/509975358 learned_addr learned my addr 172.21.15.26:0/509975358 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:00:38.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9275640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 0x7f89d415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d8a74640 1 --2- 172.21.15.26:0/509975358 >> v2:172.21.15.169:3300/0 conn(0x7f89d40cc8d0 0x7f89d40d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613493533 0 0) 0x7f89d415e260 con 0x7f89d40cb340 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003530 con 0x7f89d40cb340 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2299968076 0 0) 0x7f89c4003530 con 0x7f89d40cb340 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 msgr2=0x7f89d415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 0x7f89d415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 >> v2:172.21.15.169:3300/0 conn(0x7f89d40cc8d0 msgr2=0x7f89d40d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 --2- 172.21.15.26:0/509975358 >> v2:172.21.15.169:3300/0 conn(0x7f89d40cc8d0 0x7f89d40d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d415eb00 con 0x7f89d40cb340 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f89cc001680 con 0x7f89d40cb340 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 >> v1:172.21.15.26:6789/0 conn(0x7f89d40cb340 legacy=0x7f89d40c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 0x7f89c40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c4003f40 0x7f89c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c4004d50 0x7f89c40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f89d415e540 con 0x7f89c4004d50 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89d415e820 con 0x7f89c4003f40 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f89c400b9d0 con 0x7f89d4154e70 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c4004d50 0x7f89c40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9275640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 0x7f89c40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d8a74640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c4003f40 0x7f89c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 -- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 msgr2=0x7f89c40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d4154e70 0x7f89c40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 -- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c4003f40 msgr2=0x7f89c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c4003f40 0x7f89c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d9a76640 1 -- 172.21.15.26:0/509975358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c4003530 con 0x7f89c4004d50 2024-04-21T09:00:38.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.279+0000 7f89d8a74640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89c4003f40 0x7f89c4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d9a76640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c4004d50 0x7f89c40051d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c240 tx=0x7f89cc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59391203ff048c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc007d60 con 0x7f89c4004d50 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89cc0a9070 con 0x7f89c4004d50 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d3fff640 1 -- 172.21.15.26:0/509975358 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0a5e00 con 0x7f89c4004d50 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- 172.21.15.26:0/509975358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c4004d50 msgr2=0x7f89c40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 --2- 172.21.15.26:0/509975358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89c4004d50 0x7f89c40051d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c240 tx=0x7f89cc01cc60 comp rx=0 tx=0).stop 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d9a76640 1 -- 172.21.15.26:0/509975358 reap_dead start 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- 172.21.15.26:0/509975358 shutdown_connections 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- 172.21.15.26:0/509975358 >> 172.21.15.26:0/509975358 conn(0x7f89d406de70 msgr2=0x7f89d406e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- 172.21.15.26:0/509975358 shutdown_connections 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- 172.21.15.26:0/509975358 wait complete. 2024-04-21T09:00:38.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 Processor -- start 2024-04-21T09:00:38.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- start start 2024-04-21T09:00:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89d4158ca0 0x7f89d41f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d4159080 0x7f89d41f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d40b2bd0 0x7f89d41f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f89d40c90a0 con 0x7f89d4158ca0 2024-04-21T09:00:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89d4155250 con 0x7f89d4159080 2024-04-21T09:00:38.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89db4d9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f89d40c9220 con 0x7f89d40b2bd0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d9275640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89d4158ca0 0x7f89d41f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d9275640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89d4158ca0 0x7f89d41f0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56772/0 (socket says 172.21.15.26:56772) 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d9275640 1 -- 172.21.15.26:0/1916993190 learned_addr learned my addr 172.21.15.26:0/1916993190 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.283+0000 7f89d9a76640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d40b2bd0 0x7f89d41f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d8a74640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d4159080 0x7f89d41f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d9275640 1 -- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d40b2bd0 msgr2=0x7f89d41f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d9275640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d40b2bd0 0x7f89d41f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d9275640 1 -- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d4159080 msgr2=0x7f89d41f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d9275640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d4159080 0x7f89d41f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d9275640 1 -- 172.21.15.26:0/1916993190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d4152560 con 0x7f89d4158ca0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d9275640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89d4158ca0 0x7f89d41f0af0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f89c00115e0 tx=0x7f89c0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d1ffb640 1 -- 172.21.15.26:0/1916993190 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0015870 con 0x7f89d4158ca0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d1ffb640 1 -- 172.21.15.26:0/1916993190 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c0015a10 con 0x7f89d4158ca0 2024-04-21T09:00:38.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d415de80 con 0x7f89d4158ca0 2024-04-21T09:00:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d1ffb640 1 -- 172.21.15.26:0/1916993190 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0015de0 con 0x7f89d4158ca0 2024-04-21T09:00:38.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d415d530 con 0x7f89d4158ca0 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d1ffb640 1 -- 172.21.15.26:0/1916993190 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89c000f460 con 0x7f89d4158ca0 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d1ffb640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f89b80683b0 0x7f89b806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d1ffb640 1 -- 172.21.15.26:0/1916993190 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f89c00872d0 con 0x7f89d4158ca0 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d8a74640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f89b80683b0 0x7f89b806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89de65b000 1 Processor -- start 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89de65b000 1 -- start start 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.287+0000 7f89d8a74640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f89b80683b0 0x7f89b806a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89d41586e0 tx=0x7f89c800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x55729883b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x55729883c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298877500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557298683660 con 0x5572988728a0 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572986285d0 con 0x55729883bf00 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55729867f620 con 0x557298877120 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x55729883b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x55729883b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56782/0 (socket says 172.21.15.26:56782) 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 -- 172.21.15.26:0/3337314172 learned_addr learned my addr 172.21.15.26:0/3337314172 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x55729883c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9a76640 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298877500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 -- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 msgr2=0x557298877500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298877500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 -- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 msgr2=0x55729883c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x55729883c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 -- 172.21.15.26:0/3337314172 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55729865cbd0 con 0x5572988728a0 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x55729883b9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f89c0008010 tx=0x7f89c00578f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391206c1b8abf7eb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89beffd640 1 -- 172.21.15.26:0/3337314172 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0081070 con 0x5572988728a0 2024-04-21T09:00:38.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89beffd640 1 -- 172.21.15.26:0/3337314172 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c005fd20 con 0x5572988728a0 2024-04-21T09:00:38.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89beffd640 1 -- 172.21.15.26:0/3337314172 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c00553b0 con 0x5572988728a0 2024-04-21T09:00:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- 172.21.15.26:0/3337314172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 msgr2=0x55729883b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x55729883b9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f89c0008010 tx=0x7f89c00578f0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- 172.21.15.26:0/3337314172 shutdown_connections 2024-04-21T09:00:38.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298877500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x55729883c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- 172.21.15.26:0/3337314172 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x55729883b9c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- 172.21.15.26:0/3337314172 >> 172.21.15.26:0/3337314172 conn(0x55729871db00 msgr2=0x557298874ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- 172.21.15.26:0/3337314172 shutdown_connections 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- 172.21.15.26:0/3337314172 wait complete. 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- start start 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 Processor -- start 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x557298871650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x557298871b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298836900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557298740d40 con 0x5572988728a0 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55729863deb0 con 0x55729883bf00 2024-04-21T09:00:38.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55729867e2a0 con 0x557298877120 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89de65b000 10 client.0 _ll_register_callbacks cb 0x557298821a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x557298871b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x557298871b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56794/0 (socket says 172.21.15.26:56794) 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 -- 172.21.15.26:0/2529068404 learned_addr learned my addr 172.21.15.26:0/2529068404 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9275640 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x557298871650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d9a76640 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298836900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 -- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 msgr2=0x557298836900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298836900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 -- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 msgr2=0x557298871650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x557298871650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 -- 172.21.15.26:0/2529068404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572986c9b30 con 0x5572988728a0 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.291+0000 7f89d8a74640 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x557298871b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89c8016e40 tx=0x7f89c8004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a744e4869ea39d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:00:38.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 1 -- 172.21.15.26:0/2529068404 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c801d070 con 0x5572988728a0 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 1 -- 172.21.15.26:0/2529068404 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f89c8023420 con 0x5572988728a0 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55729861d060 con 0x5572988728a0 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 1 -- 172.21.15.26:0/2529068404 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f89c8030050 con 0x5572988728a0 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 10 client.4845 fetch_fsmap learned FSMap version 8 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557298622b70 con 0x5572988728a0 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 1 -- 172.21.15.26:0/2529068404 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55729861d060 con 0x5572988728a0 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 1 -- 172.21.15.26:0/2529068404 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f89c8033020 con 0x5572988728a0 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 10 client.4845 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 10 client.4845 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 20 client.4845 populate_metadata read hostname 'smithi026' 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298837670 0x557298837a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 4 client.4845 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55729865be30 con 0x557298837670 2024-04-21T09:00:38.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89d9275640 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298837670 0x557298837a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89d9275640 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298837670 0x557298837a80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd57292d1547a32f server_cookie=50e848b9405d4bb6 in_seq=0 out_seq=0 2024-04-21T09:00:38.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 10 client.4845 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 1 -- 172.21.15.26:0/2529068404 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55729865be30 con 0x557298837670 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 10 client.4845 handle_command_reply: tid=0 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 client.4845 shutdown 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 msgr2=0x557298871b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x557298871b90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f89c8016e40 tx=0x7f89c8004a50 comp rx=0 tx=0).stop 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 shutdown_connections 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298837670 0x557298837a80 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557298877120 0x557298836900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5572988728a0 0x557298871b90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 --2- 172.21.15.26:0/2529068404 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x557298871650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89b3fff640 0 client.4845 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 >> 172.21.15.26:0/2529068404 conn(0x55729871db00 msgr2=0x5572988769a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 shutdown_connections 2024-04-21T09:00:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 1 -- 172.21.15.26:0/2529068404 wait complete. 2024-04-21T09:00:38.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.295+0000 7f89de65b000 20 client.4845 trim_cache size 0 max 16384 2024-04-21T09:00:38.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 Processor -- start 2024-04-21T09:00:38.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- start start 2024-04-21T09:00:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55729883bf00 0x55729883a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x55729883a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557298877120 0x55729888db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41fd2c0 con 0x55729883bf00 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f89d41fc600 con 0x557298877120 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f89d41fcc50 con 0x5572988728a0 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55729883bf00 0x55729883a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55729883bf00 0x55729883a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56800/0 (socket says 172.21.15.26:56800) 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 -- 172.21.15.26:0/2903985694 learned_addr learned my addr 172.21.15.26:0/2903985694 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d8a74640 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x55729883a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9a76640 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557298877120 0x55729888db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 -- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 msgr2=0x55729883a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x55729883a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 -- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557298877120 msgr2=0x55729888db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557298877120 0x55729888db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 -- 172.21.15.26:0/2903985694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572987055e0 con 0x55729883bf00 2024-04-21T09:00:38.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89d9275640 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55729883bf00 0x55729883a2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f89c0085800 tx=0x7f89c001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945cc57c5be22f37 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89be7fc640 1 -- 172.21.15.26:0/2903985694 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0081040 con 0x55729883bf00 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89be7fc640 1 -- 172.21.15.26:0/2903985694 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c00553b0 con 0x55729883bf00 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89be7fc640 1 -- 172.21.15.26:0/2903985694 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c005b0d0 con 0x55729883bf00 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- 172.21.15.26:0/2903985694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55729883bf00 msgr2=0x55729883a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55729883bf00 0x55729883a2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f89c0085800 tx=0x7f89c001f000 comp rx=0 tx=0).stop 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- 172.21.15.26:0/2903985694 shutdown_connections 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557298877120 0x55729888db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x55729883a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 --2- 172.21.15.26:0/2903985694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55729883bf00 0x55729883a2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- 172.21.15.26:0/2903985694 >> 172.21.15.26:0/2903985694 conn(0x55729871db00 msgr2=0x557298872080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- 172.21.15.26:0/2903985694 shutdown_connections 2024-04-21T09:00:38.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- 172.21.15.26:0/2903985694 wait complete. 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 -- start start 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.315+0000 7f89de65b000 1 Processor -- start 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x5572988e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x5572988e5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557298877120 0x55729888fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557298682970 con 0x557298877120 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5572986388f0 con 0x55729883bf00 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x557298687c90 con 0x5572988728a0 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 10 client.0 _ll_register_callbacks cb 0x7f89c8009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557298877120 0x55729888fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557298877120 0x55729888fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56806/0 (socket says 172.21.15.26:56806) 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 -- 172.21.15.26:0/3646043275 learned_addr learned my addr 172.21.15.26:0/3646043275 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d8a74640 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x5572988e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9275640 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x5572988e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 -- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 msgr2=0x5572988e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x5572988e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 -- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 msgr2=0x5572988e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x5572988e4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 -- 172.21.15.26:0/3646043275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557298615ae0 con 0x557298877120 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9a76640 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557298877120 0x55729888fe30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c240 tx=0x7f89cc019a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7523f98b4874d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 1 -- 172.21.15.26:0/3646043275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0a5bc0 con 0x557298877120 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 1 -- 172.21.15.26:0/3646043275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f89cc0a5d60 con 0x557298877120 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89c00553b0 con 0x557298877120 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 1 -- 172.21.15.26:0/3646043275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f89cc000e50 con 0x557298877120 2024-04-21T09:00:38.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 10 client.4851 fetch_fsmap learned FSMap version 8 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x557298618d80 con 0x557298877120 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 1 -- 172.21.15.26:0/3646043275 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c00553b0 con 0x557298877120 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 1 -- 172.21.15.26:0/3646043275 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f89cc0048b0 con 0x557298877120 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 10 client.4851 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 10 client.4851 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 20 client.4851 populate_metadata read hostname 'smithi026' 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298890850 0x557298890c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 4 client.4851 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c18cc09d", "release": true, "await": true}] 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c18cc09d", "release": true, "await": true}) -- 0x5572986210d0 con 0x557298890850 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9275640 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298890850 0x557298890c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 10 client.4851 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89d9275640 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298890850 0x557298890c60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5efe295d84d092c server_cookie=b0ee70d0a8aa1072 in_seq=0 out_seq=0 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 1 -- 172.21.15.26:0/3646043275 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x5572986210d0 con 0x557298890850 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 10 client.4851 handle_command_reply: tid=0 2024-04-21T09:00:38.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 client.4851 shutdown 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557298877120 msgr2=0x55729888fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557298877120 0x55729888fe30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00c240 tx=0x7f89cc019a60 comp rx=0 tx=0).stop 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 shutdown_connections 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x557298890850 0x557298890c60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557298877120 0x55729888fe30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5572988728a0 0x5572988e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89b3fff640 0 client.4851 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 --2- 172.21.15.26:0/3646043275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55729883bf00 0x5572988e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 >> 172.21.15.26:0/3646043275 conn(0x55729871db00 msgr2=0x557298892d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 shutdown_connections 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 1 -- 172.21.15.26:0/3646043275 wait complete. 2024-04-21T09:00:38.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89de65b000 20 client.4851 trim_cache size 0 max 16384 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 4, 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "c18cc09d": { 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 4, 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:00:38.327 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 85.1, 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:38.328 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:00:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f89b80683b0 msgr2=0x7f89b806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f89b80683b0 0x7f89b806a870 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89d41586e0 tx=0x7f89c800b040 comp rx=0 tx=0).stop 2024-04-21T09:00:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89d4158ca0 msgr2=0x7f89d41f0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89d4158ca0 0x7f89d41f0af0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f89c00115e0 tx=0x7f89c0011aa0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 shutdown_connections 2024-04-21T09:00:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f89d40b2bd0 0x7f89d41f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f89d4159080 0x7f89d41f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f89b80683b0 0x7f89b806a870 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.319+0000 7f89db4d9640 1 --2- 172.21.15.26:0/1916993190 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f89d4158ca0 0x7f89d41f0af0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.323+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 >> 172.21.15.26:0/1916993190 conn(0x7f89d406de70 msgr2=0x7f89d414a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.323+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 shutdown_connections 2024-04-21T09:00:38.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.323+0000 7f89db4d9640 1 -- 172.21.15.26:0/1916993190 wait complete. 2024-04-21T09:00:38.339 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: c18cc09d, seconds elapsed: 30.4 2024-04-21T09:00:38.339 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.1 2024-04-21T09:00:38.339 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:00:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3feff5640 1 Processor -- start 2024-04-21T09:00:38.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3feff5640 1 -- start start 2024-04-21T09:00:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3feff5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 0x7ff3f80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3feff5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f80c6050 con 0x7ff3f80c52b0 2024-04-21T09:00:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3feff5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3f80c3470 con 0x7ff3f8073b50 2024-04-21T09:00:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3feff5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f80c5e00 con 0x7ff3f80c5690 2024-04-21T09:00:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fcd91640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff3f80c52b0 0x7ff3f81529d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46406/0 (socket says 172.21.15.26:46406) 2024-04-21T09:00:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fcd91640 1 -- 172.21.15.26:0/1106583709 learned_addr learned my addr 172.21.15.26:0/1106583709 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:00:38.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fd592640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 0x7ff3f80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798982786 0 0) 0x7ff3f80c6050 con 0x7ff3f80c52b0 2024-04-21T09:00:38.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3e0003530 con 0x7ff3f80c52b0 2024-04-21T09:00:38.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 927204276 0 0) 0x7ff3e0003530 con 0x7ff3f80c52b0 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 msgr2=0x7ff3f80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 0x7ff3f80c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 >> v1:172.21.15.169:6789/0 conn(0x7ff3f8073b50 legacy=0x7ff3f806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f80c3750 con 0x7ff3f80c52b0 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7ff3f0001680 con 0x7ff3f80c52b0 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 >> v1:172.21.15.26:6789/0 conn(0x7ff3f80c52b0 legacy=0x7ff3f81529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 0x7ff3e0003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e0003f90 0x7ff3e0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e0004d50 0x7ff3e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f80c5e00 con 0x7ff3e0004d50 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e000bc10 con 0x7ff3e0003f90 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e000be10 con 0x7ff3f80c5690 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fd592640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e0004d50 0x7ff3e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fcd91640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 0x7ff3e0003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3f7fff640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e0003f90 0x7ff3e0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fd592640 1 -- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 msgr2=0x7ff3e0003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fd592640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3f80c5690 0x7ff3e0003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fd592640 1 -- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e0003f90 msgr2=0x7ff3e0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fd592640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3e0003f90 0x7ff3e0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.451+0000 7ff3fd592640 1 -- 172.21.15.26:0/1106583709 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e0003530 con 0x7ff3e0004d50 2024-04-21T09:00:38.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3fd592640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e0004d50 0x7ff3e00051d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009fc0 tx=0x7ff3e801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4331ae3ed887a516 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e80b2070 con 0x7ff3e0004d50 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3e80a5ba0 con 0x7ff3e0004d50 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3f77fe640 1 -- 172.21.15.26:0/1106583709 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3e8009c10 con 0x7ff3e0004d50 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- 172.21.15.26:0/1106583709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e0004d50 msgr2=0x7ff3e00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 --2- 172.21.15.26:0/1106583709 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3e0004d50 0x7ff3e00051d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff3e8009fc0 tx=0x7ff3e801cca0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3fd592640 1 -- 172.21.15.26:0/1106583709 reap_dead start 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- 172.21.15.26:0/1106583709 shutdown_connections 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- 172.21.15.26:0/1106583709 >> 172.21.15.26:0/1106583709 conn(0x7ff3f80c8960 msgr2=0x7ff3f80c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- 172.21.15.26:0/1106583709 shutdown_connections 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- 172.21.15.26:0/1106583709 wait complete. 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 Processor -- start 2024-04-21T09:00:38.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- start start 2024-04-21T09:00:38.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3e0004d50 0x7ff3f814bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3f814c1e0 0x7ff3f8150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3f81f7180 0x7ff3f8151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f81599a0 con 0x7ff3f814c1e0 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3f8159820 con 0x7ff3f81f7180 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3feff5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3f80c6330 con 0x7ff3e0004d50 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3f814c1e0 0x7ff3f8150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3f7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3f814c1e0 0x7ff3f8150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56826/0 (socket says 172.21.15.26:56826) 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3f7fff640 1 -- 172.21.15.26:0/2663916898 learned_addr learned my addr 172.21.15.26:0/2663916898 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.455+0000 7ff3fd592640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3f81f7180 0x7ff3f8151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3fcd91640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3e0004d50 0x7ff3f814bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f7fff640 1 -- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3e0004d50 msgr2=0x7ff3f814bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f7fff640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3e0004d50 0x7ff3f814bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f7fff640 1 -- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3f81f7180 msgr2=0x7ff3f8151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f7fff640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3f81f7180 0x7ff3f8151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f7fff640 1 -- 172.21.15.26:0/2663916898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3f81f4000 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3fcd91640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3e0004d50 0x7ff3f814bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f7fff640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3f814c1e0 0x7ff3f8150dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e580 tx=0x7ff3ec00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f57fa640 1 -- 172.21.15.26:0/2663916898 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec0052e0 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f57fa640 1 -- 172.21.15.26:0/2663916898 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3ec018070 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3f81f42c0 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f57fa640 1 -- 172.21.15.26:0/2663916898 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3ec003820 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3f81f4880 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3f8075ef0 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f57fa640 1 -- 172.21.15.26:0/2663916898 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3ec0039c0 con 0x7ff3f814c1e0 2024-04-21T09:00:38.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f57fa640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3e40683b0 0x7ff3e406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3f57fa640 1 -- 172.21.15.26:0/2663916898 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7ff3ec0862b0 con 0x7ff3f814c1e0 2024-04-21T09:00:38.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3fcd91640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3e40683b0 0x7ff3e406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.459+0000 7ff3fcd91640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3e40683b0 0x7ff3e406a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00010f0 tx=0x7ff3f0001180 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.463+0000 7ff3f57fa640 1 -- 172.21.15.26:0/2663916898 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3ec056830 con 0x7ff3f814c1e0 2024-04-21T09:00:38.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.659+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3f814de40 con 0x7ff3f814c1e0 2024-04-21T09:00:38.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3f57fa640 1 -- 172.21.15.26:0/2663916898 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7ff3ec005480 con 0x7ff3f814c1e0 2024-04-21T09:00:38.663 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:00:38.664 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:00:38.664 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3e40683b0 msgr2=0x7ff3e406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3e40683b0 0x7ff3e406a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff3f00010f0 tx=0x7ff3f0001180 comp rx=0 tx=0).stop 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3f814c1e0 msgr2=0x7ff3f8150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3f814c1e0 0x7ff3f8150dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec00e580 tx=0x7ff3ec00ea40 comp rx=0 tx=0).stop 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 shutdown_connections 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3f81f7180 0x7ff3f8151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3e40683b0 0x7ff3e406a870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3f814c1e0 0x7ff3f8150dd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 --2- 172.21.15.26:0/2663916898 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3e0004d50 0x7ff3f814bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 >> 172.21.15.26:0/2663916898 conn(0x7ff3f80c8960 msgr2=0x7ff3f8161d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 shutdown_connections 2024-04-21T09:00:38.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.663+0000 7ff3feff5640 1 -- 172.21.15.26:0/2663916898 wait complete. 2024-04-21T09:00:38.681 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 85.1 --await' 2024-04-21T09:00:38.681 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 85.1 --await 2024-04-21T09:00:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.803+0000 7f194f58a640 1 Processor -- start 2024-04-21T09:00:38.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194f58a640 1 -- start start 2024-04-21T09:00:38.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194f58a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1948154f00 0x7f19480cab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194f58a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f194815ed60 0x7f19480cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194f58a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194806f3b0 con 0x7f1948070820 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194f58a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f194815e1c0 con 0x7f194815ed60 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194f58a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f194806f690 con 0x7f1948154f00 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f194815ed60 0x7f19480cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f194815ed60 0x7f19480cb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56834/0 (socket says 172.21.15.26:56834) 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 -- 172.21.15.26:0/2287753764 learned_addr learned my addr 172.21.15.26:0/2287753764 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194d326640 1 --2- 172.21.15.26:0/2287753764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1948154f00 0x7f19480cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 -- 172.21.15.26:0/2287753764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1948154f00 msgr2=0x7f19480cab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 --2- 172.21.15.26:0/2287753764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1948154f00 0x7f19480cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 -- 172.21.15.26:0/2287753764 >> v1:172.21.15.169:6789/0 conn(0x7f1948070820 legacy=0x7f194815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 -- 172.21.15.26:0/2287753764 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194806f970 con 0x7f194815ed60 2024-04-21T09:00:38.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f194db27640 1 --2- 172.21.15.26:0/2287753764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f194815ed60 0x7f19480cb060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1940009e50 tx=0x7f194001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88ff50da4061c9e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f193ffff640 1 -- 172.21.15.26:0/2287753764 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400a57b0 con 0x7f194815ed60 2024-04-21T09:00:38.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f193ffff640 1 -- 172.21.15.26:0/2287753764 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19400a5950 con 0x7f194815ed60 2024-04-21T09:00:38.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.807+0000 7f193ffff640 1 -- 172.21.15.26:0/2287753764 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400a5d20 con 0x7f194815ed60 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- 172.21.15.26:0/2287753764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f194815ed60 msgr2=0x7f19480cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 --2- 172.21.15.26:0/2287753764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f194815ed60 0x7f19480cb060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1940009e50 tx=0x7f194001c930 comp rx=0 tx=0).stop 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- 172.21.15.26:0/2287753764 shutdown_connections 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 --2- 172.21.15.26:0/2287753764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f194815ed60 0x7f19480cb060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 --2- 172.21.15.26:0/2287753764 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1948154f00 0x7f19480cab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- 172.21.15.26:0/2287753764 >> 172.21.15.26:0/2287753764 conn(0x7f1948068010 msgr2=0x7f19480711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- 172.21.15.26:0/2287753764 shutdown_connections 2024-04-21T09:00:38.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- 172.21.15.26:0/2287753764 wait complete. 2024-04-21T09:00:38.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 Processor -- start 2024-04-21T09:00:38.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- start start 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1948070820 0x7f194814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1948154f00 0x7f19480cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f194815ed60 0x7f19480cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f19480c8e60 con 0x7f1948154f00 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f19481552e0 con 0x7f1948070820 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f19480c8fe0 con 0x7f194815ed60 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1948154f00 0x7f19480cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1948154f00 0x7f19480cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56848/0 (socket says 172.21.15.26:56848) 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 -- 172.21.15.26:0/3041884986 learned_addr learned my addr 172.21.15.26:0/3041884986 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194d326640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1948070820 0x7f194814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194db27640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f194815ed60 0x7f19480cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 -- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f194815ed60 msgr2=0x7f19480cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f194815ed60 0x7f19480cdaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 -- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1948070820 msgr2=0x7f194814de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1948070820 0x7f194814de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 -- 172.21.15.26:0/3041884986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19480c8120 con 0x7f1948154f00 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194db27640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f194815ed60 0x7f19480cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194d326640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1948070820 0x7f194814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194cb25640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1948154f00 0x7f19480cd5b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f193800b410 tx=0x7f193800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f193dffb640 1 -- 172.21.15.26:0/3041884986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938015030 con 0x7f1948154f00 2024-04-21T09:00:38.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f193dffb640 1 -- 172.21.15.26:0/3041884986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1938004020 con 0x7f1948154f00 2024-04-21T09:00:38.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19480cc0f0 con 0x7f1948154f00 2024-04-21T09:00:38.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f193dffb640 1 -- 172.21.15.26:0/3041884986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938004450 con 0x7f1948154f00 2024-04-21T09:00:38.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.811+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19480cc6b0 con 0x7f1948154f00 2024-04-21T09:00:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f193dffb640 1 -- 172.21.15.26:0/3041884986 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1938018070 con 0x7f1948154f00 2024-04-21T09:00:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f193dffb640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f192c068380 0x7f192c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f193dffb640 1 -- 172.21.15.26:0/3041884986 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f1938086660 con 0x7f1948154f00 2024-04-21T09:00:38.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194d326640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f192c068380 0x7f192c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 Processor -- start 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 -- start start 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194d326640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f192c068380 0x7f192c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1944006fd0 tx=0x7f1944008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7edd2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edd2990 0x558d7edd2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558d7ec78650 con 0x558d7ed97500 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558d7ebe0bf0 con 0x558d7edcd5a0 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558d7eb860c0 con 0x558d7edd2990 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7edd2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7edd2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56852/0 (socket says 172.21.15.26:56852) 2024-04-21T09:00:38.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 -- 172.21.15.26:0/2651267462 learned_addr learned my addr 172.21.15.26:0/2651267462 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194db27640 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edd2990 0x558d7edd2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194d326640 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 -- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edd2990 msgr2=0x558d7edd2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edd2990 0x558d7edd2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 -- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 msgr2=0x558d7ed96fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 -- 172.21.15.26:0/2651267462 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7eba2fe0 con 0x558d7ed97500 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194db27640 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edd2990 0x558d7edd2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f194cb25640 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7edd2450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1938056370 tx=0x7f193805a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcd3ff0dd0cf570d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f1932ffd640 1 -- 172.21.15.26:0/2651267462 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1938083070 con 0x558d7ed97500 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f1932ffd640 1 -- 172.21.15.26:0/2651267462 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1938052aa0 con 0x558d7ed97500 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.815+0000 7f1932ffd640 1 -- 172.21.15.26:0/2651267462 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193806e030 con 0x558d7ed97500 2024-04-21T09:00:38.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/2651267462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 msgr2=0x558d7edd2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7edd2450 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1938056370 tx=0x7f193805a8a0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/2651267462 shutdown_connections 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edd2990 0x558d7edd2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7edd2450 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- 172.21.15.26:0/2651267462 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/2651267462 >> 172.21.15.26:0/2651267462 conn(0x558d7edce200 msgr2=0x558d7edd05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/2651267462 shutdown_connections 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/2651267462 wait complete. 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- start start 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 Processor -- start 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7ed95ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7edd81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558d7eb9c540 con 0x558d7edd2990 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558d7ebdff00 con 0x558d7edcd5a0 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558d7ebe5220 con 0x558d7ed97500 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 10 client.0 _ll_register_callbacks cb 0x558d7ed7c9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7edd81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7edd81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56862/0 (socket says 172.21.15.26:56862) 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 -- 172.21.15.26:0/3351106911 learned_addr learned my addr 172.21.15.26:0/3351106911 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194d326640 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7ed95ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 -- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 msgr2=0x558d7ed95ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7ed95ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 -- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 msgr2=0x558d7ed96410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194cb25640 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 -- 172.21.15.26:0/3351106911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7ebed570 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194db27640 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7edd81e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19400af040 tx=0x7f194001b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4726e8b67a55f7d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f1927fff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f1927fff640 1 -- 172.21.15.26:0/3351106911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400bd070 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f1927fff640 1 -- 172.21.15.26:0/3351106911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f19400a5d50 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1938052aa0 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f1927fff640 1 -- 172.21.15.26:0/3351106911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f19400b7430 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 10 client.4869 fetch_fsmap learned FSMap version 8 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558d7eb86310 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f1927fff640 1 -- 172.21.15.26:0/3351106911 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1938052aa0 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f1927fff640 1 -- 172.21.15.26:0/3351106911 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f1940008040 con 0x558d7edd2990 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 10 client.4869 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:00:38.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 10 client.4869 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:00:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 20 client.4869 populate_metadata read hostname 'smithi026' 2024-04-21T09:00:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7edd8f80 0x558d7edd9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 4 client.4869 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:00:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d7eb7a880 con 0x558d7edd8f80 2024-04-21T09:00:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.819+0000 7f194d326640 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7edd8f80 0x558d7edd9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f1927fff640 10 client.4869 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:38.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f194d326640 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7edd8f80 0x558d7edd9390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a8a88e31018177e server_cookie=b84a292338801ab in_seq=0 out_seq=0 2024-04-21T09:00:38.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f1927fff640 1 -- 172.21.15.26:0/3351106911 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558d7eb7a880 con 0x558d7edd8f80 2024-04-21T09:00:38.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f1927fff640 10 client.4869 handle_command_reply: tid=0 2024-04-21T09:00:38.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 client.4869 shutdown 2024-04-21T09:00:38.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 msgr2=0x558d7edd81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7edd81e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f19400af040 tx=0x7f194001b170 comp rx=0 tx=0).stop 2024-04-21T09:00:38.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 shutdown_connections 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7edd8f80 0x558d7edd9390 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7edd81e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7ed96410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f1927fff640 0 client.4869 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 --2- 172.21.15.26:0/3351106911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7ed95ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 >> 172.21.15.26:0/3351106911 conn(0x558d7edce200 msgr2=0x558d7edccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 shutdown_connections 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 1 -- 172.21.15.26:0/3351106911 wait complete. 2024-04-21T09:00:38.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.823+0000 7f195270c000 20 client.4869 trim_cache size 0 max 16384 2024-04-21T09:00:38.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 Processor -- start 2024-04-21T09:00:38.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 -- start start 2024-04-21T09:00:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7edd7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7edd82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7ee3dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f194814cc50 con 0x558d7edd2990 2024-04-21T09:00:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f194814bf80 con 0x558d7edcd5a0 2024-04-21T09:00:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f194814c5a0 con 0x558d7ed97500 2024-04-21T09:00:38.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f194db27640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7ee3dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f194db27640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7ee3dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56868/0 (socket says 172.21.15.26:56868) 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.839+0000 7f194db27640 1 -- 172.21.15.26:0/3618395911 learned_addr learned my addr 172.21.15.26:0/3618395911 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7edd7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194cb25640 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7edd82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194db27640 1 -- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 msgr2=0x558d7edd7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194db27640 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7edd7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194db27640 1 -- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 msgr2=0x558d7edd82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194db27640 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7edd82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194db27640 1 -- 172.21.15.26:0/3618395911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d7ebacab0 con 0x558d7edd2990 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194db27640 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7ee3dbb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f19400984d0 tx=0x7f19400b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7a3f77d5d33b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f19327fc640 1 -- 172.21.15.26:0/3618395911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400bd040 con 0x558d7edd2990 2024-04-21T09:00:38.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f19327fc640 1 -- 172.21.15.26:0/3618395911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194001ac20 con 0x558d7edd2990 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f19327fc640 1 -- 172.21.15.26:0/3618395911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19400a5b50 con 0x558d7edd2990 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- 172.21.15.26:0/3618395911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 msgr2=0x558d7ee3dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7ee3dbb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f19400984d0 tx=0x7f19400b7000 comp rx=0 tx=0).stop 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- 172.21.15.26:0/3618395911 shutdown_connections 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7edd2990 0x558d7ee3dbb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edcd5a0 0x558d7edd82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 --2- 172.21.15.26:0/3618395911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7ed97500 0x558d7edd7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- 172.21.15.26:0/3618395911 >> 172.21.15.26:0/3618395911 conn(0x558d7edce200 msgr2=0x558d7edd1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- 172.21.15.26:0/3618395911 shutdown_connections 2024-04-21T09:00:38.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- 172.21.15.26:0/3618395911 wait complete. 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- start start 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 Processor -- start 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7eded310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edcd5a0 0x558d7ee405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edd2990 0x558d7ee40af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558d7eb77470 con 0x558d7ed97500 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558d7ebede00 con 0x558d7edd2990 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558d7eba4b70 con 0x558d7edcd5a0 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 10 client.0 _ll_register_callbacks cb 0x7f1940009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:00:38.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7eded310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7eded310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56874/0 (socket says 172.21.15.26:56874) 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 -- 172.21.15.26:0/2347375529 learned_addr learned my addr 172.21.15.26:0/2347375529 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194cb25640 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edcd5a0 0x558d7ee405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 -- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edcd5a0 msgr2=0x558d7ee405b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edcd5a0 0x558d7ee405b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 -- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edd2990 msgr2=0x558d7ee40af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edd2990 0x558d7ee40af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 -- 172.21.15.26:0/2347375529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d7ec61660 con 0x558d7ed97500 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f194d326640 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7eded310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f194400ddc0 tx=0x7f1944004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f16683374012b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f1927fff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f1927fff640 1 -- 172.21.15.26:0/2347375529 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1944012cd0 con 0x558d7ed97500 2024-04-21T09:00:38.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f1927fff640 1 -- 172.21.15.26:0/2347375529 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f1944025130 con 0x558d7ed97500 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f194001ac20 con 0x558d7ed97500 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f1927fff640 1 -- 172.21.15.26:0/2347375529 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f1944034050 con 0x558d7ed97500 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 10 client.4875 fetch_fsmap learned FSMap version 8 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558d7eb766a0 con 0x558d7ed97500 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.843+0000 7f1927fff640 1 -- 172.21.15.26:0/2347375529 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f194001ac20 con 0x558d7ed97500 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f1927fff640 1 -- 172.21.15.26:0/2347375529 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f1944037020 con 0x558d7ed97500 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f195270c000 10 client.4875 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f195270c000 10 client.4875 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f195270c000 20 client.4875 populate_metadata read hostname 'smithi026' 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f195270c000 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7ee3f390 0x558d7ee3f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f195270c000 4 client.4875 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.1, "await": true}] 2024-04-21T09:00:38.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 85.1, "await": true}) -- 0x558d7ebee610 con 0x558d7ee3f390 2024-04-21T09:00:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f194cb25640 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7ee3f390 0x558d7ee3f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:00:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f1927fff640 10 client.4875 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:38.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:38.847+0000 7f194cb25640 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7ee3f390 0x558d7ee3f7a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc84dbacfad4dc2a server_cookie=37beb78ab50deba9 in_seq=0 out_seq=0 2024-04-21T09:00:41.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.491+0000 7f1927fff640 1 -- 172.21.15.26:0/2347375529 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x558d7ebee610 con 0x558d7ee3f390 2024-04-21T09:00:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.491+0000 7f1927fff640 10 client.4875 handle_command_reply: tid=0 2024-04-21T09:00:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.491+0000 7f195270c000 1 client.4875 shutdown 2024-04-21T09:00:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 msgr2=0x558d7eded310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7eded310 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f194400ddc0 tx=0x7f1944004740 comp rx=0 tx=0).stop 2024-04-21T09:00:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 shutdown_connections 2024-04-21T09:00:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558d7ee3f390 0x558d7ee3f7a0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558d7edd2990 0x558d7ee40af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f1927fff640 0 client.4875 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:00:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558d7edcd5a0 0x558d7ee405b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 --2- 172.21.15.26:0/2347375529 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558d7ed97500 0x558d7eded310 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 >> 172.21.15.26:0/2347375529 conn(0x558d7edce200 msgr2=0x558d7edd6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 shutdown_connections 2024-04-21T09:00:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.495+0000 7f195270c000 1 -- 172.21.15.26:0/2347375529 wait complete. 2024-04-21T09:00:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f195270c000 20 client.4875 trim_cache size 0 max 16384 2024-04-21T09:00:41.500 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:00:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:00:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:00:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 6, 2024-04-21T09:00:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:00:41.500 INFO:teuthology.orchestra.run.smithi026.stdout: "9e6ed40d": { 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 6, 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 85.1, 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:00:41.501 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:00:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:00:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:41.502 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:00:41.502 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:00:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f192c068380 msgr2=0x7f192c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f192c068380 0x7f192c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1944006fd0 tx=0x7f1944008040 comp rx=0 tx=0).stop 2024-04-21T09:00:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1948154f00 msgr2=0x7f19480cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:00:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1948154f00 0x7f19480cd5b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f193800b410 tx=0x7f193800b8d0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 shutdown_connections 2024-04-21T09:00:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f194815ed60 0x7f19480cdaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f192c068380 0x7f192c06a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1948154f00 0x7f19480cd5b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 --2- 172.21.15.26:0/3041884986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1948070820 0x7f194814de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:00:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 >> 172.21.15.26:0/3041884986 conn(0x7f1948068010 msgr2=0x7f1948070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:00:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 shutdown_connections 2024-04-21T09:00:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:00:41.499+0000 7f194f58a640 1 -- 172.21.15.26:0/3041884986 wait complete. 2024-04-21T09:00:41.535 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 9e6ed40d, quiesce duration: 25.1 2024-04-21T09:00:52.107 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:00:52.110 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:06.637 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:01:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484bf43640 1 Processor -- start 2024-04-21T09:01:06.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484bf43640 1 -- start start 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484bf43640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f48440c52b0 0x7f48440c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484bf43640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48440c6050 con 0x7f48440c5690 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484bf43640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48440c3470 con 0x7f4844073b50 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484bf43640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f48440c5e00 con 0x7f48440c52b0 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484a4e0640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f48440c5690 0x7f484406ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59308/0 (socket says 172.21.15.26:59308) 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484a4e0640 1 -- 172.21.15.26:0/3754373877 learned_addr learned my addr 172.21.15.26:0/3754373877 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3754373877 >> v2:172.21.15.169:3300/0 conn(0x7f48440c52b0 0x7f48440c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153972939 0 0) 0x7f48440c6050 con 0x7f48440c5690 2024-04-21T09:01:06.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4830003530 con 0x7f48440c5690 2024-04-21T09:01:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640707447 0 0) 0x7f48440c3470 con 0x7f4844073b50 2024-04-21T09:01:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48440c6050 con 0x7f4844073b50 2024-04-21T09:01:06.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2955128965 0 0) 0x7f4830003530 con 0x7f48440c5690 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 >> v2:172.21.15.169:3300/0 conn(0x7f48440c52b0 msgr2=0x7f48440c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 --2- 172.21.15.26:0/3754373877 >> v2:172.21.15.169:3300/0 conn(0x7f48440c52b0 0x7f48440c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 >> v1:172.21.15.169:6789/0 conn(0x7f4844073b50 legacy=0x7f48441529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48440c3750 con 0x7f48440c5690 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f483c001680 con 0x7f48440c5690 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 >> v1:172.21.15.26:6789/0 conn(0x7f48440c5690 legacy=0x7f484406ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4830003b50 0x7f4830003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4830004810 0x7f4830004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830005240 0x7f483000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f48440c5e00 con 0x7f4830003b50 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f483000c1a0 con 0x7f4830005240 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f483000c3a0 con 0x7f4830004810 2024-04-21T09:01:06.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4830003b50 0x7f4830003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484a4e0640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830005240 0x7f483000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f48494de640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4830004810 0x7f4830004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4849cdf640 1 -- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4830004810 msgr2=0x7f4830004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4830004810 0x7f4830004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4849cdf640 1 -- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830005240 msgr2=0x7f483000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830005240 0x7f483000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f4849cdf640 1 -- 172.21.15.26:0/3754373877 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4830003530 con 0x7f4830003b50 2024-04-21T09:01:06.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.771+0000 7f484a4e0640 1 -- 172.21.15.26:0/3754373877 reap_dead start 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4830003b50 0x7f4830003f50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4840009fc0 tx=0x7f484001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd988b5f1d6d9be6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48400b2070 con 0x7f4830003b50 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48400a5b80 con 0x7f4830003b50 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f4848cdd640 1 -- 172.21.15.26:0/3754373877 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4840009c10 con 0x7f4830003b50 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 -- 172.21.15.26:0/3754373877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4830003b50 msgr2=0x7f4830003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4830003b50 0x7f4830003f50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4840009fc0 tx=0x7f484001cc80 comp rx=0 tx=0).stop 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 -- 172.21.15.26:0/3754373877 shutdown_connections 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 --2- 172.21.15.26:0/3754373877 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4830003b50 0x7f4830003f50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 -- 172.21.15.26:0/3754373877 >> 172.21.15.26:0/3754373877 conn(0x7f48440c8960 msgr2=0x7f48440c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 -- 172.21.15.26:0/3754373877 shutdown_connections 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 -- 172.21.15.26:0/3754373877 wait complete. 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 Processor -- start 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.775+0000 7f484bf43640 1 -- start start 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830003b50 0x7f48441f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48441f58f0 0x7f48440cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48440c0450 0x7f48441471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f484406ce70 con 0x7f48441f58f0 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f48440c6330 con 0x7f4830003b50 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f484406cff0 con 0x7f48440c0450 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48441f58f0 0x7f48440cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48441f58f0 0x7f48440cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37846/0 (socket says 172.21.15.26:37846) 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 -- 172.21.15.26:0/3660139092 learned_addr learned my addr 172.21.15.26:0/3660139092 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:01:06.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830003b50 0x7f48441f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484a4e0640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48440c0450 0x7f48441471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 -- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48440c0450 msgr2=0x7f48441471a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48440c0450 0x7f48441471a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 -- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830003b50 msgr2=0x7f48441f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830003b50 0x7f48441f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 -- 172.21.15.26:0/3660139092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4844151190 con 0x7f48441f58f0 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484a4e0640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48440c0450 0x7f48441471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830003b50 0x7f48441f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f48494de640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48441f58f0 0x7f48440cb5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f483400e810 tx=0x7f483400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f483a7fc640 1 -- 172.21.15.26:0/3660139092 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48340050d0 con 0x7f48441f58f0 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f483a7fc640 1 -- 172.21.15.26:0/3660139092 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4834018070 con 0x7f48441f58f0 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f483a7fc640 1 -- 172.21.15.26:0/3660139092 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f483400c6c0 con 0x7f48441f58f0 2024-04-21T09:01:06.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4844151470 con 0x7f48441f58f0 2024-04-21T09:01:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48441f50f0 con 0x7f48441f58f0 2024-04-21T09:01:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4844075ef0 con 0x7f48441f58f0 2024-04-21T09:01:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f483a7fc640 1 -- 172.21.15.26:0/3660139092 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f483400c860 con 0x7f48441f58f0 2024-04-21T09:01:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f483a7fc640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f48280683b0 0x7f482806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:06.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f483a7fc640 1 -- 172.21.15.26:0/3660139092 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f4834086890 con 0x7f48441f58f0 2024-04-21T09:01:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.779+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f48280683b0 0x7f482806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:06.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.783+0000 7f4849cdf640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f48280683b0 0x7f482806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48400af000 tx=0x7f48400a7040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:06.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.783+0000 7f483a7fc640 1 -- 172.21.15.26:0/3660139092 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4834056e20 con 0x7f48441f58f0 2024-04-21T09:01:06.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.979+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48441f1c60 con 0x7f48441f58f0 2024-04-21T09:01:06.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.979+0000 7f483a7fc640 1 -- 172.21.15.26:0/3660139092 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f4834056720 con 0x7f48441f58f0 2024-04-21T09:01:06.981 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:01:06.981 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:01:06.981 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:01:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f48280683b0 msgr2=0x7f482806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f48280683b0 0x7f482806a870 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48400af000 tx=0x7f48400a7040 comp rx=0 tx=0).stop 2024-04-21T09:01:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48441f58f0 msgr2=0x7f48440cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48441f58f0 0x7f48440cb5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f483400e810 tx=0x7f483400ecd0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 shutdown_connections 2024-04-21T09:01:06.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f48440c0450 0x7f48441471a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f48280683b0 0x7f482806a870 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f48441f58f0 0x7f48440cb5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 --2- 172.21.15.26:0/3660139092 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4830003b50 0x7f48441f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:06.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 >> 172.21.15.26:0/3660139092 conn(0x7f48440c8960 msgr2=0x7f484414f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:06.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 shutdown_connections 2024-04-21T09:01:06.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:06.983+0000 7f484bf43640 1 -- 172.21.15.26:0/3660139092 wait complete. 2024-04-21T09:01:06.998 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id 9e6ed40d --release --await' 2024-04-21T09:01:06.998 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id 9e6ed40d --release --await 2024-04-21T09:01:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81dd689640 1 Processor -- start 2024-04-21T09:01:07.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81dd689640 1 -- start start 2024-04-21T09:01:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81dd689640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f81d80ccba0 0x7f81d81591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81dd689640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d8153240 con 0x7f81d8152e60 2024-04-21T09:01:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81dd689640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81d80c6b60 con 0x7f81d80c5e90 2024-04-21T09:01:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81dd689640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f81d8158d10 con 0x7f81d80ccba0 2024-04-21T09:01:07.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d6ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f81d8152e60 0x7f81d80736a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59320/0 (socket says 172.21.15.26:59320) 2024-04-21T09:01:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d6ffd640 1 -- 172.21.15.26:0/911440458 learned_addr learned my addr 172.21.15.26:0/911440458 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:01:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d67fc640 1 --2- 172.21.15.26:0/911440458 >> v2:172.21.15.26:3300/0 conn(0x7f81d80ccba0 0x7f81d81591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d5ffb640 1 -- 172.21.15.26:0/911440458 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775977262 0 0) 0x7f81d8153240 con 0x7f81d8152e60 2024-04-21T09:01:07.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d5ffb640 1 -- 172.21.15.26:0/911440458 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81c0003530 con 0x7f81d8152e60 2024-04-21T09:01:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d67fc640 1 -- 172.21.15.26:0/911440458 >> v1:172.21.15.169:6789/0 conn(0x7f81d80c5e90 legacy=0x7f81d81633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d67fc640 1 -- 172.21.15.26:0/911440458 >> v1:172.21.15.26:6789/0 conn(0x7f81d8152e60 legacy=0x7f81d80736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.119+0000 7f81d67fc640 1 -- 172.21.15.26:0/911440458 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d80c3550 con 0x7f81d80ccba0 2024-04-21T09:01:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d67fc640 1 --2- 172.21.15.26:0/911440458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d80ccba0 0x7f81d81591a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097c0 tx=0x7f81cc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4506c844ec728059 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d5ffb640 1 -- 172.21.15.26:0/911440458 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b5070 con 0x7f81d80ccba0 2024-04-21T09:01:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d5ffb640 1 -- 172.21.15.26:0/911440458 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81cc0a8990 con 0x7f81d80ccba0 2024-04-21T09:01:07.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d5ffb640 1 -- 172.21.15.26:0/911440458 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0a8d60 con 0x7f81d80ccba0 2024-04-21T09:01:07.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- 172.21.15.26:0/911440458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d80ccba0 msgr2=0x7f81d81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 --2- 172.21.15.26:0/911440458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d80ccba0 0x7f81d81591a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097c0 tx=0x7f81cc01ec90 comp rx=0 tx=0).stop 2024-04-21T09:01:07.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- 172.21.15.26:0/911440458 shutdown_connections 2024-04-21T09:01:07.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 --2- 172.21.15.26:0/911440458 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d80ccba0 0x7f81d81591a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- 172.21.15.26:0/911440458 >> 172.21.15.26:0/911440458 conn(0x7f81d80cbef0 msgr2=0x7f81d80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:07.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- 172.21.15.26:0/911440458 shutdown_connections 2024-04-21T09:01:07.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- 172.21.15.26:0/911440458 wait complete. 2024-04-21T09:01:07.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 Processor -- start 2024-04-21T09:01:07.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- start start 2024-04-21T09:01:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81d80c5e90 0x7f81d80721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81d80ccba0 0x7f81d8072720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d8152e60 0x7f81d81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80c67b0 con 0x7f81d8152e60 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81d80c3b10 con 0x7f81d80ccba0 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81dd689640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f81d8071740 con 0x7f81d80c5e90 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d8152e60 0x7f81d81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d8152e60 0x7f81d81550e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37874/0 (socket says 172.21.15.26:37874) 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 -- 172.21.15.26:0/800207028 learned_addr learned my addr 172.21.15.26:0/800207028 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d67fc640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81d80ccba0 0x7f81d8072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81d80c5e90 0x7f81d80721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 -- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81d80c5e90 msgr2=0x7f81d80721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81d80c5e90 0x7f81d80721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 -- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81d80ccba0 msgr2=0x7f81d8072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81d80ccba0 0x7f81d8072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d77fe640 1 -- 172.21.15.26:0/800207028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81d81f11a0 con 0x7f81d8152e60 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81d80c5e90 0x7f81d80721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.123+0000 7f81d67fc640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81d80ccba0 0x7f81d8072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81d77fe640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d8152e60 0x7f81d81550e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c740 tx=0x7f81d000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81bf7fe640 1 -- 172.21.15.26:0/800207028 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0016020 con 0x7f81d8152e60 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81bf7fe640 1 -- 172.21.15.26:0/800207028 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d000ce50 con 0x7f81d8152e60 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81d80719e0 con 0x7f81d8152e60 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81bf7fe640 1 -- 172.21.15.26:0/800207028 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0003980 con 0x7f81d8152e60 2024-04-21T09:01:07.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81d8157880 con 0x7f81d8152e60 2024-04-21T09:01:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81bf7fe640 1 -- 172.21.15.26:0/800207028 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f81d0003b20 con 0x7f81d8152e60 2024-04-21T09:01:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81bf7fe640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f81c4068380 0x7f81c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81bf7fe640 1 -- 172.21.15.26:0/800207028 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f81d00866b0 con 0x7f81d8152e60 2024-04-21T09:01:07.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f81c4068380 0x7f81c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 Processor -- start 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 -- start start 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f81c4068380 0x7f81c406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81c80011f0 tx=0x7f81c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4a6f00 0x56387d4a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4e2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56387d2ee660 con 0x56387d4a6f00 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56387d2935d0 con 0x56387d4dd8a0 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x56387d2ea620 con 0x56387d4e2120 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4a6f00 0x56387d4a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4a6f00 0x56387d4a72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37888/0 (socket says 172.21.15.26:37888) 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81d67fc640 1 -- 172.21.15.26:0/2841451197 learned_addr learned my addr 172.21.15.26:0/2841451197 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:01:07.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.127+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d77fe640 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 -- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 msgr2=0x56387d4e2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4e2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 -- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 msgr2=0x56387d4a69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 -- 172.21.15.26:0/2841451197 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387d2c7bd0 con 0x56387d4a6f00 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4a6f00 0x56387d4a72e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f81cc01b8a0 tx=0x7f81cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a244784bf172eeb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81bcff9640 1 -- 172.21.15.26:0/2841451197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b5040 con 0x56387d4a6f00 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81bcff9640 1 -- 172.21.15.26:0/2841451197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81cc0a8a10 con 0x56387d4a6f00 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81bcff9640 1 -- 172.21.15.26:0/2841451197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0a8dc0 con 0x56387d4a6f00 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2841451197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4a6f00 msgr2=0x56387d4a72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4a6f00 0x56387d4a72e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f81cc01b8a0 tx=0x7f81cc004740 comp rx=0 tx=0).stop 2024-04-21T09:01:07.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2841451197 shutdown_connections 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4a6f00 0x56387d4a72e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- 172.21.15.26:0/2841451197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2841451197 >> 172.21.15.26:0/2841451197 conn(0x56387d388b00 msgr2=0x56387d4dfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2841451197 shutdown_connections 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2841451197 wait complete. 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- start start 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 Processor -- start 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4a6f00 0x56387d4dc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d4dcb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56387d3abd40 con 0x56387d4dd8a0 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56387d2a8eb0 con 0x56387d4a6f00 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x56387d2e92a0 con 0x56387d4e2120 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 10 client.0 _ll_register_callbacks cb 0x56387d48ca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d4dcb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d4dcb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37904/0 (socket says 172.21.15.26:37904) 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 -- 172.21.15.26:0/2407249026 learned_addr learned my addr 172.21.15.26:0/2407249026 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d77fe640 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 -- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 msgr2=0x56387d4a18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 -- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4a6f00 msgr2=0x56387d4dc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4a6f00 0x56387d4dc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 -- 172.21.15.26:0/2407249026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56387d334b30 con 0x56387d4dd8a0 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81d67fc640 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d4dcb90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f81cc01b8a0 tx=0x7f81cc01d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99a876379f333d59 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:07.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81b5ffb640 1 -- 172.21.15.26:0/2407249026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b5040 con 0x56387d4dd8a0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81b5ffb640 1 -- 172.21.15.26:0/2407249026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f81cc0be770 con 0x56387d4dd8a0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56387d288060 con 0x56387d4dd8a0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81b5ffb640 1 -- 172.21.15.26:0/2407249026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f81cc0be970 con 0x56387d4dd8a0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 10 client.4896 fetch_fsmap learned FSMap version 8 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56387d28db70 con 0x56387d4dd8a0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81b5ffb640 1 -- 172.21.15.26:0/2407249026 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56387d288060 con 0x56387d4dd8a0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81b5ffb640 1 -- 172.21.15.26:0/2407249026 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f81cc0b8050 con 0x56387d4dd8a0 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 10 client.4896 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 10 client.4896 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 20 client.4896 populate_metadata read hostname 'smithi026' 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4a2640 0x56387d4a2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 4 client.4896 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:01:07.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.131+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56387d2c6e30 con 0x56387d4a2640 2024-04-21T09:01:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4a2640 0x56387d4a2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4a2640 0x56387d4a2a50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bd1006a7da0fc78 server_cookie=c32ead404e292d32 in_seq=0 out_seq=0 2024-04-21T09:01:07.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81b5ffb640 10 client.4896 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81b5ffb640 1 -- 172.21.15.26:0/2407249026 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56387d2c6e30 con 0x56387d4a2640 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81b5ffb640 10 client.4896 handle_command_reply: tid=0 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 client.4896 shutdown 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 msgr2=0x56387d4dcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d4dcb90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f81cc01b8a0 tx=0x7f81cc01d4d0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 shutdown_connections 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4a2640 0x56387d4a2a50 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.142 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4e2120 0x56387d4a18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81b5ffb640 0 client.4896 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:01:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d4dcb90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 --2- 172.21.15.26:0/2407249026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4a6f00 0x56387d4dc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 >> 172.21.15.26:0/2407249026 conn(0x56387d388b00 msgr2=0x56387d4e19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 shutdown_connections 2024-04-21T09:01:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 1 -- 172.21.15.26:0/2407249026 wait complete. 2024-04-21T09:01:07.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.135+0000 7f81e080b000 20 client.4896 trim_cache size 0 max 16384 2024-04-21T09:01:07.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 Processor -- start 2024-04-21T09:01:07.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 -- start start 2024-04-21T09:01:07.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d4a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4e2120 0x56387d4f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81fc6a0 con 0x56387d4e2120 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f81d81f4440 con 0x56387d4dd8a0 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f81d81fc070 con 0x56387d4a6f00 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81d77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4e2120 0x56387d4f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81d77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4e2120 0x56387d4f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37918/0 (socket says 172.21.15.26:37918) 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.151+0000 7f81d77fe640 1 -- 172.21.15.26:0/1251449059 learned_addr learned my addr 172.21.15.26:0/1251449059 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d4a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d77fe640 1 -- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 msgr2=0x56387d4a52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d77fe640 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d4a52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d77fe640 1 -- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 msgr2=0x56387d4a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d77fe640 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d77fe640 1 -- 172.21.15.26:0/1251449059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56387d3705e0 con 0x56387d4e2120 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d4a52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:01:07.157 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d77fe640 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4e2120 0x56387d4f8b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81d00562b0 tx=0x7f81d0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d878515827f53c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b7fff640 1 -- 172.21.15.26:0/1251449059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d0083070 con 0x56387d4e2120 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b7fff640 1 -- 172.21.15.26:0/1251449059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d005f190 con 0x56387d4e2120 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b7fff640 1 -- 172.21.15.26:0/1251449059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d006e070 con 0x56387d4e2120 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/1251449059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4e2120 msgr2=0x56387d4f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4e2120 0x56387d4f8b10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81d00562b0 tx=0x7f81d0001260 comp rx=0 tx=0).stop 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/1251449059 shutdown_connections 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4e2120 0x56387d4f8b10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4dd8a0 0x56387d4a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- 172.21.15.26:0/1251449059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d4a52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/1251449059 >> 172.21.15.26:0/1251449059 conn(0x56387d388b00 msgr2=0x56387d4dd080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/1251449059 shutdown_connections 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/1251449059 wait complete. 2024-04-21T09:01:07.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- start start 2024-04-21T09:01:07.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 Processor -- start 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d54fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d550250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4e2120 0x56387d4fae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56387d2ed970 con 0x56387d4dd8a0 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x56387d2a38f0 con 0x56387d4e2120 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x56387d2f2c90 con 0x56387d4a6f00 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 10 client.0 _ll_register_callbacks cb 0x7f81c0003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d550250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d550250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37930/0 (socket says 172.21.15.26:37930) 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 -- 172.21.15.26:0/3464958335 learned_addr learned my addr 172.21.15.26:0/3464958335 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:01:07.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d54fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 -- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 msgr2=0x56387d54fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d54fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 -- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4e2120 msgr2=0x56387d4fae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4e2120 0x56387d4fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 -- 172.21.15.26:0/3464958335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56387d280ae0 con 0x56387d4dd8a0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81d67fc640 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d550250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81cc006cf0 tx=0x7f81cc0aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc200d25480462a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b5ffb640 1 -- 172.21.15.26:0/3464958335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b5040 con 0x56387d4dd8a0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81d005f190 con 0x56387d4dd8a0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b5ffb640 1 -- 172.21.15.26:0/3464958335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(31..31 src has 1..31) ==== 5782+0+0 (secure 0 0 0) 0x7f81cc004450 con 0x56387d4dd8a0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b5ffb640 1 -- 172.21.15.26:0/3464958335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f81cc0d0050 con 0x56387d4dd8a0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 10 client.4902 fetch_fsmap learned FSMap version 8 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56387d283d80 con 0x56387d4dd8a0 2024-04-21T09:01:07.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b5ffb640 1 -- 172.21.15.26:0/3464958335 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d005f190 con 0x56387d4dd8a0 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81b5ffb640 1 -- 172.21.15.26:0/3464958335 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f81cc0d3020 con 0x56387d4dd8a0 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 10 client.4902 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 10 client.4902 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 20 client.4902 populate_metadata read hostname 'smithi026' 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4fbaa0 0x56387d4fbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 4 client.4902 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9e6ed40d", "release": true, "await": true}] 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.155+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9e6ed40d", "release": true, "await": true}) -- 0x56387d28c0d0 con 0x56387d4fbaa0 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4fbaa0 0x56387d4fbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81d6ffd640 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4fbaa0 0x56387d4fbeb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41f2e95fdda49e59 server_cookie=5ec951bc6b067dd0 in_seq=0 out_seq=0 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81b5ffb640 10 client.4902 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81b5ffb640 1 -- 172.21.15.26:0/3464958335 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+586 (crc 0 0 0) 0x56387d28c0d0 con 0x56387d4fbaa0 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81b5ffb640 10 client.4902 handle_command_reply: tid=0 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 client.4902 shutdown 2024-04-21T09:01:07.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 msgr2=0x56387d550250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d550250 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81cc006cf0 tx=0x7f81cc0aa070 comp rx=0 tx=0).stop 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 shutdown_connections 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56387d4fbaa0 0x56387d4fbeb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56387d4e2120 0x56387d4fae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56387d4dd8a0 0x56387d550250 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 --2- 172.21.15.26:0/3464958335 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56387d4a6f00 0x56387d54fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81b5ffb640 0 client.4902 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 >> 172.21.15.26:0/3464958335 conn(0x56387d388b00 msgr2=0x56387d4a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 shutdown_connections 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 1 -- 172.21.15.26:0/3464958335 wait complete. 2024-04-21T09:01:07.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81e080b000 20 client.4902 trim_cache size 0 max 16384 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 8, 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "9e6ed40d": { 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 8, 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:01:07.166 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 85.1, 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:01:07.167 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:01:07.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f81c4068380 msgr2=0x7f81c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f81c4068380 0x7f81c406a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f81c80011f0 tx=0x7f81c8009040 comp rx=0 tx=0).stop 2024-04-21T09:01:07.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d8152e60 msgr2=0x7f81d81550e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:01:07.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d8152e60 0x7f81d81550e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c740 tx=0x7f81d000cc00 comp rx=0 tx=0).stop 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 shutdown_connections 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f81c4068380 0x7f81c406a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f81d8152e60 0x7f81d81550e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81d80ccba0 0x7f81d8072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 --2- 172.21.15.26:0/800207028 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81d80c5e90 0x7f81d80721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 >> 172.21.15.26:0/800207028 conn(0x7f81d80cbef0 msgr2=0x7f81d81591a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 shutdown_connections 2024-04-21T09:01:07.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:01:07.159+0000 7f81dd689640 1 -- 172.21.15.26:0/800207028 wait complete. 2024-04-21T09:01:07.176 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 9e6ed40d, seconds elapsed: 28.8 2024-04-21T09:01:07.442 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/14' 2024-04-21T09:01:07.442 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/18' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/13' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/33' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/17' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/35' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './109/37' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './109' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/19' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/15' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/31' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/36' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/20' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/12' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/39' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/10' 2024-04-21T09:01:07.443 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/34' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/38' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/11' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/16' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/32' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/30' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/14' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/18' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/13' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/33' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/17' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/35' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './110/37' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './110' 2024-04-21T09:01:07.444 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/19' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/15' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/31' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/36' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/20' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/12' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/39' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/10' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/34' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/38' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/11' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/16' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/32' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/30' 2024-04-21T09:01:07.445 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/14' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/18' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/13' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/33' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/17' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/35' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './111/37' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './111' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/19' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/15' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/31' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/36' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/20' 2024-04-21T09:01:07.446 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/12' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/39' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/10' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/34' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/38' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/11' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/16' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/32' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/30' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/14' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/18' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/13' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/33' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/17' 2024-04-21T09:01:07.447 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/35' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './112/37' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './112' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/19' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/15' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/31' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/36' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/20' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/12' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/39' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/10' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/34' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/38' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/11' 2024-04-21T09:01:07.448 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/16' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/32' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/30' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/14' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/18' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/13' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/33' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/17' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/35' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './113/37' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './113' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/19' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/15' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/31' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/36' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/20' 2024-04-21T09:01:07.449 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/12' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/39' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/10' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/34' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/38' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/11' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/16' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/32' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/30' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/14' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/18' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/13' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/33' 2024-04-21T09:01:07.450 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/17' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/35' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './114/37' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './114' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/19' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/15' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/31' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/36' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/20' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/12' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/39' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/10' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/34' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/38' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/11' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/16' 2024-04-21T09:01:07.451 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/32' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/30' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/14' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/18' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/13' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/33' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/17' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/35' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './115/37' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './115' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/19' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/15' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/31' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/36' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/20' 2024-04-21T09:01:07.452 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/12' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/39' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/10' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/34' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/38' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/11' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/16' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/32' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/30' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/14' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/18' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/13' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/33' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/17' 2024-04-21T09:01:07.453 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/35' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './116/37' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './116' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/19' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/15' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/31' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/36' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/20' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/12' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/39' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/10' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/34' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/38' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/11' 2024-04-21T09:01:07.454 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/16' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/32' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/30' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/14' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/18' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/13' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/33' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/17' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/35' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './117/37' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './117' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/19' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/15' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/31' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/36' 2024-04-21T09:01:07.455 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/20' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/12' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/39' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/10' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/34' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/38' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/11' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/16' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/32' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/30' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/14' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/18' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/13' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/33' 2024-04-21T09:01:07.456 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/17' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/35' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './118/37' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './118' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/19' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/15' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/31' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/36' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/20' 2024-04-21T09:01:07.457 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/12' 2024-04-21T09:01:08.928 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/39' 2024-04-21T09:01:08.928 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/10' 2024-04-21T09:01:08.928 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/34' 2024-04-21T09:01:08.928 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/38' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/11' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/16' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/32' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/30' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/14' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/18' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/13' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/33' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/17' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/35' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './119/37' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './119' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/19' 2024-04-21T09:01:08.929 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/15' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/31' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/36' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/20' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/12' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/39' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/10' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/34' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/38' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/11' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/16' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/32' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/30' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/14' 2024-04-21T09:01:08.930 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/18' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/13' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/33' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/17' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/35' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './120/37' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './120' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/19' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/15' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/31' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/36' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/20' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/12' 2024-04-21T09:01:08.931 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/39' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/10' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/34' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/38' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/11' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/16' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/32' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/30' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/14' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/18' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/13' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/33' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/17' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/35' 2024-04-21T09:01:08.932 INFO:tasks.workunit.client.0.smithi026.stdout:removed './121/37' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './121' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/19' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/15' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/31' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/36' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/20' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/12' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/39' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/10' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/34' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/38' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/11' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/16' 2024-04-21T09:01:08.933 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/32' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/30' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/14' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/18' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/13' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/33' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/17' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/35' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './122/37' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './122' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/19' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/15' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/31' 2024-04-21T09:01:08.934 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/36' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/20' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/12' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/39' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/10' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/34' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/38' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/11' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/16' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/32' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/30' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/14' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/18' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/13' 2024-04-21T09:01:08.935 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/33' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/17' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/35' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './123/37' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './123' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/19' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/15' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/31' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/36' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/20' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/12' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/39' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/10' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/34' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/38' 2024-04-21T09:01:08.936 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/11' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/16' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/32' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/30' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/14' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/18' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/13' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/33' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/17' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/35' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './124/37' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './124' 2024-04-21T09:01:08.937 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/19' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/15' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/31' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/36' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/20' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/12' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/39' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/10' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/34' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/38' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/11' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/16' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/32' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/30' 2024-04-21T09:01:08.938 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/14' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/18' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/13' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/33' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/17' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/35' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './125/37' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './125' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/19' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/15' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/31' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/36' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/20' 2024-04-21T09:01:08.939 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/12' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/39' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/10' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/34' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/38' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/11' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/16' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/32' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/30' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/14' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/18' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/13' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/33' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/17' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/35' 2024-04-21T09:01:08.940 INFO:tasks.workunit.client.0.smithi026.stdout:removed './126/37' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './126' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/19' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/15' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/31' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/36' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/20' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/12' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/39' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/10' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/34' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/38' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/11' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/16' 2024-04-21T09:01:08.941 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/32' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/30' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/14' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/18' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/13' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/33' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/17' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/35' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './127/37' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './127' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/19' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/15' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/31' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/36' 2024-04-21T09:01:08.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/20' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/12' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/39' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/10' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/34' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/38' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/11' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/16' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/32' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/30' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/14' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/18' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/13' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/33' 2024-04-21T09:01:08.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/17' 2024-04-21T09:01:08.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/35' 2024-04-21T09:01:10.674 INFO:tasks.workunit.client.0.smithi026.stdout:removed './128/37' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './128' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/19' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/15' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/31' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/36' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/20' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/12' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/39' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/10' 2024-04-21T09:01:10.675 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/34' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/38' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/11' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/16' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/32' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/30' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/14' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/18' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/13' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/33' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/17' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/35' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './129/37' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './129' 2024-04-21T09:01:10.676 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/19' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/15' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/31' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/36' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/20' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/12' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/39' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/10' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/34' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/38' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/11' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/16' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/32' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/30' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/14' 2024-04-21T09:01:10.677 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/18' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/13' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/33' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/17' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/35' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './130/37' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './130' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/19' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/15' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/31' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/36' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/20' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/12' 2024-04-21T09:01:10.678 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/39' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/10' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/34' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/38' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/11' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/16' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/32' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/30' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/14' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/18' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/13' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/33' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/17' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/35' 2024-04-21T09:01:10.679 INFO:tasks.workunit.client.0.smithi026.stdout:removed './131/37' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './131' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/19' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/15' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/31' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/36' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/20' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/12' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/39' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/10' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/34' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/38' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/11' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/16' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/32' 2024-04-21T09:01:10.680 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/30' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/14' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/18' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/13' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/33' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/17' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/35' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './132/37' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './132' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/19' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/15' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/31' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/36' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/20' 2024-04-21T09:01:10.681 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/12' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/39' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/10' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/34' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/38' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/11' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/16' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/32' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/30' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/14' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/18' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/13' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/33' 2024-04-21T09:01:10.682 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/17' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/35' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './133/37' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './133' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/19' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/15' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/31' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/36' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/20' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/12' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/39' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/10' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/34' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/38' 2024-04-21T09:01:10.683 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/11' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/16' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/32' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/30' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/14' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/18' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/13' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/33' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/17' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/35' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './134/37' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './134' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/19' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/15' 2024-04-21T09:01:10.684 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/31' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/36' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/20' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/12' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/39' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/10' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/34' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/38' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/11' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/16' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/32' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/30' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/14' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/18' 2024-04-21T09:01:10.685 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/13' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/33' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/17' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/35' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './135/37' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './135' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/19' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/15' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/31' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/36' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/20' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/12' 2024-04-21T09:01:10.686 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/39' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/10' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/34' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/38' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/11' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/16' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/32' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/30' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/14' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/18' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/13' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/33' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/17' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/35' 2024-04-21T09:01:10.687 INFO:tasks.workunit.client.0.smithi026.stdout:removed './136/37' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './136' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/19' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/15' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/31' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/36' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/20' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/12' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/39' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/10' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/34' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/38' 2024-04-21T09:01:10.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/11' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/16' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/32' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/30' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/14' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/18' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/13' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/33' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/17' 2024-04-21T09:01:10.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/35' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './137/37' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './137' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/19' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/15' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/31' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/36' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/20' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/12' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/39' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/10' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/34' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/38' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/11' 2024-04-21T09:01:10.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/16' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/32' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/30' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/14' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/18' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/13' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/33' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/17' 2024-04-21T09:01:12.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/35' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './138/37' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './138' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/19' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/15' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/31' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/36' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/20' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/12' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/39' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/10' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/34' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/38' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/11' 2024-04-21T09:01:12.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/16' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/32' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/30' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/14' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/18' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/13' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/33' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/17' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/35' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './139/37' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './139' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/19' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/15' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/31' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/36' 2024-04-21T09:01:12.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/20' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/12' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/39' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/10' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/34' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/38' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/11' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/16' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/32' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/30' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/14' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/18' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/13' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/33' 2024-04-21T09:01:12.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/17' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/35' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './140/37' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './140' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/19' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/15' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/31' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/36' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/20' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/12' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/39' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/10' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/34' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/38' 2024-04-21T09:01:12.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/11' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/16' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/32' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/30' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/14' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/18' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/13' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/33' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/17' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/35' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './141/37' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './141' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/19' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/15' 2024-04-21T09:01:12.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/31' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/36' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/20' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/12' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/39' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/10' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/34' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/38' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/11' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/16' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/32' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/30' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/14' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/18' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/13' 2024-04-21T09:01:12.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/33' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/17' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/35' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './142/37' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './142' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/19' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/15' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/31' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/36' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/20' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/12' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/39' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/10' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/34' 2024-04-21T09:01:12.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/38' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/11' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/16' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/32' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/30' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/14' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/18' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/13' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/33' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/17' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/35' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './143/37' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './143' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/19' 2024-04-21T09:01:12.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/15' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/31' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/36' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/20' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/12' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/39' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/10' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/34' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/38' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/11' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/16' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/32' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/30' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/14' 2024-04-21T09:01:12.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/18' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/13' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/33' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/17' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/35' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './144/37' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './144' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/19' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/15' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/31' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/36' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/20' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/12' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/39' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/10' 2024-04-21T09:01:12.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/34' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/38' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/11' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/16' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/32' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/30' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/14' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/18' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/13' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/33' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/17' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/35' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './145/37' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './145' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/19' 2024-04-21T09:01:12.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/15' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/31' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/36' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/20' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/12' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/39' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/10' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/34' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/38' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/11' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/16' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/32' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/30' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/14' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/18' 2024-04-21T09:01:12.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/13' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/33' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/17' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/35' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './146/37' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './146' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/19' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/15' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/31' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/36' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/20' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/12' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/39' 2024-04-21T09:01:12.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/10' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/34' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/38' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/11' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/16' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/32' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/30' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/14' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/18' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/13' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/33' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/17' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/35' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './147/37' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './147' 2024-04-21T09:01:12.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/19' 2024-04-21T09:01:12.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/15' 2024-04-21T09:01:12.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/31' 2024-04-21T09:01:12.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/36' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/20' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/12' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/39' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/10' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/34' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/38' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/11' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/16' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/32' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/30' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/14' 2024-04-21T09:01:14.041 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/18' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/13' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/33' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/17' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/35' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './148/37' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './148' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/19' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/15' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/31' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/36' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/20' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/12' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/39' 2024-04-21T09:01:14.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/10' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/34' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/38' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/11' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/16' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/32' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/30' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/14' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/18' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/13' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/33' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/17' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/35' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './149/37' 2024-04-21T09:01:14.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './149' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/19' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/15' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/31' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/36' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/20' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/12' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/39' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/10' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/34' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/38' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/11' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/16' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/32' 2024-04-21T09:01:14.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/30' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/14' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/18' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/13' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/33' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/17' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/35' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './150/37' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './150' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/19' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/15' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/31' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/36' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/20' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/12' 2024-04-21T09:01:14.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/39' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/10' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/34' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/38' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/11' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/16' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/32' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/30' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/14' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/18' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/13' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/33' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/17' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/35' 2024-04-21T09:01:14.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './151/37' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './151' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/19' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/15' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/31' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/36' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/20' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/12' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/39' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/10' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/34' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/38' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/11' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/16' 2024-04-21T09:01:14.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/32' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/30' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/14' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/18' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/13' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/33' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/17' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/35' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './152/37' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './152' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/19' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/15' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/31' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/36' 2024-04-21T09:01:14.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/20' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/12' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/39' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/10' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/34' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/38' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/11' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/16' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/32' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/30' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/14' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/18' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/13' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/33' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/17' 2024-04-21T09:01:14.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/35' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './153/37' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './153' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/19' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/15' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/31' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/36' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/20' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/12' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/39' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/10' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/34' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/38' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/11' 2024-04-21T09:01:14.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/16' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/32' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/30' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/14' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/18' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/13' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/33' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/17' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/35' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './154/37' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './154' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/19' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/15' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/31' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/36' 2024-04-21T09:01:14.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/20' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/12' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/39' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/10' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/34' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/38' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/11' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/16' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/32' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/30' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/14' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/18' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/13' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/33' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/17' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/35' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './155/37' 2024-04-21T09:01:14.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './155' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/19' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/15' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/31' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/36' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/20' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/12' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/39' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/10' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/34' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/38' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/11' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/16' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/32' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/30' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/14' 2024-04-21T09:01:14.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/18' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/13' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/33' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/17' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/35' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './156/37' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './156' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/19' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/15' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/31' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/36' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/20' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/12' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/39' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/10' 2024-04-21T09:01:14.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/34' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/38' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/11' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/16' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/32' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/30' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/14' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/18' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/13' 2024-04-21T09:01:14.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/33' 2024-04-21T09:01:15.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/17' 2024-04-21T09:01:15.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/35' 2024-04-21T09:01:15.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './157/37' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './157' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/19' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/15' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/31' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/36' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/20' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/12' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/39' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/10' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/34' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/38' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/11' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/16' 2024-04-21T09:01:15.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/32' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/30' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/14' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/18' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/13' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/33' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/17' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/35' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './158/37' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './158' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/19' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/15' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/31' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/36' 2024-04-21T09:01:15.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/20' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/12' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/39' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/10' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/34' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/38' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/11' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/16' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/32' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/30' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/14' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/18' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/13' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/33' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/17' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/35' 2024-04-21T09:01:15.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './159/37' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './159' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/19' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/15' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/31' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/36' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/20' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/12' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/39' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/10' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/34' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/38' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/11' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/16' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/32' 2024-04-21T09:01:15.800 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/30' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/14' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/18' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/13' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/33' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/17' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/35' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './160/37' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './160' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/19' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/15' 2024-04-21T09:01:15.801 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/31' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/36' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/20' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/12' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/39' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/10' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/34' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/38' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/11' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/16' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/32' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/30' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/14' 2024-04-21T09:01:15.802 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/18' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/13' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/33' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/17' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/35' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './161/37' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './161' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/19' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/15' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/31' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/36' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/20' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/12' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/39' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/10' 2024-04-21T09:01:15.803 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/34' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/38' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/11' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/16' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/32' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/30' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/14' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/18' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/13' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/33' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/17' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/35' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './162/37' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './162' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/19' 2024-04-21T09:01:15.804 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/15' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/31' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/36' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/20' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/12' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/39' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/10' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/34' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/38' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/11' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/16' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/32' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/30' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/14' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/18' 2024-04-21T09:01:15.805 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/13' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/33' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/17' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/35' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './163/37' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './163' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/19' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/15' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/31' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/36' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/20' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/12' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/39' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/10' 2024-04-21T09:01:15.806 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/34' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/38' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/11' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/16' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/32' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/30' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/14' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/18' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/13' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/33' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/17' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/35' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './164/37' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './164' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/19' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/15' 2024-04-21T09:01:15.807 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/31' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/36' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/20' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/12' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/39' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/10' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/34' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/38' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/11' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/16' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/32' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/30' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/14' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/18' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/13' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/33' 2024-04-21T09:01:15.808 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/17' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/35' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './165/37' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './165' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/19' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/15' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/31' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/36' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/20' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/12' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/39' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/10' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/34' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/38' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/11' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/16' 2024-04-21T09:01:15.809 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/32' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/30' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/14' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/18' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/13' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/33' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/17' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/35' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './166/37' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './166' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/19' 2024-04-21T09:01:15.810 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/15' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/31' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/36' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/20' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/12' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/39' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/10' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/34' 2024-04-21T09:01:15.811 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/38' 2024-04-21T09:01:17.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/11' 2024-04-21T09:01:17.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/16' 2024-04-21T09:01:17.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/32' 2024-04-21T09:01:17.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/30' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/14' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/18' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/13' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/33' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/17' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/35' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './167/37' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './167' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/19' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/15' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/31' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/36' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/20' 2024-04-21T09:01:17.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/12' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/39' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/10' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/34' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/38' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/11' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/16' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/32' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/30' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/14' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/18' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/13' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/33' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/17' 2024-04-21T09:01:17.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/35' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './168/37' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './168' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/19' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/15' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/31' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/36' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/20' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/12' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/39' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/10' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/34' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/38' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/11' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/16' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/32' 2024-04-21T09:01:17.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/30' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/14' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/18' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/13' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/33' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/17' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/35' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './169/37' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './169' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/19' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/15' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/31' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/36' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/20' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/12' 2024-04-21T09:01:17.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/39' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/10' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/34' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/38' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/11' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/16' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/32' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/30' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/14' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/18' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/13' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/33' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/17' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/35' 2024-04-21T09:01:17.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './170/37' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './170' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/19' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/15' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/31' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/36' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/20' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/12' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/39' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/10' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/34' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/38' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/11' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/16' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/32' 2024-04-21T09:01:17.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/30' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/14' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/18' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/13' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/33' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/17' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/35' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './171/37' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './171' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/19' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/15' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/31' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/36' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/20' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/12' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/39' 2024-04-21T09:01:17.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/10' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/34' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/38' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/11' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/16' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/32' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/30' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/14' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/18' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/13' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/33' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/17' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/35' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './172/37' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './172' 2024-04-21T09:01:17.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/19' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/15' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/31' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/36' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/20' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/12' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/39' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/10' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/34' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/38' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/11' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/16' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/32' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/30' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/14' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/18' 2024-04-21T09:01:17.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/13' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/33' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/17' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/35' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './173/37' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './173' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/19' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/15' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/31' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/36' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/20' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/12' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/39' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/10' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/34' 2024-04-21T09:01:17.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/38' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/11' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/16' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/32' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/30' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/14' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/18' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/13' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/33' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/17' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/35' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './174/37' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './174' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/19' 2024-04-21T09:01:17.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/15' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/31' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/36' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/20' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/12' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/39' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/10' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/34' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/38' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/11' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/16' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/32' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/30' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/14' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/18' 2024-04-21T09:01:17.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/13' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/33' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/17' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/35' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './175/37' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './175' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/19' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/15' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/31' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/36' 2024-04-21T09:01:17.378 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/20' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/12' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/39' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/10' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/34' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/38' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/11' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/16' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/32' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/30' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/14' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/18' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/13' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/33' 2024-04-21T09:01:17.379 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/17' 2024-04-21T09:01:17.380 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/35' 2024-04-21T09:01:17.380 INFO:tasks.workunit.client.0.smithi026.stdout:removed './176/37' 2024-04-21T09:01:17.380 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './176' 2024-04-21T09:01:17.380 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/19' 2024-04-21T09:01:17.380 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/15' 2024-04-21T09:01:19.009 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/31' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/36' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/20' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/12' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/39' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/10' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/34' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/38' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/11' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/16' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/32' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/30' 2024-04-21T09:01:19.010 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/14' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/18' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/13' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/33' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/17' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/35' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './177/37' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './177' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/19' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/15' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/31' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/36' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/20' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/12' 2024-04-21T09:01:19.011 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/39' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/10' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/34' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/38' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/11' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/16' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/32' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/30' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/14' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/18' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/13' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/33' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/17' 2024-04-21T09:01:19.012 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/35' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './178/37' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './178' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/19' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/15' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/31' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/36' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/20' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/12' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/39' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/10' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/34' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/38' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/11' 2024-04-21T09:01:19.013 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/16' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/32' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/30' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/14' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/18' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/13' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/33' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/17' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/35' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './179/37' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './179' 2024-04-21T09:01:19.014 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/19' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/15' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/31' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/36' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/20' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/12' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/39' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/10' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/34' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/38' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/11' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/16' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/32' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/30' 2024-04-21T09:01:19.015 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/14' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/18' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/13' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/33' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/17' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/35' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './180/37' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './180' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/19' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/15' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/31' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/36' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/20' 2024-04-21T09:01:19.016 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/12' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/39' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/10' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/34' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/38' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/11' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/16' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/32' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/30' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/14' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/18' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/13' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/33' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/17' 2024-04-21T09:01:19.017 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/35' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './181/37' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './181' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/19' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/15' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/31' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/36' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/20' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/12' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/39' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/10' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/34' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/38' 2024-04-21T09:01:19.018 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/11' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/16' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/32' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/30' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/14' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/18' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/13' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/33' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/17' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/35' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './182/37' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './182' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/19' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/15' 2024-04-21T09:01:19.019 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/31' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/36' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/20' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/12' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/39' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/10' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/34' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/38' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/11' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/16' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/32' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/30' 2024-04-21T09:01:19.020 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/14' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/18' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/13' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/33' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/17' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/35' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './183/37' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './183' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/19' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/15' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/31' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/36' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/20' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/12' 2024-04-21T09:01:19.021 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/39' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/10' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/34' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/38' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/11' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/16' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/32' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/30' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/14' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/18' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/13' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/33' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/17' 2024-04-21T09:01:19.022 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/35' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './184/37' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './184' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/19' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/15' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/31' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/36' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/20' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/12' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/39' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/10' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/34' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/38' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/11' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/16' 2024-04-21T09:01:19.023 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/32' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/30' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/14' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/18' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/13' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/33' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/17' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/35' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './185/37' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './185' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/19' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/15' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/31' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/36' 2024-04-21T09:01:19.024 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/20' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/12' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/39' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/10' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/34' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/38' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/11' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/16' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/32' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/30' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/14' 2024-04-21T09:01:19.025 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/18' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/13' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/33' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/17' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/35' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './186/37' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './186' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/19' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/15' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/31' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/36' 2024-04-21T09:01:20.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/20' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/12' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/39' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/10' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/34' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/38' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/11' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/16' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/32' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/30' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/14' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/18' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/13' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/33' 2024-04-21T09:01:20.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/17' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/35' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './187/37' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './187' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/19' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/15' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/31' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/36' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/20' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/12' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/39' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/10' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/34' 2024-04-21T09:01:20.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/38' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/11' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/16' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/32' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/30' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/14' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/18' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/13' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/33' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/17' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/35' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './188/37' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './188' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/19' 2024-04-21T09:01:20.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/15' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/31' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/36' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/20' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/12' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/39' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/10' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/34' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/38' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/11' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/16' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/32' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/30' 2024-04-21T09:01:20.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/14' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/18' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/13' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/33' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/17' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/35' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './189/37' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './189' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/19' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/15' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/31' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/36' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/20' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/12' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/39' 2024-04-21T09:01:20.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/10' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/34' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/38' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/11' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/16' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/32' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/30' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/14' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/18' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/13' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/33' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/17' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/35' 2024-04-21T09:01:20.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './190/37' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './190' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/19' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/15' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/31' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/36' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/20' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/12' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/39' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/10' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/34' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/38' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/11' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/16' 2024-04-21T09:01:20.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/32' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/30' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/14' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/18' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/13' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/33' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/17' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/35' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './191/37' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './191' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/19' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/15' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/31' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/36' 2024-04-21T09:01:20.840 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/20' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/12' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/39' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/10' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/34' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/38' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/11' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/16' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/32' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/30' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/14' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/18' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/13' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/33' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/17' 2024-04-21T09:01:20.841 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/35' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './192/37' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './192' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/19' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/15' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/31' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/36' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/20' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/12' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/39' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/10' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/34' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/38' 2024-04-21T09:01:20.842 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/11' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/16' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/32' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/30' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/14' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/18' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/13' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/33' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/17' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/35' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './193/37' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './193' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/19' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/15' 2024-04-21T09:01:20.843 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/31' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/36' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/20' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/12' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/39' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/10' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/34' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/38' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/11' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/16' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/32' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/30' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/14' 2024-04-21T09:01:20.844 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/18' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/13' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/33' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/17' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/35' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './194/37' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './194' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/19' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/15' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/31' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/36' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/20' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/12' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/39' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/10' 2024-04-21T09:01:20.845 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/34' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/38' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/11' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/16' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/32' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/30' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/14' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/18' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/13' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/33' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/17' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/35' 2024-04-21T09:01:20.846 INFO:tasks.workunit.client.0.smithi026.stdout:removed './195/37' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './195' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/19' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/15' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/31' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/36' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/20' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/12' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/39' 2024-04-21T09:01:20.847 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/10' 2024-04-21T09:01:22.237 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:22.239 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:22.361 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/34' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/38' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/11' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/16' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/32' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/30' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/14' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/18' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/13' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/33' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/17' 2024-04-21T09:01:22.362 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/35' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './196/37' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './196' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/19' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/15' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/31' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/36' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/20' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/12' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/39' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/10' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/34' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/38' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/11' 2024-04-21T09:01:22.363 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/16' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/32' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/30' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/14' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/18' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/13' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/33' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/17' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/35' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './197/37' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './197' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/19' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/15' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/31' 2024-04-21T09:01:22.364 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/36' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/20' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/12' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/39' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/10' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/34' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/38' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/11' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/16' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/32' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/30' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/14' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/18' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/13' 2024-04-21T09:01:22.365 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/33' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/17' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/35' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './198/37' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './198' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/19' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/15' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/31' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/36' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/20' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/12' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/39' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/10' 2024-04-21T09:01:22.366 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/34' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/38' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/11' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/16' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/32' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/30' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/14' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/18' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/13' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/33' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/17' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/35' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './199/37' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './199' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/21' 2024-04-21T09:01:22.367 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/27' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/31' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/36' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/20' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/39' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/34' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/38' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/28' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/24' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/29' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/32' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/22' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/25' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/30' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/33' 2024-04-21T09:01:22.368 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/23' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/35' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/26' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './200/37' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './200' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/21' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/27' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/31' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/36' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/20' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/39' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/34' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/38' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/28' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/24' 2024-04-21T09:01:22.369 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/29' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/32' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/22' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/25' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/30' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/33' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/23' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/35' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/26' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './201/37' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './201' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/21' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/27' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/31' 2024-04-21T09:01:22.370 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/36' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/20' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/39' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/34' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/38' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/28' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/24' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/29' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/32' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/22' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/25' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/30' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/33' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/23' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/35' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/26' 2024-04-21T09:01:22.371 INFO:tasks.workunit.client.0.smithi026.stdout:removed './202/37' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './202' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/21' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/27' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/31' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/36' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/20' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/39' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/34' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/38' 2024-04-21T09:01:22.372 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/28' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/24' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/29' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/32' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/22' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/25' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/30' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/33' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/23' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/35' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/26' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './203/37' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './203' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/21' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/27' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/31' 2024-04-21T09:01:22.373 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/36' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/20' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/39' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/34' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/38' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/28' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/24' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/29' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/32' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/22' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/25' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/30' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/33' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/23' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/35' 2024-04-21T09:01:22.374 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/26' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './204/37' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './204' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/21' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/27' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/31' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/36' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/20' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/39' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/34' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/38' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/28' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/24' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/29' 2024-04-21T09:01:22.375 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/32' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/22' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/25' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/30' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/33' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/23' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/35' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/26' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './205/37' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './205' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/21' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/27' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/31' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/36' 2024-04-21T09:01:22.376 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/20' 2024-04-21T09:01:22.377 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/39' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/34' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/38' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/28' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/24' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/29' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/32' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/22' 2024-04-21T09:01:24.042 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/25' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/30' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/33' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/23' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/35' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/26' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './206/37' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './206' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/21' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/27' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/31' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/36' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/20' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/39' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/34' 2024-04-21T09:01:24.043 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/38' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/28' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/24' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/29' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/32' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/22' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/25' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/30' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/33' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/23' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/35' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/26' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './207/37' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './207' 2024-04-21T09:01:24.044 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/21' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/27' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/31' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/36' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/20' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/39' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/34' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/38' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/28' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/24' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/29' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/32' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/22' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/25' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/30' 2024-04-21T09:01:24.045 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/33' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/23' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/35' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/26' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './208/37' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './208' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/21' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/27' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/31' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/36' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/20' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/39' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/34' 2024-04-21T09:01:24.046 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/38' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/28' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/24' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/29' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/32' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/22' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/25' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/30' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/33' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/23' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/35' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/26' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './209/37' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './209' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/21' 2024-04-21T09:01:24.047 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/27' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/31' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/36' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/20' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/39' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/34' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/38' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/28' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/24' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/29' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/32' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/22' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/25' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/30' 2024-04-21T09:01:24.048 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/33' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/23' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/35' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/26' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './210/37' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './210' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/21' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/27' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/31' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/36' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/20' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/39' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/34' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/38' 2024-04-21T09:01:24.049 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/28' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/24' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/29' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/32' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/22' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/25' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/30' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/33' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/23' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/35' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/26' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './211/37' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './211' 2024-04-21T09:01:24.050 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/21' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/27' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/31' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/36' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/20' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/39' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/34' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/38' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/28' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/24' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/29' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/32' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/22' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/25' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/30' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/33' 2024-04-21T09:01:24.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/23' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/35' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/26' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './212/37' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './212' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/21' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/27' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/31' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/36' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/20' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/39' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/34' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/38' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/28' 2024-04-21T09:01:24.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/24' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/29' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/32' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/22' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/25' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/30' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/33' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/23' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/35' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/26' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './213/37' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './213' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/21' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/27' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/31' 2024-04-21T09:01:24.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/36' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/20' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/39' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/34' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/38' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/28' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/24' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/29' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/32' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/22' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/25' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/30' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/33' 2024-04-21T09:01:24.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/23' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/35' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/26' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './214/37' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './214' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/21' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/27' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/31' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/36' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/20' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/39' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/34' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/38' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/28' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/24' 2024-04-21T09:01:24.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/29' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/32' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/22' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/25' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/30' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/33' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/23' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/35' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/26' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './215/37' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './215' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/21' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/27' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/31' 2024-04-21T09:01:24.056 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/36' 2024-04-21T09:01:24.057 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/20' 2024-04-21T09:01:24.057 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/39' 2024-04-21T09:01:24.057 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/34' 2024-04-21T09:01:24.057 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/38' 2024-04-21T09:01:25.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/28' 2024-04-21T09:01:25.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/24' 2024-04-21T09:01:25.688 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/29' 2024-04-21T09:01:25.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/32' 2024-04-21T09:01:25.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/22' 2024-04-21T09:01:25.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/25' 2024-04-21T09:01:25.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/30' 2024-04-21T09:01:25.689 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/33' 2024-04-21T09:01:25.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/23' 2024-04-21T09:01:25.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/35' 2024-04-21T09:01:25.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/26' 2024-04-21T09:01:25.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './216/37' 2024-04-21T09:01:25.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './216' 2024-04-21T09:01:25.690 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/21' 2024-04-21T09:01:25.691 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/27' 2024-04-21T09:01:25.691 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/31' 2024-04-21T09:01:25.691 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/36' 2024-04-21T09:01:25.691 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/20' 2024-04-21T09:01:25.691 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/39' 2024-04-21T09:01:25.692 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/34' 2024-04-21T09:01:25.692 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/38' 2024-04-21T09:01:25.692 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/28' 2024-04-21T09:01:25.692 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/24' 2024-04-21T09:01:25.692 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/29' 2024-04-21T09:01:25.692 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/32' 2024-04-21T09:01:25.693 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/22' 2024-04-21T09:01:25.693 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/25' 2024-04-21T09:01:25.693 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/30' 2024-04-21T09:01:25.693 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/33' 2024-04-21T09:01:25.693 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/23' 2024-04-21T09:01:25.694 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/35' 2024-04-21T09:01:25.694 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/26' 2024-04-21T09:01:25.694 INFO:tasks.workunit.client.0.smithi026.stdout:removed './217/37' 2024-04-21T09:01:25.694 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './217' 2024-04-21T09:01:25.694 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/21' 2024-04-21T09:01:25.694 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/27' 2024-04-21T09:01:25.695 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/31' 2024-04-21T09:01:25.695 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/36' 2024-04-21T09:01:25.695 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/20' 2024-04-21T09:01:25.695 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/39' 2024-04-21T09:01:25.695 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/34' 2024-04-21T09:01:25.695 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/38' 2024-04-21T09:01:25.696 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/28' 2024-04-21T09:01:25.696 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/24' 2024-04-21T09:01:25.696 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/29' 2024-04-21T09:01:25.696 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/32' 2024-04-21T09:01:25.696 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/22' 2024-04-21T09:01:25.696 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/25' 2024-04-21T09:01:25.697 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/30' 2024-04-21T09:01:25.697 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/33' 2024-04-21T09:01:25.697 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/23' 2024-04-21T09:01:25.697 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/35' 2024-04-21T09:01:25.697 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/26' 2024-04-21T09:01:25.698 INFO:tasks.workunit.client.0.smithi026.stdout:removed './218/37' 2024-04-21T09:01:25.698 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './218' 2024-04-21T09:01:25.698 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/21' 2024-04-21T09:01:25.698 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/27' 2024-04-21T09:01:25.698 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/31' 2024-04-21T09:01:25.698 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/36' 2024-04-21T09:01:25.699 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/20' 2024-04-21T09:01:25.699 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/39' 2024-04-21T09:01:25.699 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/34' 2024-04-21T09:01:25.699 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/38' 2024-04-21T09:01:25.699 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/28' 2024-04-21T09:01:25.699 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/24' 2024-04-21T09:01:25.700 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/29' 2024-04-21T09:01:25.700 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/32' 2024-04-21T09:01:25.700 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/22' 2024-04-21T09:01:25.700 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/25' 2024-04-21T09:01:25.700 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/30' 2024-04-21T09:01:25.701 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/33' 2024-04-21T09:01:25.701 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/23' 2024-04-21T09:01:25.701 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/35' 2024-04-21T09:01:25.701 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/26' 2024-04-21T09:01:25.701 INFO:tasks.workunit.client.0.smithi026.stdout:removed './219/37' 2024-04-21T09:01:25.701 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './219' 2024-04-21T09:01:25.702 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/21' 2024-04-21T09:01:25.702 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/27' 2024-04-21T09:01:25.702 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/31' 2024-04-21T09:01:25.702 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/36' 2024-04-21T09:01:25.702 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/20' 2024-04-21T09:01:25.702 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/39' 2024-04-21T09:01:25.703 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/34' 2024-04-21T09:01:25.703 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/38' 2024-04-21T09:01:25.703 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/28' 2024-04-21T09:01:25.703 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/24' 2024-04-21T09:01:25.703 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/29' 2024-04-21T09:01:25.703 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/32' 2024-04-21T09:01:25.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/22' 2024-04-21T09:01:25.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/25' 2024-04-21T09:01:25.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/30' 2024-04-21T09:01:25.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/33' 2024-04-21T09:01:25.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/23' 2024-04-21T09:01:25.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/35' 2024-04-21T09:01:25.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/26' 2024-04-21T09:01:25.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './220/37' 2024-04-21T09:01:25.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './220' 2024-04-21T09:01:25.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/21' 2024-04-21T09:01:25.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/27' 2024-04-21T09:01:25.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/31' 2024-04-21T09:01:25.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/36' 2024-04-21T09:01:25.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/20' 2024-04-21T09:01:25.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/39' 2024-04-21T09:01:25.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/34' 2024-04-21T09:01:25.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/38' 2024-04-21T09:01:25.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/28' 2024-04-21T09:01:25.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/24' 2024-04-21T09:01:25.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/29' 2024-04-21T09:01:25.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/32' 2024-04-21T09:01:25.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/22' 2024-04-21T09:01:25.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/25' 2024-04-21T09:01:25.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/30' 2024-04-21T09:01:25.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/33' 2024-04-21T09:01:25.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/23' 2024-04-21T09:01:25.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/35' 2024-04-21T09:01:25.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/26' 2024-04-21T09:01:25.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './221/37' 2024-04-21T09:01:25.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './221' 2024-04-21T09:01:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/21' 2024-04-21T09:01:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/27' 2024-04-21T09:01:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/31' 2024-04-21T09:01:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/36' 2024-04-21T09:01:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/20' 2024-04-21T09:01:25.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/39' 2024-04-21T09:01:25.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/34' 2024-04-21T09:01:25.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/38' 2024-04-21T09:01:25.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/28' 2024-04-21T09:01:25.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/24' 2024-04-21T09:01:25.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/29' 2024-04-21T09:01:25.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/32' 2024-04-21T09:01:25.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/22' 2024-04-21T09:01:25.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/25' 2024-04-21T09:01:25.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/30' 2024-04-21T09:01:25.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/33' 2024-04-21T09:01:25.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/23' 2024-04-21T09:01:25.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/35' 2024-04-21T09:01:25.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/26' 2024-04-21T09:01:25.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './222/37' 2024-04-21T09:01:25.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './222' 2024-04-21T09:01:25.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/21' 2024-04-21T09:01:25.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/27' 2024-04-21T09:01:25.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/31' 2024-04-21T09:01:25.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/36' 2024-04-21T09:01:25.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/20' 2024-04-21T09:01:25.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/39' 2024-04-21T09:01:25.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/34' 2024-04-21T09:01:25.714 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/38' 2024-04-21T09:01:25.714 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/28' 2024-04-21T09:01:25.714 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/24' 2024-04-21T09:01:25.714 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/29' 2024-04-21T09:01:25.714 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/32' 2024-04-21T09:01:25.714 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/22' 2024-04-21T09:01:25.715 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/25' 2024-04-21T09:01:25.715 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/30' 2024-04-21T09:01:25.715 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/33' 2024-04-21T09:01:25.715 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/23' 2024-04-21T09:01:25.715 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/35' 2024-04-21T09:01:25.716 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/26' 2024-04-21T09:01:25.716 INFO:tasks.workunit.client.0.smithi026.stdout:removed './223/37' 2024-04-21T09:01:25.716 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './223' 2024-04-21T09:01:25.716 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/21' 2024-04-21T09:01:25.717 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/27' 2024-04-21T09:01:25.717 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/31' 2024-04-21T09:01:25.717 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/36' 2024-04-21T09:01:25.717 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/20' 2024-04-21T09:01:25.717 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/39' 2024-04-21T09:01:25.718 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/34' 2024-04-21T09:01:25.718 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/38' 2024-04-21T09:01:25.718 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/28' 2024-04-21T09:01:25.718 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/24' 2024-04-21T09:01:25.718 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/29' 2024-04-21T09:01:25.718 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/32' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/22' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/25' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/30' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/33' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/23' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/35' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/26' 2024-04-21T09:01:25.719 INFO:tasks.workunit.client.0.smithi026.stdout:removed './224/37' 2024-04-21T09:01:25.720 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './224' 2024-04-21T09:01:25.721 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/21' 2024-04-21T09:01:25.721 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/27' 2024-04-21T09:01:25.721 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/31' 2024-04-21T09:01:25.722 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/36' 2024-04-21T09:01:25.722 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/20' 2024-04-21T09:01:25.722 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/39' 2024-04-21T09:01:25.722 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/34' 2024-04-21T09:01:25.722 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/38' 2024-04-21T09:01:25.722 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/28' 2024-04-21T09:01:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/24' 2024-04-21T09:01:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/29' 2024-04-21T09:01:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/32' 2024-04-21T09:01:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/22' 2024-04-21T09:01:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/25' 2024-04-21T09:01:25.723 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/30' 2024-04-21T09:01:25.724 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/33' 2024-04-21T09:01:25.724 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/23' 2024-04-21T09:01:25.724 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/35' 2024-04-21T09:01:25.724 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/26' 2024-04-21T09:01:25.724 INFO:tasks.workunit.client.0.smithi026.stdout:removed './225/37' 2024-04-21T09:01:25.725 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './225' 2024-04-21T09:01:25.725 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/21' 2024-04-21T09:01:25.725 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/27' 2024-04-21T09:01:25.725 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/31' 2024-04-21T09:01:25.725 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/36' 2024-04-21T09:01:25.725 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/20' 2024-04-21T09:01:25.726 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/39' 2024-04-21T09:01:25.726 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/34' 2024-04-21T09:01:25.726 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/38' 2024-04-21T09:01:25.726 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/28' 2024-04-21T09:01:25.726 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/24' 2024-04-21T09:01:27.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/29' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/32' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/22' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/25' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/30' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/33' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/23' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/35' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/26' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './226/37' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './226' 2024-04-21T09:01:27.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/21' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/27' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/31' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/36' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/20' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/39' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/34' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/38' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/28' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/24' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/29' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/32' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/22' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/25' 2024-04-21T09:01:27.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/30' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/33' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/23' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/35' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/26' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './227/37' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './227' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/21' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/27' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/31' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/36' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/20' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/39' 2024-04-21T09:01:27.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/34' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/38' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/28' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/24' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/29' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/32' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/22' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/25' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/30' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/33' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/23' 2024-04-21T09:01:27.343 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/35' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/26' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './228/37' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './228' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/21' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/27' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/31' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/36' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/20' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/39' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/34' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/38' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/28' 2024-04-21T09:01:27.344 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/24' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/29' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/32' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/22' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/25' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/30' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/33' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/23' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/35' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/26' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './229/37' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './229' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/21' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/27' 2024-04-21T09:01:27.345 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/31' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/36' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/20' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/39' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/34' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/38' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/28' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/24' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/29' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/32' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/22' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/25' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/30' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/33' 2024-04-21T09:01:27.346 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/23' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/35' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/26' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './230/37' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './230' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/21' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/27' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/31' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/36' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/20' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/39' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/34' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/38' 2024-04-21T09:01:27.347 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/28' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/24' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/29' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/32' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/22' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/25' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/30' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/33' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/23' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/35' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/26' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './231/37' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './231' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/21' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/27' 2024-04-21T09:01:27.348 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/31' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/36' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/20' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/39' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/34' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/38' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/28' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/24' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/29' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/32' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/22' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/25' 2024-04-21T09:01:27.349 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/30' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/33' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/23' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/35' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/26' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './232/37' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './232' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/21' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/27' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/31' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/36' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/20' 2024-04-21T09:01:27.350 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/39' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/34' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/38' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/28' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/24' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/29' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/32' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/22' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/25' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/30' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/33' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/23' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/35' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/26' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed './233/37' 2024-04-21T09:01:27.351 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './233' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/21' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/27' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/31' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/36' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/20' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/39' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/34' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/38' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/28' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/24' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/29' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/32' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/22' 2024-04-21T09:01:27.352 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/25' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/30' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/33' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/23' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/35' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/26' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './234/37' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './234' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/21' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/27' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/31' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/36' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/20' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/39' 2024-04-21T09:01:27.353 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/34' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/38' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/28' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/24' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/29' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/32' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/22' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/25' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/30' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/33' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/23' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/35' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/26' 2024-04-21T09:01:27.354 INFO:tasks.workunit.client.0.smithi026.stdout:removed './235/37' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './235' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/21' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/27' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/31' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/36' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/20' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/39' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/34' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/38' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/28' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/24' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/29' 2024-04-21T09:01:27.355 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/32' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/22' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/25' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/30' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/33' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/23' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/35' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/26' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed './236/37' 2024-04-21T09:01:28.942 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './236' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/21' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/27' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/31' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/36' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/20' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/39' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/34' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/38' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/28' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/24' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/29' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/32' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/22' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/25' 2024-04-21T09:01:28.943 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/30' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/33' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/23' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/35' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/26' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './237/37' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './237' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/21' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/27' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/31' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/36' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/20' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/39' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/34' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/38' 2024-04-21T09:01:28.944 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/28' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/24' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/29' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/32' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/22' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/25' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/30' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/33' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/23' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/35' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/26' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './238/37' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './238' 2024-04-21T09:01:28.945 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/21' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/27' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/31' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/36' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/20' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/39' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/34' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/38' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/28' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/24' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/29' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/32' 2024-04-21T09:01:28.946 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/22' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/25' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/30' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/33' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/23' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/35' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/26' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './239/37' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './239' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/21' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/27' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/31' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/36' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/20' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/39' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/34' 2024-04-21T09:01:28.947 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/38' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/28' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/24' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/29' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/32' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/22' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/25' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/30' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/33' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/23' 2024-04-21T09:01:28.948 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/35' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/26' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './240/37' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './240' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/21' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/27' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/31' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/36' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/20' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/39' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/34' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/38' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/28' 2024-04-21T09:01:28.949 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/24' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/29' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/32' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/22' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/25' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/30' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/33' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/23' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/35' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/26' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './241/37' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './241' 2024-04-21T09:01:28.950 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/21' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/27' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/31' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/36' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/20' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/39' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/34' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/38' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/28' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/24' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/29' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/32' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/22' 2024-04-21T09:01:28.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/25' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/30' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/33' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/23' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/35' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/26' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './242/37' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './242' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/21' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/27' 2024-04-21T09:01:28.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/31' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/36' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/20' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/39' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/34' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/38' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/28' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/24' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/29' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/32' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/22' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/25' 2024-04-21T09:01:28.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/30' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/33' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/23' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/35' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/26' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './243/37' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './243' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/21' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/27' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/31' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/36' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/20' 2024-04-21T09:01:28.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/39' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/34' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/38' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/28' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/24' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/29' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/32' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/22' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/25' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/30' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/33' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/23' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/35' 2024-04-21T09:01:28.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/26' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './244/37' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './244' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/21' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/27' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/31' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/36' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/20' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/39' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/34' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/38' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/28' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/24' 2024-04-21T09:01:28.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/29' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/32' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/22' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/25' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/30' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/33' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/23' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/35' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/26' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './245/37' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './245' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/21' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/27' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/31' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/36' 2024-04-21T09:01:28.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/20' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/39' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/34' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/38' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/28' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/24' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/29' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/32' 2024-04-21T09:01:28.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/22' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/25' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/30' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/33' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/23' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/35' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/26' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed './246/37' 2024-04-21T09:01:30.561 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './246' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/21' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/27' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/31' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/36' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/20' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/39' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/34' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/38' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/28' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/24' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/29' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/32' 2024-04-21T09:01:30.562 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/22' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/25' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/30' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/33' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/23' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/35' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/26' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './247/37' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './247' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/21' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/27' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/31' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/36' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/20' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/39' 2024-04-21T09:01:30.563 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/34' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/38' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/28' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/24' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/29' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/32' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/22' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/25' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/30' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/33' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/23' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/35' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/26' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed './248/37' 2024-04-21T09:01:30.564 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './248' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/21' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/27' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/31' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/36' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/20' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/39' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/34' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/38' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/28' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/24' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/29' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/32' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/22' 2024-04-21T09:01:30.565 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/25' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/30' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/33' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/23' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/35' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/26' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './249/37' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './249' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/21' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/27' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/31' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/36' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/20' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/39' 2024-04-21T09:01:30.566 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/34' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/38' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/28' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/24' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/29' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/32' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/22' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/25' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/30' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/33' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/23' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/35' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/26' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed './250/37' 2024-04-21T09:01:30.567 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './250' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/21' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/27' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/31' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/36' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/20' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/39' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/34' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/38' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/28' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/24' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/29' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/32' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/22' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/25' 2024-04-21T09:01:30.568 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/30' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/33' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/23' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/35' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/26' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './251/37' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './251' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/21' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/27' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/31' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/36' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/20' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/39' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/34' 2024-04-21T09:01:30.569 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/38' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/28' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/24' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/29' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/32' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/22' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/25' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/30' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/33' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/23' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/35' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/26' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './252/37' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './252' 2024-04-21T09:01:30.570 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/21' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/27' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/31' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/36' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/20' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/39' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/34' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/38' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/28' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/24' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/29' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/32' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/22' 2024-04-21T09:01:30.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/25' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/30' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/33' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/23' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/35' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/26' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './253/37' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './253' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/21' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/27' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/31' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/36' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/20' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/39' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/34' 2024-04-21T09:01:30.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/38' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/28' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/24' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/29' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/32' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/22' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/25' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/30' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/33' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/23' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/35' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/26' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './254/37' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './254' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/21' 2024-04-21T09:01:30.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/27' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/31' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/36' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/20' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/39' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/34' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/38' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/28' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/24' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/29' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/32' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/22' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/25' 2024-04-21T09:01:30.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/30' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/33' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/23' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/35' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/26' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './255/37' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './255' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/21' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/27' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/31' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/36' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/20' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/39' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/34' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/38' 2024-04-21T09:01:30.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/28' 2024-04-21T09:01:30.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/24' 2024-04-21T09:01:30.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/29' 2024-04-21T09:01:30.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/32' 2024-04-21T09:01:30.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/22' 2024-04-21T09:01:30.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/25' 2024-04-21T09:01:30.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/30' 2024-04-21T09:01:32.209 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/33' 2024-04-21T09:01:32.209 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/23' 2024-04-21T09:01:32.209 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/35' 2024-04-21T09:01:32.209 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/26' 2024-04-21T09:01:32.209 INFO:tasks.workunit.client.0.smithi026.stdout:removed './256/37' 2024-04-21T09:01:32.209 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './256' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/21' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/27' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/31' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/36' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/20' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/39' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/34' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/38' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/28' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/24' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/29' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/32' 2024-04-21T09:01:32.210 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/22' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/25' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/30' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/33' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/23' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/35' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/26' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './257/37' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './257' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/21' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/27' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/31' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/36' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/20' 2024-04-21T09:01:32.211 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/39' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/34' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/38' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/28' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/24' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/29' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/32' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/22' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/25' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/30' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/33' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/23' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/35' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/26' 2024-04-21T09:01:32.212 INFO:tasks.workunit.client.0.smithi026.stdout:removed './258/37' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './258' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/21' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/27' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/31' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/36' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/20' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/39' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/34' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/38' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/28' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/24' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/29' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/32' 2024-04-21T09:01:32.213 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/22' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/25' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/30' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/33' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/23' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/35' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/26' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './259/37' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './259' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/21' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/27' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/31' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/36' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/20' 2024-04-21T09:01:32.214 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/39' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/34' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/38' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/28' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/24' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/29' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/32' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/22' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/25' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/30' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/33' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/23' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/35' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/26' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed './260/37' 2024-04-21T09:01:32.215 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './260' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/21' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/27' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/31' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/36' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/20' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/39' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/34' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/38' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/28' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/24' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/29' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/32' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/22' 2024-04-21T09:01:32.216 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/25' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/30' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/33' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/23' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/35' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/26' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './261/37' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './261' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/21' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/27' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/31' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/36' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/20' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/39' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/34' 2024-04-21T09:01:32.217 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/38' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/28' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/24' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/29' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/32' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/22' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/25' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/30' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/33' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/23' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/35' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/26' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './262/37' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './262' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/21' 2024-04-21T09:01:32.218 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/27' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/31' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/36' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/20' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/39' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/34' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/38' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/28' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/24' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/29' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/32' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/22' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/25' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/30' 2024-04-21T09:01:32.219 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/33' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/23' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/35' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/26' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './263/37' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './263' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/21' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/27' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/31' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/36' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/20' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/39' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/34' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/38' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/28' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/24' 2024-04-21T09:01:32.220 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/29' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/32' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/22' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/25' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/30' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/33' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/23' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/35' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/26' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './264/37' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './264' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/21' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/27' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/31' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/36' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/20' 2024-04-21T09:01:32.221 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/39' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/34' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/38' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/28' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/24' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/29' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/32' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/22' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/25' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/30' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/33' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/23' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/35' 2024-04-21T09:01:32.222 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/26' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './265/37' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './265' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/21' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/27' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/31' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/36' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/20' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/39' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/34' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/38' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/28' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/24' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/29' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/32' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/22' 2024-04-21T09:01:32.223 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/25' 2024-04-21T09:01:32.224 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/30' 2024-04-21T09:01:32.224 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/33' 2024-04-21T09:01:32.224 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/23' 2024-04-21T09:01:33.780 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/35' 2024-04-21T09:01:33.780 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/26' 2024-04-21T09:01:33.780 INFO:tasks.workunit.client.0.smithi026.stdout:removed './266/37' 2024-04-21T09:01:33.780 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './266' 2024-04-21T09:01:33.781 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/21' 2024-04-21T09:01:33.781 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/27' 2024-04-21T09:01:33.781 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/31' 2024-04-21T09:01:33.781 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/36' 2024-04-21T09:01:33.781 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/20' 2024-04-21T09:01:33.781 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/39' 2024-04-21T09:01:33.782 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/34' 2024-04-21T09:01:33.782 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/38' 2024-04-21T09:01:33.782 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/28' 2024-04-21T09:01:33.782 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/24' 2024-04-21T09:01:33.782 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/29' 2024-04-21T09:01:33.782 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/32' 2024-04-21T09:01:33.782 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/22' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/25' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/30' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/33' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/23' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/35' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/26' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed './267/37' 2024-04-21T09:01:33.783 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './267' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/21' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/27' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/31' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/36' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/20' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/39' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/34' 2024-04-21T09:01:33.784 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/38' 2024-04-21T09:01:33.785 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/28' 2024-04-21T09:01:33.785 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/24' 2024-04-21T09:01:33.785 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/29' 2024-04-21T09:01:33.785 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/32' 2024-04-21T09:01:33.785 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/22' 2024-04-21T09:01:33.785 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/25' 2024-04-21T09:01:33.785 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/30' 2024-04-21T09:01:33.786 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/33' 2024-04-21T09:01:33.786 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/23' 2024-04-21T09:01:33.786 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/35' 2024-04-21T09:01:33.786 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/26' 2024-04-21T09:01:33.786 INFO:tasks.workunit.client.0.smithi026.stdout:removed './268/37' 2024-04-21T09:01:33.786 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './268' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/21' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/27' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/31' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/36' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/20' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/39' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/34' 2024-04-21T09:01:33.787 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/38' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/28' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/24' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/29' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/32' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/22' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/25' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/30' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/33' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/23' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/35' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/26' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './269/37' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './269' 2024-04-21T09:01:33.788 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/21' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/27' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/31' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/36' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/20' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/39' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/34' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/38' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/28' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/24' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/29' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/32' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/22' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/25' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/30' 2024-04-21T09:01:33.789 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/33' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/23' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/35' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/26' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './270/37' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './270' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/21' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/27' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/31' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/36' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/20' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/39' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/34' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/38' 2024-04-21T09:01:33.790 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/28' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/24' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/29' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/32' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/22' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/25' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/30' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/33' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/23' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/35' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/26' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './271/37' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './271' 2024-04-21T09:01:33.791 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/21' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/27' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/31' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/36' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/20' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/39' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/34' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/38' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/28' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/24' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/29' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/32' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/22' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/25' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/30' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/33' 2024-04-21T09:01:33.792 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/23' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/35' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/26' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './272/37' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './272' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/21' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/27' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/31' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/36' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/20' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/39' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/34' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/38' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/28' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/24' 2024-04-21T09:01:33.793 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/29' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/32' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/22' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/25' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/30' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/33' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/23' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/35' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/26' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './273/37' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './273' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/21' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/27' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/31' 2024-04-21T09:01:33.794 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/36' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/20' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/39' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/34' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/38' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/28' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/24' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/29' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/32' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/22' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/25' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/30' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/33' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/23' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/35' 2024-04-21T09:01:33.795 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/26' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './274/37' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './274' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/21' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/27' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/31' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/36' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/20' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/39' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/34' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/38' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/28' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/24' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/29' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/32' 2024-04-21T09:01:33.796 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/22' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/25' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/30' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/33' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/23' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/35' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/26' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './275/37' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './275' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/21' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/27' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/31' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/36' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/20' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/39' 2024-04-21T09:01:33.797 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/34' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/38' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/28' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/24' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/29' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/32' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/22' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/25' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/30' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/33' 2024-04-21T09:01:33.798 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/23' 2024-04-21T09:01:33.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/35' 2024-04-21T09:01:33.799 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/26' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './276/37' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './276' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/21' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/27' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/31' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/36' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/20' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/39' 2024-04-21T09:01:35.470 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/34' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/38' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/28' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/24' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/29' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/32' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/22' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/25' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/30' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/33' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/23' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/35' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/26' 2024-04-21T09:01:35.471 INFO:tasks.workunit.client.0.smithi026.stdout:removed './277/37' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './277' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/21' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/27' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/31' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/36' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/20' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/39' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/34' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/38' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/28' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/24' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/29' 2024-04-21T09:01:35.472 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/32' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/22' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/25' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/30' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/33' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/23' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/35' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/26' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './278/37' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './278' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/21' 2024-04-21T09:01:35.473 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/27' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/31' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/36' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/20' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/39' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/34' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/38' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/28' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/24' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/29' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/32' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/22' 2024-04-21T09:01:35.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/25' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/30' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/33' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/23' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/35' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/26' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './279/37' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './279' 2024-04-21T09:01:35.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/21' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/27' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/31' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/36' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/20' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/39' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/34' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/38' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/28' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/24' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/29' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/32' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/22' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/25' 2024-04-21T09:01:35.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/30' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/33' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/23' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/35' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/26' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './280/37' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './280' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/21' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/27' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/31' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/36' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/20' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/39' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/34' 2024-04-21T09:01:35.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/38' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/28' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/24' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/29' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/32' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/22' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/25' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/30' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/33' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/23' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/35' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/26' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './281/37' 2024-04-21T09:01:35.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './281' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/21' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/27' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/31' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/36' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/20' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/39' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/34' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/38' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/28' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/24' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/29' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/32' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/22' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/25' 2024-04-21T09:01:35.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/30' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/33' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/23' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/35' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/26' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './282/37' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './282' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/21' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/27' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/31' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/36' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/20' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/39' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/34' 2024-04-21T09:01:35.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/38' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/28' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/24' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/29' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/32' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/22' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/25' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/30' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/33' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/23' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/35' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/26' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './283/37' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './283' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/21' 2024-04-21T09:01:35.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/27' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/31' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/36' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/20' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/39' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/34' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/38' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/28' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/24' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/29' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/32' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/22' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/25' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/30' 2024-04-21T09:01:35.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/33' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/23' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/35' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/26' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './284/37' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './284' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/21' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/27' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/31' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/36' 2024-04-21T09:01:35.483 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/20' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/39' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/34' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/38' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/28' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/24' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/29' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/32' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/22' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/25' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/30' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/33' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/23' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/35' 2024-04-21T09:01:35.484 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/26' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './285/37' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './285' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/21' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/27' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/31' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/36' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/20' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/39' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/34' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/38' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/28' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/24' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/29' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/32' 2024-04-21T09:01:35.485 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/22' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/25' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/30' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/33' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/23' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/35' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/26' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed './286/37' 2024-04-21T09:01:35.486 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './286' 2024-04-21T09:01:40.585 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/21' 2024-04-21T09:01:40.585 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/27' 2024-04-21T09:01:40.585 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/31' 2024-04-21T09:01:40.585 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/36' 2024-04-21T09:01:40.585 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/20' 2024-04-21T09:01:40.585 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/39' 2024-04-21T09:01:40.585 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/34' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/38' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/28' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/24' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/29' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/32' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/22' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/25' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/30' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/33' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/23' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/35' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/26' 2024-04-21T09:01:40.586 INFO:tasks.workunit.client.0.smithi026.stdout:removed './287/37' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './287' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/21' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/27' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/31' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/36' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/20' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/39' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/34' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/38' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/28' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/24' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/29' 2024-04-21T09:01:40.587 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/32' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/22' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/25' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/30' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/33' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/23' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/35' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/26' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './288/37' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './288' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/21' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/27' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/31' 2024-04-21T09:01:40.588 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/36' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/20' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/39' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/34' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/38' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/28' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/24' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/29' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/32' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/22' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/25' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/30' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/33' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/23' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/35' 2024-04-21T09:01:40.589 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/26' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './289/37' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './289' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/21' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/27' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/31' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/36' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/20' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/39' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/34' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/38' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/28' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/24' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/29' 2024-04-21T09:01:40.590 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/32' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/22' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/25' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/30' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/33' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/23' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/35' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/26' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './290/37' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './290' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/21' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/27' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/31' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/36' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/20' 2024-04-21T09:01:40.591 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/39' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/34' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/38' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/28' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/24' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/29' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/32' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/22' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/25' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/30' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/33' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/23' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/35' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/26' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed './291/37' 2024-04-21T09:01:40.592 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './291' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/21' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/27' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/31' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/36' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/20' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/39' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/34' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/38' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/28' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/24' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/29' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/32' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/22' 2024-04-21T09:01:40.593 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/25' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/30' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/33' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/23' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/35' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/26' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './292/37' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './292' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/21' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/27' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/31' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/36' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/20' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/39' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/34' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/38' 2024-04-21T09:01:40.594 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/28' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/24' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/29' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/32' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/22' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/25' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/30' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/33' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/23' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/35' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/26' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './293/37' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './293' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/21' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/27' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/31' 2024-04-21T09:01:40.595 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/36' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/20' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/39' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/34' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/38' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/28' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/24' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/29' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/32' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/22' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/25' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/30' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/33' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/23' 2024-04-21T09:01:40.596 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/35' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/26' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './294/37' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './294' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/21' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/27' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/31' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/36' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/20' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/39' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/34' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/38' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/28' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/24' 2024-04-21T09:01:40.597 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/29' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/32' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/22' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/25' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/30' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/33' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/23' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/35' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/26' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './295/37' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './295' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/21' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/27' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/31' 2024-04-21T09:01:40.598 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/36' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/20' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/39' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/34' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/38' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/28' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/24' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/29' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/32' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/22' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/25' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/30' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/33' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/23' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/35' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/26' 2024-04-21T09:01:40.599 INFO:tasks.workunit.client.0.smithi026.stdout:removed './296/37' 2024-04-21T09:01:40.600 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './296' 2024-04-21T09:01:40.600 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/21' 2024-04-21T09:01:40.600 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/27' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/31' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/36' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/20' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/39' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/34' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/38' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/28' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/24' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/29' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/32' 2024-04-21T09:01:41.900 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/22' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/25' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/30' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/33' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/23' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/35' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/26' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './297/37' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './297' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/21' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/27' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/31' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/36' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/20' 2024-04-21T09:01:41.901 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/39' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/34' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/38' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/28' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/24' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/29' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/32' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/22' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/25' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/30' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/33' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/23' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/35' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/26' 2024-04-21T09:01:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:removed './298/37' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './298' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/21' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/27' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/31' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/36' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/20' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/39' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/34' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/38' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/28' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/24' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/29' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/32' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/22' 2024-04-21T09:01:41.903 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/25' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/30' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/33' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/23' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/35' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/26' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './299/37' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './299' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/19' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/15' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/20' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/12' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/10' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/11' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/16' 2024-04-21T09:01:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/14' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/18' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/13' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/166/17' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/166' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/19' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/15' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/20' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/12' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/10' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/11' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/16' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/14' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/18' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/13' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/147/17' 2024-04-21T09:01:41.905 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/147' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/19' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/15' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/20' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/12' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/10' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/11' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/16' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/14' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/18' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/13' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/151/17' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/151' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/19' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/15' 2024-04-21T09:01:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/20' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/12' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/10' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/11' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/16' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/14' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/18' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/13' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/170/17' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/170' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/19' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/15' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/20' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/12' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/10' 2024-04-21T09:01:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/11' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/16' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/14' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/18' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/13' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/167/17' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/167' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/19' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/15' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/20' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/12' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/10' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/11' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/16' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/14' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/18' 2024-04-21T09:01:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/13' 2024-04-21T09:01:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/140/17' 2024-04-21T09:01:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/140' 2024-04-21T09:01:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/19' 2024-04-21T09:01:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/15' 2024-04-21T09:01:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/20' 2024-04-21T09:01:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/12' 2024-04-21T09:01:41.909 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/10' 2024-04-21T09:01:42.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/11' 2024-04-21T09:01:42.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/16' 2024-04-21T09:01:42.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/14' 2024-04-21T09:01:42.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/18' 2024-04-21T09:01:42.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/13' 2024-04-21T09:01:42.951 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/142/17' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/142' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/19' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/15' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/20' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/12' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/10' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/11' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/16' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/14' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/18' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/13' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/150/17' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/150' 2024-04-21T09:01:42.952 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/19' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/15' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/20' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/12' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/10' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/11' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/16' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/14' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/18' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/13' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/105/17' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/105' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/19' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/15' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/20' 2024-04-21T09:01:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/12' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/10' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/11' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/16' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/14' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/18' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/13' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/149/17' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/149' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/19' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/15' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/20' 2024-04-21T09:01:42.954 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/12' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/10' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/11' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/16' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/14' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/18' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/13' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/109/17' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/109' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/19' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/15' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/20' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/12' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/10' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/11' 2024-04-21T09:01:42.955 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/16' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/14' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/18' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/13' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/158/17' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/158' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/19' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/15' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/20' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/12' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/10' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/11' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/16' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/14' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/18' 2024-04-21T09:01:42.956 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/13' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/106/17' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/106' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/19' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/15' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/20' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/12' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/10' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/11' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/16' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/14' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/18' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/13' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/189/17' 2024-04-21T09:01:42.957 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/189' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/19' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/15' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/20' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/12' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/10' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/11' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/16' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/14' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/18' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/13' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/133/17' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/133' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/19' 2024-04-21T09:01:42.958 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/15' 2024-04-21T09:01:42.959 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/20' 2024-04-21T09:01:42.959 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/12' 2024-04-21T09:01:42.959 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/10' 2024-04-21T09:01:42.959 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/11' 2024-04-21T09:01:43.831 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/16' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/14' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/18' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/13' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/173/17' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/173' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/19' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/15' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/20' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/12' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/10' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/11' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/16' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/14' 2024-04-21T09:01:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/18' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/13' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/174/17' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/174' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/19' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/15' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/20' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/12' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/10' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/11' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/16' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/14' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/18' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/13' 2024-04-21T09:01:43.833 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/155/17' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/155' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/19' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/15' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/20' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/12' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/10' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/11' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/16' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/14' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/18' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/13' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/114/17' 2024-04-21T09:01:43.834 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/114' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/19' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/15' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/20' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/12' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/10' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/11' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/16' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/14' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/18' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/13' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/159/17' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/159' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/19' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/15' 2024-04-21T09:01:43.835 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/20' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/12' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/10' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/11' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/16' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/14' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/18' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/13' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/187/17' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/187' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/19' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/15' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/20' 2024-04-21T09:01:43.836 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/12' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/10' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/11' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/16' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/14' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/18' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/13' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/185/17' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/185' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/19' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/15' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/20' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/12' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/10' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/11' 2024-04-21T09:01:43.837 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/16' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/14' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/18' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/13' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/120/17' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/120' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/19' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/15' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/20' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/12' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/10' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/11' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/16' 2024-04-21T09:01:43.838 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/14' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/18' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/13' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/110/17' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/110' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/19' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/15' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/20' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/12' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/10' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/11' 2024-04-21T09:01:43.839 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/16' 2024-04-21T09:01:44.736 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/14' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/18' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/13' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/137/17' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/137' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/19' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/15' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/20' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/12' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/10' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/11' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/16' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/14' 2024-04-21T09:01:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/18' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/13' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/198/17' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/198' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/19' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/15' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/20' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/12' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/10' 2024-04-21T09:01:44.738 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/11' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/16' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/14' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/18' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/13' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/136/17' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/136' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/19' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/15' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/20' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/12' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/10' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/11' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/16' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/14' 2024-04-21T09:01:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/18' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/13' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/125/17' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/125' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/19' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/15' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/20' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/12' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/10' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/11' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/16' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/14' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/18' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/13' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/194/17' 2024-04-21T09:01:44.740 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/194' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/19' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/15' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/20' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/12' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/10' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/11' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/16' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/14' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/18' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/13' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/119/17' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/119' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/19' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/15' 2024-04-21T09:01:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/20' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/12' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/10' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/11' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/16' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/14' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/18' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/13' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/157/17' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/157' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/19' 2024-04-21T09:01:44.742 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/15' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/20' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/12' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/10' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/11' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/16' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/14' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/18' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/13' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/172/17' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/172' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/19' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/15' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/20' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/12' 2024-04-21T09:01:44.743 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/10' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/11' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/16' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/14' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/18' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/13' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/186/17' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/186' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/19' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/15' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/20' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/12' 2024-04-21T09:01:44.744 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/10' 2024-04-21T09:01:44.745 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/11' 2024-04-21T09:01:44.745 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/16' 2024-04-21T09:01:44.745 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/14' 2024-04-21T09:01:45.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/18' 2024-04-21T09:01:45.704 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/13' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/190/17' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/190' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/19' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/15' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/20' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/12' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/10' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/11' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/16' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/14' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/18' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/13' 2024-04-21T09:01:45.705 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/104/17' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/104' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/19' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/15' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/20' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/12' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/10' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/11' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/16' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/14' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/18' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/13' 2024-04-21T09:01:45.706 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/164/17' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/164' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/19' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/15' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/20' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/12' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/10' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/11' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/16' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/14' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/18' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/13' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/112/17' 2024-04-21T09:01:45.707 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/112' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/19' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/15' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/20' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/12' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/10' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/11' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/16' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/14' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/18' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/13' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/100/17' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/100' 2024-04-21T09:01:45.708 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/19' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/15' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/20' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/12' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/10' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/11' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/16' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/14' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/18' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/13' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/134/17' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/134' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/19' 2024-04-21T09:01:45.709 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/15' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/20' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/12' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/10' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/11' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/16' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/14' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/18' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/13' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/115/17' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/115' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/19' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/15' 2024-04-21T09:01:45.710 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/20' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/12' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/10' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/11' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/16' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/14' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/18' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/13' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/116/17' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/116' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/19' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/15' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/20' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/12' 2024-04-21T09:01:45.711 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/10' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/11' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/16' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/14' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/18' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/13' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/195/17' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/195' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/19' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/15' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/20' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/12' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/10' 2024-04-21T09:01:45.712 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/11' 2024-04-21T09:01:45.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/16' 2024-04-21T09:01:45.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/14' 2024-04-21T09:01:45.713 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/18' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/13' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/138/17' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/138' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/19' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/15' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/20' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/12' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/10' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/11' 2024-04-21T09:01:46.612 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/16' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/14' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/18' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/13' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/135/17' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/135' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/19' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/15' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/20' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/12' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/10' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/11' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/16' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/14' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/18' 2024-04-21T09:01:46.613 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/13' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/117/17' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/117' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/19' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/15' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/20' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/12' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/10' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/11' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/16' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/14' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/18' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/13' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/143/17' 2024-04-21T09:01:46.614 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/143' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/19' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/15' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/20' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/12' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/10' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/11' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/16' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/14' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/18' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/13' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/180/17' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/180' 2024-04-21T09:01:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/19' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/15' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/20' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/12' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/10' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/11' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/16' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/14' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/18' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/13' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/126/17' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/126' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/19' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/15' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/20' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/12' 2024-04-21T09:01:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/10' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/11' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/16' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/14' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/18' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/13' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/161/17' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/161' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/19' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/15' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/20' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/12' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/10' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/11' 2024-04-21T09:01:46.617 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/16' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/14' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/18' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/13' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/176/17' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/176' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/19' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/15' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/20' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/12' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/10' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/11' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/16' 2024-04-21T09:01:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/14' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/18' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/13' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/111/17' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/111' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/19' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/15' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/20' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/12' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/10' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/11' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/16' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/14' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/18' 2024-04-21T09:01:46.619 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/13' 2024-04-21T09:01:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/191/17' 2024-04-21T09:01:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/191' 2024-04-21T09:01:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/19' 2024-04-21T09:01:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/15' 2024-04-21T09:01:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/20' 2024-04-21T09:01:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/12' 2024-04-21T09:01:47.522 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/10' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/11' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/16' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/14' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/18' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/13' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/184/17' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/184' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/19' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/15' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/20' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/12' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/10' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/11' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/16' 2024-04-21T09:01:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/14' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/18' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/13' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/192/17' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/192' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/19' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/15' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/20' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/12' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/10' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/11' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/16' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/14' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/18' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/13' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/103/17' 2024-04-21T09:01:47.524 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/103' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/19' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/15' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/20' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/12' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/10' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/11' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/16' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/14' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/18' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/13' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/128/17' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/128' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/19' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/15' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/20' 2024-04-21T09:01:47.525 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/12' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/10' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/11' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/16' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/14' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/18' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/13' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/144/17' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/144' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/19' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/15' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/20' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/12' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/10' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/11' 2024-04-21T09:01:47.526 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/16' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/14' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/18' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/13' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/146/17' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/146' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/19' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/15' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/20' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/12' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/10' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/11' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/16' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/14' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/18' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/13' 2024-04-21T09:01:47.527 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/141/17' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/141' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/19' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/15' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/20' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/12' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/10' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/11' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/16' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/14' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/18' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/13' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/182/17' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/182' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/19' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/15' 2024-04-21T09:01:47.528 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/20' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/12' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/10' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/11' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/16' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/14' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/18' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/13' 2024-04-21T09:01:47.529 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/107/17' 2024-04-21T09:01:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/107' 2024-04-21T09:01:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/19' 2024-04-21T09:01:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/15' 2024-04-21T09:01:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/20' 2024-04-21T09:01:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/12' 2024-04-21T09:01:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/10' 2024-04-21T09:01:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/11' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/16' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/14' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/18' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/13' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/178/17' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/178' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/19' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/15' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/20' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/12' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/10' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/11' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/16' 2024-04-21T09:01:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/14' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/18' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/13' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/156/17' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/156' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/19' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/15' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/20' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/12' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/10' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/11' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/16' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/14' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/18' 2024-04-21T09:01:48.476 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/13' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/131/17' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/131' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/19' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/15' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/20' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/12' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/10' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/11' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/16' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/14' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/18' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/13' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/123/17' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/123' 2024-04-21T09:01:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/19' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/15' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/20' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/12' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/10' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/11' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/16' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/14' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/18' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/13' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/160/17' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/160' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/19' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/15' 2024-04-21T09:01:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/20' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/12' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/10' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/11' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/16' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/14' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/18' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/13' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/165/17' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/165' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/19' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/15' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/20' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/12' 2024-04-21T09:01:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/10' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/11' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/16' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/14' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/18' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/13' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/101/17' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/101' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/19' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/15' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/20' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/12' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/10' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/11' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/16' 2024-04-21T09:01:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/14' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/18' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/13' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/148/17' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/148' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/19' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/15' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/20' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/12' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/10' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/11' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/16' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/14' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/18' 2024-04-21T09:01:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/13' 2024-04-21T09:01:48.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/168/17' 2024-04-21T09:01:48.482 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/168' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/19' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/15' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/20' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/12' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/10' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/11' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/16' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/14' 2024-04-21T09:01:49.459 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/18' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/13' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/179/17' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/179' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/19' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/15' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/20' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/12' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/10' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/11' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/16' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/14' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/18' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/13' 2024-04-21T09:01:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/132/17' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/132' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/19' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/15' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/20' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/12' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/10' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/11' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/16' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/14' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/18' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/13' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/199/17' 2024-04-21T09:01:49.461 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/199' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/19' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/15' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/20' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/12' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/10' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/11' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/16' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/14' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/18' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/13' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/163/17' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/163' 2024-04-21T09:01:49.462 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/19' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/15' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/20' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/12' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/10' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/11' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/16' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/14' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/18' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/13' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/153/17' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/153' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/19' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/15' 2024-04-21T09:01:49.463 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/20' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/12' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/10' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/11' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/16' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/14' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/18' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/13' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/122/17' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/122' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/19' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/15' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/20' 2024-04-21T09:01:49.464 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/12' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/10' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/11' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/16' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/14' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/18' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/13' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/162/17' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/162' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/19' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/15' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/20' 2024-04-21T09:01:49.465 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/12' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/10' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/11' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/16' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/14' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/18' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/13' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/197/17' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/197' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/19' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/15' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/20' 2024-04-21T09:01:49.466 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/12' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/10' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/11' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/16' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/14' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/18' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/13' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/113/17' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/113' 2024-04-21T09:01:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/19' 2024-04-21T09:01:50.409 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/15' 2024-04-21T09:01:50.409 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/20' 2024-04-21T09:01:50.409 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/12' 2024-04-21T09:01:50.409 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/10' 2024-04-21T09:01:50.409 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/11' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/16' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/14' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/18' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/13' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/152/17' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/152' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/19' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/15' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/20' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/12' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/10' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/11' 2024-04-21T09:01:50.410 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/16' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/14' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/18' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/13' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/121/17' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/121' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/19' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/15' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/20' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/12' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/10' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/11' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/16' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/14' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/18' 2024-04-21T09:01:50.411 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/13' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/118/17' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/118' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/19' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/15' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/20' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/12' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/10' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/11' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/16' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/14' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/18' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/13' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/196/17' 2024-04-21T09:01:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/196' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/19' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/15' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/20' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/12' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/10' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/11' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/16' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/14' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/18' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/13' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/124/17' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/124' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/19' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/15' 2024-04-21T09:01:50.413 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/20' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/12' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/10' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/11' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/16' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/14' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/18' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/13' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/188/17' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/188' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/19' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/15' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/20' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/12' 2024-04-21T09:01:50.414 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/10' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/11' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/16' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/14' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/18' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/13' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/145/17' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/145' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/19' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/15' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/20' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/12' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/10' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/11' 2024-04-21T09:01:50.415 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/16' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/14' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/18' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/13' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/130/17' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/130' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/19' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/15' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/20' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/12' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/10' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/11' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/16' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/14' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/18' 2024-04-21T09:01:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/13' 2024-04-21T09:01:50.417 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/193/17' 2024-04-21T09:01:50.417 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/193' 2024-04-21T09:01:50.417 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/19' 2024-04-21T09:01:50.417 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/15' 2024-04-21T09:01:51.324 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/20' 2024-04-21T09:01:51.325 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/12' 2024-04-21T09:01:51.325 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/10' 2024-04-21T09:01:51.325 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/11' 2024-04-21T09:01:51.325 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/16' 2024-04-21T09:01:51.325 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/14' 2024-04-21T09:01:51.325 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/18' 2024-04-21T09:01:51.326 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/13' 2024-04-21T09:01:51.326 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/175/17' 2024-04-21T09:01:51.326 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/175' 2024-04-21T09:01:51.326 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/19' 2024-04-21T09:01:51.326 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/15' 2024-04-21T09:01:51.326 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/20' 2024-04-21T09:01:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/12' 2024-04-21T09:01:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/10' 2024-04-21T09:01:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/11' 2024-04-21T09:01:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/16' 2024-04-21T09:01:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/14' 2024-04-21T09:01:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/18' 2024-04-21T09:01:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/13' 2024-04-21T09:01:51.328 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/181/17' 2024-04-21T09:01:51.328 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/181' 2024-04-21T09:01:51.328 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/19' 2024-04-21T09:01:51.328 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/15' 2024-04-21T09:01:51.328 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/20' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/12' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/10' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/11' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/16' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/14' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/18' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/13' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/127/17' 2024-04-21T09:01:51.329 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/127' 2024-04-21T09:01:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/19' 2024-04-21T09:01:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/15' 2024-04-21T09:01:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/20' 2024-04-21T09:01:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/12' 2024-04-21T09:01:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/10' 2024-04-21T09:01:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/11' 2024-04-21T09:01:51.331 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/16' 2024-04-21T09:01:51.331 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/14' 2024-04-21T09:01:51.331 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/18' 2024-04-21T09:01:51.331 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/13' 2024-04-21T09:01:51.331 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/108/17' 2024-04-21T09:01:51.331 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/108' 2024-04-21T09:01:51.332 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/19' 2024-04-21T09:01:51.332 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/15' 2024-04-21T09:01:51.332 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/20' 2024-04-21T09:01:51.332 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/12' 2024-04-21T09:01:51.332 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/10' 2024-04-21T09:01:51.332 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/11' 2024-04-21T09:01:51.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/16' 2024-04-21T09:01:51.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/14' 2024-04-21T09:01:51.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/18' 2024-04-21T09:01:51.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/13' 2024-04-21T09:01:51.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/183/17' 2024-04-21T09:01:51.333 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/183' 2024-04-21T09:01:51.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/19' 2024-04-21T09:01:51.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/15' 2024-04-21T09:01:51.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/20' 2024-04-21T09:01:51.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/12' 2024-04-21T09:01:51.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/10' 2024-04-21T09:01:51.334 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/11' 2024-04-21T09:01:51.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/16' 2024-04-21T09:01:51.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/14' 2024-04-21T09:01:51.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/18' 2024-04-21T09:01:51.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/13' 2024-04-21T09:01:51.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/177/17' 2024-04-21T09:01:51.335 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/177' 2024-04-21T09:01:51.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/19' 2024-04-21T09:01:51.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/15' 2024-04-21T09:01:51.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/20' 2024-04-21T09:01:51.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/12' 2024-04-21T09:01:51.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/10' 2024-04-21T09:01:51.336 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/11' 2024-04-21T09:01:51.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/16' 2024-04-21T09:01:51.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/14' 2024-04-21T09:01:51.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/18' 2024-04-21T09:01:51.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/13' 2024-04-21T09:01:51.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/169/17' 2024-04-21T09:01:51.337 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/169' 2024-04-21T09:01:51.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/19' 2024-04-21T09:01:51.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/15' 2024-04-21T09:01:51.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/20' 2024-04-21T09:01:51.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/12' 2024-04-21T09:01:51.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/10' 2024-04-21T09:01:51.338 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/11' 2024-04-21T09:01:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/16' 2024-04-21T09:01:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/14' 2024-04-21T09:01:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/18' 2024-04-21T09:01:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/13' 2024-04-21T09:01:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/154/17' 2024-04-21T09:01:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/154' 2024-04-21T09:01:51.339 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/19' 2024-04-21T09:01:51.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/15' 2024-04-21T09:01:51.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/20' 2024-04-21T09:01:51.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/12' 2024-04-21T09:01:51.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/10' 2024-04-21T09:01:51.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/11' 2024-04-21T09:01:51.340 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/16' 2024-04-21T09:01:51.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/14' 2024-04-21T09:01:51.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/18' 2024-04-21T09:01:51.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/13' 2024-04-21T09:01:51.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/171/17' 2024-04-21T09:01:51.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/171' 2024-04-21T09:01:51.341 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/19' 2024-04-21T09:01:51.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/15' 2024-04-21T09:01:51.342 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/20' 2024-04-21T09:01:51.656 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/12' 2024-04-21T09:01:51.656 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/10' 2024-04-21T09:01:51.656 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/11' 2024-04-21T09:01:51.656 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/16' 2024-04-21T09:01:51.656 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/14' 2024-04-21T09:01:51.656 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/18' 2024-04-21T09:01:51.656 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/13' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/139/17' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/139' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/19' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/15' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/20' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/12' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/10' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/11' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/16' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/14' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/18' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/13' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/102/17' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/102' 2024-04-21T09:01:51.657 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/19' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/15' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/20' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/12' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/10' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/11' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/16' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/14' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/18' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/13' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed './copyofsnap1/test1/129/17' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1/129' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1/test1' 2024-04-21T09:01:51.658 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory './copyofsnap1' 2024-04-21T09:01:51.659 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:01:51.660 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:01:51.660 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:01:51.699 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2024-04-21T09:01:51.700 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-04-21T09:01:51.763 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:01:51.763 INFO:tasks.workunit.client.0.smithi026.stderr:+ touch foo 2024-04-21T09:01:51.768 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod +x foo 2024-04-21T09:01:51.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:01:51.794 INFO:tasks.workunit.client.0.smithi026.stderr:+ find .snap/s/foo -executable 2024-04-21T09:01:51.794 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep foo 2024-04-21T09:01:51.805 INFO:tasks.workunit.client.0.smithi026.stdout:.snap/s/foo 2024-04-21T09:01:51.805 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:01:51.822 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm foo 2024-04-21T09:01:51.830 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:01:51.831 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:01:51.831 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:01:51.831 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:01:51.904 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2024-04-21T09:01:51.904 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-04-21T09:01:51.963 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:01:51.963 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir foo 2024-04-21T09:01:51.974 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo x 2024-04-21T09:01:51.974 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:52.301 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:52.305 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:01:53.022 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir foo/.snap/ss 2024-04-21T09:01:53.133 INFO:tasks.workunit.client.0.smithi026.stderr:+ ln foo/x foo/xx 2024-04-21T09:01:53.140 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat foo/.snap/ss/x 2024-04-21T09:01:53.152 INFO:tasks.workunit.client.0.smithi026.stdout:x 2024-04-21T09:01:53.153 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir foo/.snap/ss 2024-04-21T09:01:53.167 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo a 2024-04-21T09:01:53.170 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo b 2024-04-21T09:01:53.170 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir foo/.snap/s 2024-04-21T09:01:53.186 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat foo/.snap/s/a 2024-04-21T09:01:53.198 INFO:tasks.workunit.client.0.smithi026.stderr:+ r=a 2024-04-21T09:01:53.198 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ -z a ] 2024-04-21T09:01:53.198 INFO:tasks.workunit.client.0.smithi026.stderr:+ ln foo/b foo/b2 2024-04-21T09:01:53.203 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat foo/.snap/s/b 2024-04-21T09:01:53.213 INFO:tasks.workunit.client.0.smithi026.stdout:b 2024-04-21T09:01:53.214 INFO:tasks.workunit.client.0.smithi026.stdout:this used to hang: 2024-04-21T09:01:53.214 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo this used to hang: 2024-04-21T09:01:53.216 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo more 2024-04-21T09:01:53.219 INFO:tasks.workunit.client.0.smithi026.stdout:oh, it didn't hang! good job. 2024-04-21T09:01:53.219 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo oh, it didn't hang! good job. 2024-04-21T09:01:53.219 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat foo/b 2024-04-21T09:01:53.220 INFO:tasks.workunit.client.0.smithi026.stdout:b 2024-04-21T09:01:53.220 INFO:tasks.workunit.client.0.smithi026.stdout:more 2024-04-21T09:01:53.221 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir foo/.snap/s 2024-04-21T09:01:53.237 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -r foo 2024-04-21T09:01:53.283 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:01:53.284 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:01:53.284 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:01:53.284 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:01:53.314 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2024-04-21T09:01:53.314 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-04-21T09:01:53.375 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:01:53.375 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:53.378 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/bar 2024-04-21T09:01:53.397 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/foo 2024-04-21T09:01:53.409 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/foo 2024-04-21T09:01:53.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:53.430 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/bar/a 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout: File: .snap/bar/a 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout:Device: 2dh/45d Inode: 845524441765765 Links: 2 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout:Access: (0775/drwxrwxr-x) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout:Access: 2024-04-21 09:01:53.378548045 +0000 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout:Modify: 2024-04-21 09:01:53.378548045 +0000 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout:Change: 2024-04-21 09:01:53.378548045 +0000 2024-04-21T09:01:53.441 INFO:tasks.workunit.client.0.smithi026.stdout: Birth: - 2024-04-21T09:01:53.442 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/bar 2024-04-21T09:01:53.455 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:01:53.456 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:01:53.456 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:01:53.456 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:01:53.524 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2024-04-21T09:01:53.524 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-04-21T09:01:53.589 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:01:53.590 INFO:tasks.workunit.client.0.smithi026.stderr:+ seq 1 20 2024-04-21T09:01:53.590 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:53.596 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:53.599 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:53.620 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:53.633 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:53.635 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:53.798 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:53.813 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:53.814 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:53.814 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:53.814 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:53.814 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:53.814 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:53.814 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:53.814 INFO:tasks.workunit.client.0.smithi026.stdout: 35525 ? 00:00:00 ps 2024-04-21T09:01:53.821 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:53.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:53.860 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:53.870 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:53.874 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:53.878 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:53.896 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:53.909 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:53.911 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:53.956 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:53.971 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:53.971 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:53.971 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:53.971 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:53.972 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:53.972 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:53.972 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:53.972 INFO:tasks.workunit.client.0.smithi026.stdout: 35535 ? 00:00:00 ps 2024-04-21T09:01:53.979 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:54.010 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:54.016 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:54.027 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:54.032 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:54.036 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:54.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:54.105 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:54.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:54.181 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:54.196 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:54.196 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:54.196 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:54.196 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:54.196 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:54.197 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:54.197 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:54.197 INFO:tasks.workunit.client.0.smithi026.stdout: 35545 ? 00:00:00 ps 2024-04-21T09:01:54.203 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:54.235 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:54.242 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:54.254 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:54.258 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:54.262 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:54.278 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:54.291 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:54.293 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:54.348 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:54.365 INFO:tasks.workunit.client.0.smithi026.stdout: 35555 ? 00:00:00 ps 2024-04-21T09:01:54.373 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:54.404 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:54.413 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:54.427 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:54.432 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:54.436 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:54.457 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:54.470 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:54.472 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:54.514 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:54.528 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:54.528 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:54.528 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:54.529 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:54.529 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:54.529 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:54.529 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:54.529 INFO:tasks.workunit.client.0.smithi026.stdout: 35565 ? 00:00:00 ps 2024-04-21T09:01:54.535 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:54.565 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:54.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:54.584 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:54.589 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:54.593 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:54.612 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:54.627 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:54.629 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:54.690 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:54.705 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:54.705 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:54.706 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:54.706 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:54.706 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:54.706 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:54.706 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:54.706 INFO:tasks.workunit.client.0.smithi026.stdout: 35575 ? 00:00:00 ps 2024-04-21T09:01:54.712 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:54.740 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:54.745 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:54.756 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:54.761 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:54.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:54.781 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:54.795 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:54.798 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:54.848 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:54.863 INFO:tasks.workunit.client.0.smithi026.stdout: 35585 ? 00:00:00 ps 2024-04-21T09:01:54.870 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:54.898 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:54.903 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:54.914 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:54.918 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:54.921 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:54.939 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:54.952 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:54.953 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:54.998 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:55.014 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:55.014 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:55.014 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:55.015 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:55.015 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:55.015 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:55.015 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:55.015 INFO:tasks.workunit.client.0.smithi026.stdout: 35595 ? 00:00:00 ps 2024-04-21T09:01:55.023 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:55.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:55.060 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:55.071 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:55.075 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:55.079 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:55.098 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:55.110 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:55.112 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:55.166 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:55.182 INFO:tasks.workunit.client.0.smithi026.stdout: 35605 ? 00:00:00 ps 2024-04-21T09:01:55.188 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:55.215 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:55.222 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:55.233 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:55.237 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:55.241 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:55.260 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:55.273 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:55.275 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:55.325 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:55.341 INFO:tasks.workunit.client.0.smithi026.stdout: 35615 ? 00:00:00 ps 2024-04-21T09:01:55.350 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:55.374 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:55.380 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:55.390 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:55.394 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:55.398 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:55.417 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:55.430 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:55.432 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:55.483 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:55.498 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:55.498 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:55.498 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:55.499 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:55.499 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:55.499 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:55.499 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:55.499 INFO:tasks.workunit.client.0.smithi026.stdout: 35625 ? 00:00:00 ps 2024-04-21T09:01:55.506 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:55.533 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:55.539 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:55.552 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:55.557 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:55.563 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:55.637 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:55.715 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:55.719 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:56.041 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:56.057 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:56.057 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:56.058 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:56.058 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:56.058 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:56.058 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:56.058 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:56.058 INFO:tasks.workunit.client.0.smithi026.stdout: 35635 ? 00:00:00 ps 2024-04-21T09:01:56.066 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:56.100 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:56.106 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:56.117 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:56.121 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:56.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:56.142 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:56.153 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:56.155 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:56.225 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:56.239 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:56.239 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:56.240 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:56.240 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:56.240 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:56.240 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:56.240 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:56.240 INFO:tasks.workunit.client.0.smithi026.stdout: 35645 ? 00:00:00 ps 2024-04-21T09:01:56.247 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:56.283 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:56.290 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:56.303 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:56.309 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:56.313 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:56.334 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:56.349 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:56.351 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:56.402 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:56.416 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:56.416 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:56.417 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:56.417 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:56.417 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:56.417 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:56.417 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:56.417 INFO:tasks.workunit.client.0.smithi026.stdout: 35655 ? 00:00:00 ps 2024-04-21T09:01:56.424 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:56.451 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:56.457 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:56.468 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:56.472 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:56.476 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:56.494 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:56.506 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:56.508 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:56.558 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:56.575 INFO:tasks.workunit.client.0.smithi026.stdout: 35665 ? 00:00:00 ps 2024-04-21T09:01:56.602 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:56.639 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:56.644 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:56.653 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:56.656 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:56.660 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:56.677 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:56.689 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:56.691 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:56.775 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:56.790 INFO:tasks.workunit.client.0.smithi026.stdout: 35675 ? 00:00:00 ps 2024-04-21T09:01:56.798 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:56.831 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:56.838 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:56.879 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:56.884 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:56.887 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:56.903 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:56.913 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:56.915 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:56.992 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:57.008 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:57.008 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:57.009 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:57.009 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:57.009 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:57.009 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:57.009 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:57.009 INFO:tasks.workunit.client.0.smithi026.stdout: 35685 ? 00:00:00 ps 2024-04-21T09:01:57.016 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:57.048 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:57.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:57.065 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:57.070 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:57.075 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:57.094 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:57.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:57.108 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:57.178 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:57.191 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:57.192 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:57.192 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:57.192 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:57.192 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:57.192 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:57.192 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:57.192 INFO:tasks.workunit.client.0.smithi026.stdout: 35695 ? 00:00:00 ps 2024-04-21T09:01:57.199 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:57.230 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:57.236 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:57.247 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:57.252 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:57.256 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:57.274 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:57.286 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:57.288 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:57.343 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:57.358 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:57.358 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:57.359 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:57.359 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:57.359 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:57.359 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:57.359 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:57.359 INFO:tasks.workunit.client.0.smithi026.stdout: 35705 ? 00:00:00 ps 2024-04-21T09:01:57.366 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:57.399 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:57.405 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:57.416 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:01:57.421 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/one 2024-04-21T09:01:57.425 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat 2024-04-21T09:01:57.442 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/two 2024-04-21T09:01:57.455 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a/foo 2024-04-21T09:01:57.456 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:01:57.501 INFO:tasks.workunit.client.0.smithi026.stderr:+ ps 2024-04-21T09:01:57.513 INFO:tasks.workunit.client.0.smithi026.stdout: PID TTY TIME CMD 2024-04-21T09:01:57.513 INFO:tasks.workunit.client.0.smithi026.stdout: 1314 ? 00:00:00 systemd 2024-04-21T09:01:57.513 INFO:tasks.workunit.client.0.smithi026.stdout: 1315 ? 00:00:00 (sd-pam) 2024-04-21T09:01:57.513 INFO:tasks.workunit.client.0.smithi026.stdout: 17100 ? 00:00:00 sshd 2024-04-21T09:01:57.513 INFO:tasks.workunit.client.0.smithi026.stdout: 32795 ? 00:00:00 bash 2024-04-21T09:01:57.513 INFO:tasks.workunit.client.0.smithi026.stdout: 35514 ? 00:00:00 timeout 2024-04-21T09:01:57.514 INFO:tasks.workunit.client.0.smithi026.stdout: 35517 ? 00:00:00 snaptest-double 2024-04-21T09:01:57.514 INFO:tasks.workunit.client.0.smithi026.stdout: 35715 ? 00:00:00 ps 2024-04-21T09:01:57.520 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-21T09:01:57.548 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a/foo 2024-04-21T09:01:57.553 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a 2024-04-21T09:01:57.564 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:01:57.565 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:01:57.565 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:01:57.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:01:57.660 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2024-04-21T09:01:57.660 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-04-21T09:01:57.673 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/foo 2024-04-21T09:01:57.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo We want ENOENT, not ESTALE, here. 2024-04-21T09:01:57.686 INFO:tasks.workunit.client.0.smithi026.stdout:We want ENOENT, not ESTALE, here. 2024-04-21T09:01:57.687 INFO:tasks.workunit.client.0.smithi026.stderr:+ seq 1 100 2024-04-21T09:01:57.687 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/1 2024-04-21T09:01:57.687 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.691 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2024-04-21T09:01:57.692 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/2 2024-04-21T09:01:57.692 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.695 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2024-04-21T09:01:57.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/3 2024-04-21T09:01:57.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.700 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2024-04-21T09:01:57.700 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/4 2024-04-21T09:01:57.700 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.704 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2024-04-21T09:01:57.705 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/5 2024-04-21T09:01:57.705 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.709 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2024-04-21T09:01:57.709 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/6 2024-04-21T09:01:57.709 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.713 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2024-04-21T09:01:57.714 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/7 2024-04-21T09:01:57.714 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.717 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2024-04-21T09:01:57.718 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/8 2024-04-21T09:01:57.718 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.723 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2024-04-21T09:01:57.724 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/9 2024-04-21T09:01:57.724 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.731 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2024-04-21T09:01:57.731 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/10 2024-04-21T09:01:57.732 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.738 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2024-04-21T09:01:57.739 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/11 2024-04-21T09:01:57.739 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.744 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2024-04-21T09:01:57.745 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/12 2024-04-21T09:01:57.745 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.752 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2024-04-21T09:01:57.752 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/13 2024-04-21T09:01:57.753 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.758 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2024-04-21T09:01:57.758 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/14 2024-04-21T09:01:57.759 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.764 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2024-04-21T09:01:57.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/15 2024-04-21T09:01:57.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.769 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2024-04-21T09:01:57.770 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/16 2024-04-21T09:01:57.770 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.774 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2024-04-21T09:01:57.775 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/17 2024-04-21T09:01:57.775 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.778 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2024-04-21T09:01:57.779 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/18 2024-04-21T09:01:57.779 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.782 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2024-04-21T09:01:57.783 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/19 2024-04-21T09:01:57.783 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.786 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2024-04-21T09:01:57.787 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/20 2024-04-21T09:01:57.787 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.790 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2024-04-21T09:01:57.790 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/21 2024-04-21T09:01:57.790 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.793 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2024-04-21T09:01:57.794 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/22 2024-04-21T09:01:57.794 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.798 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2024-04-21T09:01:57.799 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/23 2024-04-21T09:01:57.799 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.802 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2024-04-21T09:01:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/24 2024-04-21T09:01:57.802 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.805 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2024-04-21T09:01:57.806 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/25 2024-04-21T09:01:57.806 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.809 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2024-04-21T09:01:57.809 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/26 2024-04-21T09:01:57.809 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.813 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2024-04-21T09:01:57.813 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/27 2024-04-21T09:01:57.813 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.817 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2024-04-21T09:01:57.817 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/28 2024-04-21T09:01:57.817 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.820 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2024-04-21T09:01:57.821 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/29 2024-04-21T09:01:57.821 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.824 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2024-04-21T09:01:57.825 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/30 2024-04-21T09:01:57.825 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.828 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2024-04-21T09:01:57.829 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/31 2024-04-21T09:01:57.829 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.832 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2024-04-21T09:01:57.833 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/32 2024-04-21T09:01:57.833 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.836 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2024-04-21T09:01:57.837 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/33 2024-04-21T09:01:57.837 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.840 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2024-04-21T09:01:57.841 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/34 2024-04-21T09:01:57.841 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.845 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2024-04-21T09:01:57.846 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/35 2024-04-21T09:01:57.846 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.848 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2024-04-21T09:01:57.849 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/36 2024-04-21T09:01:57.849 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.853 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2024-04-21T09:01:57.853 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/37 2024-04-21T09:01:57.853 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.857 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2024-04-21T09:01:57.858 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/38 2024-04-21T09:01:57.858 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.862 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2024-04-21T09:01:57.862 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/39 2024-04-21T09:01:57.862 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.866 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2024-04-21T09:01:57.866 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/40 2024-04-21T09:01:57.866 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.870 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2024-04-21T09:01:57.870 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/41 2024-04-21T09:01:57.870 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.874 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2024-04-21T09:01:57.874 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/42 2024-04-21T09:01:57.874 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.878 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2024-04-21T09:01:57.878 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/43 2024-04-21T09:01:57.878 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.881 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2024-04-21T09:01:57.882 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/44 2024-04-21T09:01:57.882 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.885 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2024-04-21T09:01:57.886 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/45 2024-04-21T09:01:57.886 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.889 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2024-04-21T09:01:57.890 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/46 2024-04-21T09:01:57.890 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.893 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2024-04-21T09:01:57.894 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/47 2024-04-21T09:01:57.894 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.897 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2024-04-21T09:01:57.898 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/48 2024-04-21T09:01:57.898 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.901 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2024-04-21T09:01:57.901 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/49 2024-04-21T09:01:57.902 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.905 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2024-04-21T09:01:57.905 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/50 2024-04-21T09:01:57.905 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.909 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2024-04-21T09:01:57.909 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/51 2024-04-21T09:01:57.909 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.913 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2024-04-21T09:01:57.914 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/52 2024-04-21T09:01:57.914 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.917 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2024-04-21T09:01:57.917 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/53 2024-04-21T09:01:57.917 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.921 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2024-04-21T09:01:57.921 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/54 2024-04-21T09:01:57.921 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.925 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2024-04-21T09:01:57.925 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/55 2024-04-21T09:01:57.925 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.929 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2024-04-21T09:01:57.929 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/56 2024-04-21T09:01:57.929 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.934 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2024-04-21T09:01:57.935 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/57 2024-04-21T09:01:57.935 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.940 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2024-04-21T09:01:57.940 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/58 2024-04-21T09:01:57.941 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.945 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2024-04-21T09:01:57.946 INFO:tasks.workunit.client.0.smithi026.stderr:+ + stat .snap/foo/59 2024-04-21T09:01:57.947 INFO:tasks.workunit.client.0.smithi026.stderr:grep No such file 2024-04-21T09:01:57.953 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2024-04-21T09:01:57.954 INFO:tasks.workunit.client.0.smithi026.stderr:+ + grep No such file 2024-04-21T09:01:57.954 INFO:tasks.workunit.client.0.smithi026.stderr:stat .snap/foo/60 2024-04-21T09:01:57.959 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2024-04-21T09:01:57.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/61 2024-04-21T09:01:57.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.965 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2024-04-21T09:01:57.965 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/62 2024-04-21T09:01:57.965 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.970 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2024-04-21T09:01:57.970 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/63 2024-04-21T09:01:57.970 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.975 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2024-04-21T09:01:57.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/64 2024-04-21T09:01:57.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.980 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2024-04-21T09:01:57.980 INFO:tasks.workunit.client.0.smithi026.stderr:+ + grep No such file 2024-04-21T09:01:57.980 INFO:tasks.workunit.client.0.smithi026.stderr:stat .snap/foo/65 2024-04-21T09:01:57.986 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2024-04-21T09:01:57.987 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/66 2024-04-21T09:01:57.987 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.992 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2024-04-21T09:01:57.992 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/67 2024-04-21T09:01:57.992 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:57.999 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2024-04-21T09:01:58.000 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/68 2024-04-21T09:01:58.000 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.006 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2024-04-21T09:01:58.006 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/69 2024-04-21T09:01:58.006 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.013 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2024-04-21T09:01:58.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/70 2024-04-21T09:01:58.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.019 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2024-04-21T09:01:58.019 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/71 2024-04-21T09:01:58.019 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.022 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2024-04-21T09:01:58.023 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/72 2024-04-21T09:01:58.023 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.025 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2024-04-21T09:01:58.026 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/73 2024-04-21T09:01:58.026 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.029 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2024-04-21T09:01:58.029 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/74 2024-04-21T09:01:58.029 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.032 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2024-04-21T09:01:58.033 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/75 2024-04-21T09:01:58.033 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.036 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2024-04-21T09:01:58.037 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/76 2024-04-21T09:01:58.037 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.040 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2024-04-21T09:01:58.041 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/77 2024-04-21T09:01:58.041 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.045 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2024-04-21T09:01:58.045 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/78 2024-04-21T09:01:58.045 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.050 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2024-04-21T09:01:58.050 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/79 2024-04-21T09:01:58.051 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.053 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2024-04-21T09:01:58.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/80 2024-04-21T09:01:58.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.056 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2024-04-21T09:01:58.057 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/81 2024-04-21T09:01:58.057 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.060 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2024-04-21T09:01:58.061 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/82 2024-04-21T09:01:58.061 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.064 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2024-04-21T09:01:58.065 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/83 2024-04-21T09:01:58.065 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.069 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2024-04-21T09:01:58.070 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/84 2024-04-21T09:01:58.070 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.074 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2024-04-21T09:01:58.075 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/85 2024-04-21T09:01:58.075 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.079 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2024-04-21T09:01:58.080 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/86 2024-04-21T09:01:58.080 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.083 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2024-04-21T09:01:58.084 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/87 2024-04-21T09:01:58.084 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.088 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2024-04-21T09:01:58.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/88 2024-04-21T09:01:58.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.092 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2024-04-21T09:01:58.093 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/89 2024-04-21T09:01:58.093 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.097 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2024-04-21T09:01:58.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/90 2024-04-21T09:01:58.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.101 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2024-04-21T09:01:58.101 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/91 2024-04-21T09:01:58.102 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.105 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2024-04-21T09:01:58.106 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/92 2024-04-21T09:01:58.106 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.109 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2024-04-21T09:01:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/93 2024-04-21T09:01:58.110 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.114 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2024-04-21T09:01:58.115 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/94 2024-04-21T09:01:58.115 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.118 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2024-04-21T09:01:58.119 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/95 2024-04-21T09:01:58.119 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.122 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2024-04-21T09:01:58.123 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/96 2024-04-21T09:01:58.123 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.126 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2024-04-21T09:01:58.127 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/97 2024-04-21T09:01:58.127 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.131 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2024-04-21T09:01:58.132 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/98 2024-04-21T09:01:58.132 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.135 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2024-04-21T09:01:58.136 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/99 2024-04-21T09:01:58.136 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.140 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2024-04-21T09:01:58.140 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/foo/100 2024-04-21T09:01:58.140 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep No such file 2024-04-21T09:01:58.144 INFO:tasks.workunit.client.0.smithi026.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2024-04-21T09:01:58.145 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/foo 2024-04-21T09:01:58.157 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:01:58.158 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:01:58.158 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:01:58.158 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:01:58.221 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2024-04-21T09:01:58.222 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-04-21T09:01:58.281 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:01:58.281 INFO:tasks.workunit.client.0.smithi026.stderr:+ sudo git config --global http.sslVerify false 2024-04-21T09:01:58.299 INFO:tasks.workunit.client.0.smithi026.stderr:+ sudo git config --global http.postBuffer 1048576000 2024-04-21T09:01:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:+ retried=false 2024-04-21T09:01:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:+ trap -- retry EXIT 2024-04-21T09:01:58.317 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -rf ceph 2024-04-21T09:01:58.318 INFO:tasks.workunit.client.0.smithi026.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2024-04-21T09:01:58.325 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into 'ceph'... 2024-04-21T09:02:22.743 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:02:22.746 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:02:52.796 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:02:52.800 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:03:22.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:03:22.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:03:53.024 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:03:53.027 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:04:23.163 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:04:23.166 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:04:53.202 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:04:53.205 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:05:23.366 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:05:23.371 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:05:53.422 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:05:53.425 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:06:23.536 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:06:23.540 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:06:53.608 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:06:53.611 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:07:23.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:07:23.679 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:07:53.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:07:53.772 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:08:23.925 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:08:23.928 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:08:38.976 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-04-21T09:08:38.977 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:08:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.118+0000 7f9e98d9e640 1 Processor -- start 2024-04-21T09:08:39.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.118+0000 7f9e98d9e640 1 -- start start 2024-04-21T09:08:39.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e98d9e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 0x7f9e9415c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e98d9e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e940c94f0 con 0x7f9e940c8590 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e98d9e640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e940c9790 con 0x7f9e9415c6f0 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e98d9e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940740c0 con 0x7f9e94153010 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e92d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e940c8590 0x7f9e941634e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42032/0 (socket says 172.21.15.26:42032) 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e92d9d640 1 -- 172.21.15.26:0/4284398700 learned_addr learned my addr 172.21.15.26:0/4284398700 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9259c640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 0x7f9e9415c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612879663 0 0) 0x7f9e940c94f0 con 0x7f9e940c8590 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e7c003530 con 0x7f9e940c8590 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1111975713 0 0) 0x7f9e7c003530 con 0x7f9e940c8590 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 msgr2=0x7f9e9415c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 0x7f9e9415c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 >> v1:172.21.15.169:6789/0 conn(0x7f9e9415c6f0 legacy=0x7f9e940c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e940c7930 con 0x7f9e940c8590 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f9e8c001680 con 0x7f9e940c8590 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 >> v1:172.21.15.26:6789/0 conn(0x7f9e940c8590 legacy=0x7f9e941634e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 0x7f9e7c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e7c004d50 0x7f9e7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c00bb60 con 0x7f9e7c003f70 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e7c00bce0 con 0x7f9e7c004d50 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e7c00bee0 con 0x7f9e94153010 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e91d9b640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e9259c640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 0x7f9e7c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e92d9d640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e7c004d50 0x7f9e7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e91d9b640 1 -- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 msgr2=0x7f9e7c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e91d9b640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e94153010 0x7f9e7c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e91d9b640 1 -- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e7c004d50 msgr2=0x7f9e7c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e91d9b640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e7c004d50 0x7f9e7c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e91d9b640 1 -- 172.21.15.26:0/4284398700 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e7c003530 con 0x7f9e7c003f70 2024-04-21T09:08:39.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.122+0000 7f9e92d9d640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e7c004d50 0x7f9e7c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:39.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e91d9b640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e7c004810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e88001780 tx=0x7f9e8801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f6513646c41b6c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e880013a0 con 0x7f9e7c003f70 2024-04-21T09:08:39.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e880052f0 con 0x7f9e7c003f70 2024-04-21T09:08:39.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9159a640 1 -- 172.21.15.26:0/4284398700 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e88003840 con 0x7f9e7c003f70 2024-04-21T09:08:39.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- 172.21.15.26:0/4284398700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 msgr2=0x7f9e7c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 --2- 172.21.15.26:0/4284398700 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e7c004810 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9e88001780 tx=0x7f9e8801c420 comp rx=0 tx=0).stop 2024-04-21T09:08:39.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e92d9d640 1 -- 172.21.15.26:0/4284398700 reap_dead start 2024-04-21T09:08:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- 172.21.15.26:0/4284398700 shutdown_connections 2024-04-21T09:08:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- 172.21.15.26:0/4284398700 >> 172.21.15.26:0/4284398700 conn(0x7f9e940c9b50 msgr2=0x7f9e940c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- 172.21.15.26:0/4284398700 shutdown_connections 2024-04-21T09:08:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- 172.21.15.26:0/4284398700 wait complete. 2024-04-21T09:08:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 Processor -- start 2024-04-21T09:08:39.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- start start 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e94148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e940caf20 0x7f9e941f77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e9415b340 0x7f9e941f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940c7bf0 con 0x7f9e7c003f70 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e941533f0 con 0x7f9e9415b340 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e98d9e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940c6e30 con 0x7f9e940caf20 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e94148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e94148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34802/0 (socket says 172.21.15.26:34802) 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 -- 172.21.15.26:0/2272505081 learned_addr learned my addr 172.21.15.26:0/2272505081 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e91d9b640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e940caf20 0x7f9e941f77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e92d9d640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e9415b340 0x7f9e941f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 -- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e940caf20 msgr2=0x7f9e941f77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e940caf20 0x7f9e941f77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 -- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e9415b340 msgr2=0x7f9e941f7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e9415b340 0x7f9e941f7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 -- 172.21.15.26:0/2272505081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e94148bb0 con 0x7f9e7c003f70 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e92d9d640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e9415b340 0x7f9e941f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.126+0000 7f9e9259c640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e94148670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e84007f30 tx=0x7f9e84011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2272505081 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8401a020 con 0x7f9e7c003f70 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2272505081 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e84016470 con 0x7f9e7c003f70 2024-04-21T09:08:39.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e941f8250 con 0x7f9e7c003f70 2024-04-21T09:08:39.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2272505081 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84016860 con 0x7f9e7c003f70 2024-04-21T09:08:39.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9415ba40 con 0x7f9e7c003f70 2024-04-21T09:08:39.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e94075ef0 con 0x7f9e7c003f70 2024-04-21T09:08:39.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2272505081 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e8401d020 con 0x7f9e7c003f70 2024-04-21T09:08:39.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e82ffd640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e74068380 0x7f9e7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2272505081 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9e840879a0 con 0x7f9e7c003f70 2024-04-21T09:08:39.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e91d9b640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e74068380 0x7f9e7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.130+0000 7f9e91d9b640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e74068380 0x7f9e7406a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e880ac000 tx=0x7f9e880011a0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.134+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2272505081 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e84024030 con 0x7f9e7c003f70 2024-04-21T09:08:39.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.362+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e940735b0 con 0x7f9e7c003f70 2024-04-21T09:08:39.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.362+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2272505081 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f9e84057e90 con 0x7f9e7c003f70 2024-04-21T09:08:39.365 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:08:39.365 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:08:39.365 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:08:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e74068380 msgr2=0x7f9e7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e74068380 0x7f9e7406a840 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9e880ac000 tx=0x7f9e880011a0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 msgr2=0x7f9e94148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e94148670 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9e84007f30 tx=0x7f9e84011660 comp rx=0 tx=0).stop 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 shutdown_connections 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e9415b340 0x7f9e941f7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e940caf20 0x7f9e941f77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e74068380 0x7f9e7406a840 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 --2- 172.21.15.26:0/2272505081 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e7c003f70 0x7f9e94148670 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 >> 172.21.15.26:0/2272505081 conn(0x7f9e940c9b50 msgr2=0x7f9e9406e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 shutdown_connections 2024-04-21T09:08:39.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.366+0000 7f9e98d9e640 1 -- 172.21.15.26:0/2272505081 wait complete. 2024-04-21T09:08:39.384 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 70 --await' 2024-04-21T09:08:39.384 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 70 --await 2024-04-21T09:08:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ec6d640 1 Processor -- start 2024-04-21T09:08:39.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ec6d640 1 -- start start 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ec6d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f12680b2280 0x7f126806f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ec6d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f126806dc80 0x7f12680c79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ec6d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f126815ab40 con 0x7f126806e090 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ec6d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1268073e10 con 0x7f126806dc80 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ec6d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f12680732a0 con 0x7f12680b2280 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f1267fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f126806dc80 0x7f12680c79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f1267fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f126806dc80 0x7f12680c79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34808/0 (socket says 172.21.15.26:34808) 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126d20a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f126806e090 0x7f126806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42034/0 (socket says 172.21.15.26:42034) 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f1267fff640 1 -- 172.21.15.26:0/3238512866 learned_addr learned my addr 172.21.15.26:0/3238512866 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f126ca09640 1 --2- 172.21.15.26:0/3238512866 >> v2:172.21.15.169:3300/0 conn(0x7f12680b2280 0x7f126806f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f1267fff640 1 -- 172.21.15.26:0/3238512866 >> v2:172.21.15.169:3300/0 conn(0x7f12680b2280 msgr2=0x7f126806f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f1267fff640 1 --2- 172.21.15.26:0/3238512866 >> v2:172.21.15.169:3300/0 conn(0x7f12680b2280 0x7f126806f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f1267fff640 1 -- 172.21.15.26:0/3238512866 >> v1:172.21.15.26:6789/0 conn(0x7f126806e090 legacy=0x7f126806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f12677fe640 1 -- 172.21.15.26:0/3238512866 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209034975 0 0) 0x7f126815ab40 con 0x7f126806e090 2024-04-21T09:08:39.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.518+0000 7f1267fff640 1 -- 172.21.15.26:0/3238512866 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1268073580 con 0x7f126806dc80 2024-04-21T09:08:39.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f1267fff640 1 --2- 172.21.15.26:0/3238512866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806dc80 0x7f12680c79a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12680727a0 tx=0x7f125401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fde11f0196005d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f12677fe640 1 -- 172.21.15.26:0/3238512866 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540b5070 con 0x7f126806dc80 2024-04-21T09:08:39.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f12677fe640 1 -- 172.21.15.26:0/3238512866 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12540a8a10 con 0x7f126806dc80 2024-04-21T09:08:39.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f12677fe640 1 -- 172.21.15.26:0/3238512866 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540a8de0 con 0x7f126806dc80 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 -- 172.21.15.26:0/3238512866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806dc80 msgr2=0x7f12680c79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 --2- 172.21.15.26:0/3238512866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806dc80 0x7f12680c79a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f12680727a0 tx=0x7f125401ed10 comp rx=0 tx=0).stop 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 -- 172.21.15.26:0/3238512866 shutdown_connections 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 --2- 172.21.15.26:0/3238512866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806dc80 0x7f12680c79a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 --2- 172.21.15.26:0/3238512866 >> v2:172.21.15.169:3300/0 conn(0x7f12680b2280 0x7f126806f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 -- 172.21.15.26:0/3238512866 >> 172.21.15.26:0/3238512866 conn(0x7f1268070190 msgr2=0x7f12680705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 -- 172.21.15.26:0/3238512866 shutdown_connections 2024-04-21T09:08:39.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 -- 172.21.15.26:0/3238512866 wait complete. 2024-04-21T09:08:39.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 Processor -- start 2024-04-21T09:08:39.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.522+0000 7f126ec6d640 1 -- start start 2024-04-21T09:08:39.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126806dc80 0x7f1268151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806e090 0x7f12681525c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680b2280 0x7f1268155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f126815b3c0 con 0x7f126806e090 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f126815b0e0 con 0x7f126806dc80 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1268072f60 con 0x7f12680b2280 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806e090 0x7f12681525c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806e090 0x7f12681525c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34824/0 (socket says 172.21.15.26:34824) 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 -- 172.21.15.26:0/28042994 learned_addr learned my addr 172.21.15.26:0/28042994 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ca09640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126806dc80 0x7f1268151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126d20a640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680b2280 0x7f1268155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 -- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680b2280 msgr2=0x7f1268155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680b2280 0x7f1268155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 -- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126806dc80 msgr2=0x7f1268151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126806dc80 0x7f1268151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 -- 172.21.15.26:0/28042994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12681564e0 con 0x7f126806e090 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f1267fff640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806e090 0x7f12681525c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12540b3040 tx=0x7f125401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f12657fa640 1 -- 172.21.15.26:0/28042994 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540b5070 con 0x7f126806e090 2024-04-21T09:08:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f12657fa640 1 -- 172.21.15.26:0/28042994 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12540b0c50 con 0x7f126806e090 2024-04-21T09:08:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f12657fa640 1 -- 172.21.15.26:0/28042994 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540bb410 con 0x7f126806e090 2024-04-21T09:08:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1268156750 con 0x7f126806e090 2024-04-21T09:08:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12681f48a0 con 0x7f126806e090 2024-04-21T09:08:39.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f12657fa640 1 -- 172.21.15.26:0/28042994 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f12540c2060 con 0x7f126806e090 2024-04-21T09:08:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f12657fa640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f124c068380 0x7f124c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f12657fa640 1 -- 172.21.15.26:0/28042994 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f1254123d60 con 0x7f126806e090 2024-04-21T09:08:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.526+0000 7f126ca09640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f124c068380 0x7f124c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 Processor -- start 2024-04-21T09:08:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- start start 2024-04-21T09:08:39.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f124c068380 0x7f124c06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f125c00a8d0 tx=0x7f125c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df3768fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df37a4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37a4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561df364a650 con 0x561df379f5a0 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561df35b2bf0 con 0x561df3769500 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561df35580c0 con 0x561df37a4990 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df3768fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df3768fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34840/0 (socket says 172.21.15.26:34840) 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 -- 172.21.15.26:0/3932546467 learned_addr learned my addr 172.21.15.26:0/3932546467 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126d20a640 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37a4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1267fff640 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df37a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 -- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 msgr2=0x561df37a4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37a4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 -- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 msgr2=0x561df37a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df37a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 -- 172.21.15.26:0/3932546467 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df3574fe0 con 0x561df379f5a0 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1267fff640 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df37a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126d20a640 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f126ca09640 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df3768fc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f125c00eb70 tx=0x7f125c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cfb5d48e170665 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f12527fc640 1 -- 172.21.15.26:0/3932546467 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c01a050 con 0x561df379f5a0 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f12527fc640 1 -- 172.21.15.26:0/3932546467 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c024070 con 0x561df379f5a0 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f12527fc640 1 -- 172.21.15.26:0/3932546467 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c01f440 con 0x561df379f5a0 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- 172.21.15.26:0/3932546467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 msgr2=0x561df3768fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df3768fc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f125c00eb70 tx=0x7f125c011000 comp rx=0 tx=0).stop 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- 172.21.15.26:0/3932546467 shutdown_connections 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37a4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df37a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 --2- 172.21.15.26:0/3932546467 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df3768fc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- 172.21.15.26:0/3932546467 >> 172.21.15.26:0/3932546467 conn(0x561df37a0200 msgr2=0x561df37a25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- 172.21.15.26:0/3932546467 shutdown_connections 2024-04-21T09:08:39.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- 172.21.15.26:0/3932546467 wait complete. 2024-04-21T09:08:39.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 -- start start 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.530+0000 7f1271def000 1 Processor -- start 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df3769500 0x561df3760c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df3761190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37616d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561df356e540 con 0x561df3769500 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561df35b1f00 con 0x561df379f5a0 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561df35b7220 con 0x561df37a4990 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 10 client.0 _ll_register_callbacks cb 0x561df374e9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df3769500 0x561df3760c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df3769500 0x561df3760c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34852/0 (socket says 172.21.15.26:34852) 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 -- 172.21.15.26:0/3638482612 learned_addr learned my addr 172.21.15.26:0/3638482612 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1267fff640 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df3761190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126d20a640 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37616d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 -- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 msgr2=0x561df37616d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37616d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 -- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 msgr2=0x561df3761190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df3761190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 -- 172.21.15.26:0/3638482612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df35bf570 con 0x561df3769500 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f126ca09640 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df3769500 0x561df3760c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f125c00a130 tx=0x7f125c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbaf218cfece3b2d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f12477fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f12477fe640 1 -- 172.21.15.26:0/3638482612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c004020 con 0x561df3769500 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f12477fe640 1 -- 172.21.15.26:0/3638482612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f125c0041c0 con 0x561df3769500 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125c024070 con 0x561df3769500 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f12477fe640 1 -- 172.21.15.26:0/3638482612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f125c01a020 con 0x561df3769500 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 10 client.4923 fetch_fsmap learned FSMap version 8 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x561df3558310 con 0x561df3769500 2024-04-21T09:08:39.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f12477fe640 1 -- 172.21.15.26:0/3638482612 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c024070 con 0x561df3769500 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f12477fe640 1 -- 172.21.15.26:0/3638482612 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f125c01f930 con 0x561df3769500 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 10 client.4923 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 10 client.4923 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 20 client.4923 populate_metadata read hostname 'smithi026' 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df37b8150 0x561df37ba540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 4 client.4923 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561df354c880 con 0x561df37b8150 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1267fff640 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df37b8150 0x561df37ba540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f12477fe640 10 client.4923 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:39.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.534+0000 7f1267fff640 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df37b8150 0x561df37ba540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a46aab269c6ce278 server_cookie=825ec997b0911d90 in_seq=0 out_seq=0 2024-04-21T09:08:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f12477fe640 1 -- 172.21.15.26:0/3638482612 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561df354c880 con 0x561df37b8150 2024-04-21T09:08:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f12477fe640 10 client.4923 handle_command_reply: tid=0 2024-04-21T09:08:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 client.4923 shutdown 2024-04-21T09:08:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df3769500 msgr2=0x561df3760c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df3769500 0x561df3760c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f125c00a130 tx=0x7f125c004740 comp rx=0 tx=0).stop 2024-04-21T09:08:39.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 shutdown_connections 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df37b8150 0x561df37ba540 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37616d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df3761190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f12477fe640 0 client.4923 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 --2- 172.21.15.26:0/3638482612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df3769500 0x561df3760c50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 >> 172.21.15.26:0/3638482612 conn(0x561df37a0200 msgr2=0x561df379ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 shutdown_connections 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 1 -- 172.21.15.26:0/3638482612 wait complete. 2024-04-21T09:08:39.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.538+0000 7f1271def000 20 client.4923 trim_cache size 0 max 16384 2024-04-21T09:08:39.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.554+0000 7f1271def000 1 Processor -- start 2024-04-21T09:08:39.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.554+0000 7f1271def000 1 -- start start 2024-04-21T09:08:39.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df3769500 0x561df37bf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df37bfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df37a4990 0x561df3764450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f12681537f0 con 0x561df37a4990 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f126814df20 con 0x561df379f5a0 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1268153140 con 0x561df3769500 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df37a4990 0x561df3764450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df37a4990 0x561df3764450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34862/0 (socket says 172.21.15.26:34862) 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 -- 172.21.15.26:0/63624632 learned_addr learned my addr 172.21.15.26:0/63624632 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126ca09640 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df3769500 0x561df37bf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1267fff640 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df37bfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 -- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df3769500 msgr2=0x561df37bf570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df3769500 0x561df37bf570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 -- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 msgr2=0x561df37bfab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df37bfab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 -- 172.21.15.26:0/63624632 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561df357eab0 con 0x561df37a4990 2024-04-21T09:08:39.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f126d20a640 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df37a4990 0x561df3764450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f12680caeb0 tx=0x7f1260007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d48cd0b1816b9a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1251ffb640 1 -- 172.21.15.26:0/63624632 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260010040 con 0x561df37a4990 2024-04-21T09:08:39.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1251ffb640 1 -- 172.21.15.26:0/63624632 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260001c20 con 0x561df37a4990 2024-04-21T09:08:39.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1251ffb640 1 -- 172.21.15.26:0/63624632 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260002010 con 0x561df37a4990 2024-04-21T09:08:39.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- 172.21.15.26:0/63624632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df37a4990 msgr2=0x561df3764450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df37a4990 0x561df3764450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f12680caeb0 tx=0x7f1260007840 comp rx=0 tx=0).stop 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- 172.21.15.26:0/63624632 shutdown_connections 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df37a4990 0x561df3764450 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df379f5a0 0x561df37bfab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 --2- 172.21.15.26:0/63624632 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df3769500 0x561df37bf570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- 172.21.15.26:0/63624632 >> 172.21.15.26:0/63624632 conn(0x561df37a0200 msgr2=0x561df3799fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- 172.21.15.26:0/63624632 shutdown_connections 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- 172.21.15.26:0/63624632 wait complete. 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 -- start start 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.558+0000 7f1271def000 1 Processor -- start 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df3767610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df37da100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37da640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x561df3549470 con 0x561df379f5a0 2024-04-21T09:08:39.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x561df35bfe00 con 0x561df3769500 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x561df3576b70 con 0x561df37a4990 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 10 client.0 _ll_register_callbacks cb 0x7f125c00ea70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df37da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df37da100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34874/0 (socket says 172.21.15.26:34874) 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 -- 172.21.15.26:0/3830839851 learned_addr learned my addr 172.21.15.26:0/3830839851 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f126d20a640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37da640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f126ca09640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df3767610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 -- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 msgr2=0x561df37da640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37da640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 -- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 msgr2=0x561df3767610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df3767610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 -- 172.21.15.26:0/3830839851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561df3633660 con 0x561df379f5a0 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f126d20a640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37da640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1267fff640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df37da100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f12540effa0 tx=0x7f12540c1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96170da72ea90e6b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:39.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f12477fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f12477fe640 1 -- 172.21.15.26:0/3830839851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254121070 con 0x561df379f5a0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f12477fe640 1 -- 172.21.15.26:0/3830839851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f12540afe00 con 0x561df379f5a0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1260001c20 con 0x561df379f5a0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f12477fe640 1 -- 172.21.15.26:0/3830839851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f1254119050 con 0x561df379f5a0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 10 client.4929 fetch_fsmap learned FSMap version 8 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x561df35486a0 con 0x561df379f5a0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f12477fe640 1 -- 172.21.15.26:0/3830839851 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260001c20 con 0x561df379f5a0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f12477fe640 1 -- 172.21.15.26:0/3830839851 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f12540f01b0 con 0x561df379f5a0 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 10 client.4929 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 10 client.4929 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 20 client.4929 populate_metadata read hostname 'smithi026' 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df38194f0 0x561df3819900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 4 client.4929 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 70.0, "await": true}] 2024-04-21T09:08:39.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 70.0, "await": true}) -- 0x561df35c0610 con 0x561df38194f0 2024-04-21T09:08:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f126ca09640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df38194f0 0x561df3819900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f12477fe640 10 client.4929 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:39.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:39.562+0000 7f126ca09640 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df38194f0 0x561df3819900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dd1929edc9e2c63 server_cookie=abf72f6732b8265b in_seq=0 out_seq=0 2024-04-21T09:08:42.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f12477fe640 1 -- 172.21.15.26:0/3830839851 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x561df35c0610 con 0x561df38194f0 2024-04-21T09:08:42.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f12477fe640 10 client.4929 handle_command_reply: tid=0 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 client.4929 shutdown 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 msgr2=0x561df37da100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df37da100 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f12540effa0 tx=0x7f12540c1000 comp rx=0 tx=0).stop 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 shutdown_connections 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x561df38194f0 0x561df3819900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x561df37a4990 0x561df37da640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x561df379f5a0 0x561df37da100 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 --2- 172.21.15.26:0/3830839851 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x561df3769500 0x561df3767610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 >> 172.21.15.26:0/3830839851 conn(0x561df37a0200 msgr2=0x561df379a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:42.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f12477fe640 0 client.4929 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:42.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 shutdown_connections 2024-04-21T09:08:42.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 1 -- 172.21.15.26:0/3830839851 wait complete. 2024-04-21T09:08:42.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f1271def000 20 client.4929 trim_cache size 0 max 16384 2024-04-21T09:08:42.237 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 10, 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "9ddd2aa0": { 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 10, 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:08:42.238 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 70.0, 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:42.239 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:42.240 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:08:42.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f124c068380 msgr2=0x7f124c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f126ec6d640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f124c068380 0x7f124c06a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f125c00a8d0 tx=0x7f125c008040 comp rx=0 tx=0).stop 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806e090 msgr2=0x7f12681525c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.234+0000 7f126ec6d640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806e090 0x7f12681525c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f12540b3040 tx=0x7f125401bab0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 shutdown_connections 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f12680b2280 0x7f1268155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f124c068380 0x7f124c06a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f126806e090 0x7f12681525c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 --2- 172.21.15.26:0/28042994 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f126806dc80 0x7f1268151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 >> 172.21.15.26:0/28042994 conn(0x7f1268070190 msgr2=0x7f12680cb1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 shutdown_connections 2024-04-21T09:08:42.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:42.238+0000 7f126ec6d640 1 -- 172.21.15.26:0/28042994 wait complete. 2024-04-21T09:08:42.265 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 9ddd2aa0, quiesce duration: 10 2024-04-21T09:08:52.267 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:08:52.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d8d23640 1 Processor -- start 2024-04-21T09:08:52.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d8d23640 1 -- start start 2024-04-21T09:08:52.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d8d23640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9d40c4510 0x7fe9d4158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d8d23640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d40c6f90 con 0x7fe9d4158810 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d8d23640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9d40c6cb0 con 0x7fe9d40c71d0 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d8d23640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe9d40c9980 con 0x7fe9d40c4510 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe9d4158810 0x7fe9d40c5db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46166/0 (socket says 172.21.15.26:46166) 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d259c640 1 -- 172.21.15.26:0/3051525965 learned_addr learned my addr 172.21.15.26:0/3051525965 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d1d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe9d40c4510 0x7fe9d4158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d1d9b640 1 -- 172.21.15.26:0/3051525965 >> v1:172.21.15.169:6789/0 conn(0x7fe9d40c71d0 legacy=0x7fe9d4162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d1d9b640 1 -- 172.21.15.26:0/3051525965 >> v1:172.21.15.26:6789/0 conn(0x7fe9d4158810 legacy=0x7fe9d40c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.402+0000 7fe9d1d9b640 1 -- 172.21.15.26:0/3051525965 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d40c83c0 con 0x7fe9d40c4510 2024-04-21T09:08:52.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d1d9b640 1 --2- 172.21.15.26:0/3051525965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d40c4510 0x7fe9d4158fd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80097c0 tx=0x7fe9c801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2b7ebe84702ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d159a640 1 -- 172.21.15.26:0/3051525965 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80ab430 con 0x7fe9d40c4510 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d159a640 1 -- 172.21.15.26:0/3051525965 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9c80b0070 con 0x7fe9d40c4510 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d159a640 1 -- 172.21.15.26:0/3051525965 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80ab7f0 con 0x7fe9d40c4510 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- 172.21.15.26:0/3051525965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d40c4510 msgr2=0x7fe9d4158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/3051525965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d40c4510 0x7fe9d4158fd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80097c0 tx=0x7fe9c801c430 comp rx=0 tx=0).stop 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- 172.21.15.26:0/3051525965 shutdown_connections 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/3051525965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d40c4510 0x7fe9d4158fd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- 172.21.15.26:0/3051525965 >> 172.21.15.26:0/3051525965 conn(0x7fe9d40725c0 msgr2=0x7fe9d40729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- 172.21.15.26:0/3051525965 shutdown_connections 2024-04-21T09:08:52.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- 172.21.15.26:0/3051525965 wait complete. 2024-04-21T09:08:52.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 Processor -- start 2024-04-21T09:08:52.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- start start 2024-04-21T09:08:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9d40c4510 0x7fe9d415e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d40c71d0 0x7fe9d415ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d4158810 0x7fe9d41f4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d406cc40 con 0x7fe9d4158810 2024-04-21T09:08:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe9d4158bf0 con 0x7fe9d40c71d0 2024-04-21T09:08:52.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d8d23640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe9d406cdc0 con 0x7fe9d40c4510 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d4158810 0x7fe9d41f4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d4158810 0x7fe9d41f4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57384/0 (socket says 172.21.15.26:57384) 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 -- 172.21.15.26:0/1891180479 learned_addr learned my addr 172.21.15.26:0/1891180479 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d259c640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9d40c4510 0x7fe9d415e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d1d9b640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d40c71d0 0x7fe9d415ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 -- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9d40c4510 msgr2=0x7fe9d415e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9d40c4510 0x7fe9d415e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 -- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d40c71d0 msgr2=0x7fe9d415ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d40c71d0 0x7fe9d415ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d2d9d640 1 -- 172.21.15.26:0/1891180479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9d40c3800 con 0x7fe9d4158810 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d259c640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9d40c4510 0x7fe9d415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.406+0000 7fe9d1d9b640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d40c71d0 0x7fe9d415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:52.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9d2d9d640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d4158810 0x7fe9d41f4780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00ba10 tx=0x7fe9cc00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9c2ffd640 1 -- 172.21.15.26:0/1891180479 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc019070 con 0x7fe9d4158810 2024-04-21T09:08:52.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9c2ffd640 1 -- 172.21.15.26:0/1891180479 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9cc00cb40 con 0x7fe9d4158810 2024-04-21T09:08:52.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9d40c0a70 con 0x7fe9d4158810 2024-04-21T09:08:52.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9c2ffd640 1 -- 172.21.15.26:0/1891180479 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc014440 con 0x7fe9d4158810 2024-04-21T09:08:52.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9d41f82b0 con 0x7fe9d4158810 2024-04-21T09:08:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9d41f4470 con 0x7fe9d4158810 2024-04-21T09:08:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9c2ffd640 1 -- 172.21.15.26:0/1891180479 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe9cc01c070 con 0x7fe9d4158810 2024-04-21T09:08:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9c2ffd640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe9b40683b0 0x7fe9b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9c2ffd640 1 -- 172.21.15.26:0/1891180479 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fe9cc086500 con 0x7fe9d4158810 2024-04-21T09:08:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9d259c640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe9b40683b0 0x7fe9b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.410+0000 7fe9d259c640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe9b40683b0 0x7fe9b406a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4007fd0 tx=0x7fe9c4009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.414+0000 7fe9c2ffd640 1 -- 172.21.15.26:0/1891180479 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe9cc056af0 con 0x7fe9d4158810 2024-04-21T09:08:52.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.618+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe9d4075ef0 con 0x7fe9d4158810 2024-04-21T09:08:52.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.618+0000 7fe9c2ffd640 1 -- 172.21.15.26:0/1891180479 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fe9cc0563f0 con 0x7fe9d4158810 2024-04-21T09:08:52.620 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:08:52.620 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:08:52.620 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe9b40683b0 msgr2=0x7fe9b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe9b40683b0 0x7fe9b406a870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4007fd0 tx=0x7fe9c4009040 comp rx=0 tx=0).stop 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d4158810 msgr2=0x7fe9d41f4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d4158810 0x7fe9d41f4780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00ba10 tx=0x7fe9cc00bed0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 shutdown_connections 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe9b40683b0 0x7fe9b406a870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe9d4158810 0x7fe9d41f4780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe9d40c71d0 0x7fe9d415ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 --2- 172.21.15.26:0/1891180479 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe9d40c4510 0x7fe9d415e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 >> 172.21.15.26:0/1891180479 conn(0x7fe9d40725c0 msgr2=0x7fe9d41569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 shutdown_connections 2024-04-21T09:08:52.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.622+0000 7fe9d8d23640 1 -- 172.21.15.26:0/1891180479 wait complete. 2024-04-21T09:08:52.638 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id 9ddd2aa0 --release --await' 2024-04-21T09:08:52.639 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id 9ddd2aa0 --release --await 2024-04-21T09:08:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f85cd640 1 Processor -- start 2024-04-21T09:08:52.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f85cd640 1 -- start start 2024-04-21T09:08:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f85cd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6f00ccba0 0x7fd6f01591a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f85cd640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f0153240 con 0x7fd6f00c5e90 2024-04-21T09:08:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f85cd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6f00c6b60 con 0x7fd6f0152e60 2024-04-21T09:08:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f85cd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd6f0158d10 con 0x7fd6f00ccba0 2024-04-21T09:08:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f6b6a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd6f00c5e90 0x7fd6f01633a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:46172/0 (socket says 172.21.15.26:46172) 2024-04-21T09:08:52.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f6b6a640 1 -- 172.21.15.26:0/1189093624 learned_addr learned my addr 172.21.15.26:0/1189093624 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:08:52.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/1189093624 >> v2:172.21.15.26:3300/0 conn(0x7fd6f00ccba0 0x7fd6f01591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f5367640 1 -- 172.21.15.26:0/1189093624 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 913623419 0 0) 0x7fd6f0153240 con 0x7fd6f00c5e90 2024-04-21T09:08:52.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f5367640 1 -- 172.21.15.26:0/1189093624 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6dc003530 con 0x7fd6f00c5e90 2024-04-21T09:08:52.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f5b68640 1 -- 172.21.15.26:0/1189093624 >> v1:172.21.15.169:6789/0 conn(0x7fd6f0152e60 legacy=0x7fd6f00736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f5b68640 1 -- 172.21.15.26:0/1189093624 >> v1:172.21.15.26:6789/0 conn(0x7fd6f00c5e90 legacy=0x7fd6f01633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.774+0000 7fd6f5b68640 1 -- 172.21.15.26:0/1189093624 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f00c3550 con 0x7fd6f00ccba0 2024-04-21T09:08:52.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/1189093624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f00ccba0 0x7fd6f01591a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00097c0 tx=0x7fd6e001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd5a5a70988b347 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f5367640 1 -- 172.21.15.26:0/1189093624 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b5070 con 0x7fd6f00ccba0 2024-04-21T09:08:52.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f5367640 1 -- 172.21.15.26:0/1189093624 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e00a8990 con 0x7fd6f00ccba0 2024-04-21T09:08:52.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f5367640 1 -- 172.21.15.26:0/1189093624 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00a8d40 con 0x7fd6f00ccba0 2024-04-21T09:08:52.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- 172.21.15.26:0/1189093624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f00ccba0 msgr2=0x7fd6f01591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/1189093624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f00ccba0 0x7fd6f01591a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00097c0 tx=0x7fd6e001ec90 comp rx=0 tx=0).stop 2024-04-21T09:08:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- 172.21.15.26:0/1189093624 shutdown_connections 2024-04-21T09:08:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/1189093624 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f00ccba0 0x7fd6f01591a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- 172.21.15.26:0/1189093624 >> 172.21.15.26:0/1189093624 conn(0x7fd6f00cbef0 msgr2=0x7fd6f00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- 172.21.15.26:0/1189093624 shutdown_connections 2024-04-21T09:08:52.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- 172.21.15.26:0/1189093624 wait complete. 2024-04-21T09:08:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 Processor -- start 2024-04-21T09:08:52.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- start start 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f00c5e90 0x7fd6f00c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f00ccba0 0x7fd6f01eed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f0152e60 0x7fd6f00ca940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f00c67b0 con 0x7fd6f0152e60 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f00c3b10 con 0x7fd6f00c5e90 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f85cd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f01ef280 con 0x7fd6f00ccba0 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f6b6a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f0152e60 0x7fd6f00ca940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f6b6a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f0152e60 0x7fd6f00ca940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57410/0 (socket says 172.21.15.26:57410) 2024-04-21T09:08:52.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.778+0000 7fd6f6b6a640 1 -- 172.21.15.26:0/2848693910 learned_addr learned my addr 172.21.15.26:0/2848693910 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f00ccba0 0x7fd6f01eed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6369640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f00c5e90 0x7fd6f00c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6b6a640 1 -- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f00ccba0 msgr2=0x7fd6f01eed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f00ccba0 0x7fd6f01eed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6b6a640 1 -- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f00c5e90 msgr2=0x7fd6f00c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f00c5e90 0x7fd6f00c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6b6a640 1 -- 172.21.15.26:0/2848693910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6f014d2b0 con 0x7fd6f0152e60 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f00ccba0 0x7fd6f01eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6369640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f00c5e90 0x7fd6f00c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f0152e60 0x7fd6f00ca940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c480 tx=0x7fd6e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6e6ffd640 1 -- 172.21.15.26:0/2848693910 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8017070 con 0x7fd6f0152e60 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6e6ffd640 1 -- 172.21.15.26:0/2848693910 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e8005cf0 con 0x7fd6f0152e60 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6f014d590 con 0x7fd6f0152e60 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6e6ffd640 1 -- 172.21.15.26:0/2848693910 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80072b0 con 0x7fd6f0152e60 2024-04-21T09:08:52.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6f0154560 con 0x7fd6f0152e60 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6e6ffd640 1 -- 172.21.15.26:0/2848693910 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd6e801a070 con 0x7fd6f0152e60 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6e6ffd640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd6d4068380 0x7fd6d406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6e6ffd640 1 -- 172.21.15.26:0/2848693910 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fd6e8085df0 con 0x7fd6f0152e60 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6369640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd6d4068380 0x7fd6d406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6fb74f000 1 Processor -- start 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6fb74f000 1 -- start start 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.782+0000 7fd6f6369640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd6d4068380 0x7fd6d406a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec007fd0 tx=0x7fd6ec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4dff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e002e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e3b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4c47660 con 0x55c4b4dfff00 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4bec5d0 con 0x55c4b4e3b120 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c4b4c43620 con 0x55c4b4e368a0 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e002e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e002e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57424/0 (socket says 172.21.15.26:57424) 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/4004169159 learned_addr learned my addr 172.21.15.26:0/4004169159 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e3b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f6369640 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4dff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 msgr2=0x55c4b4dff9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4dff9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 msgr2=0x55c4b4e3b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e3b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/4004169159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b4c20bd0 con 0x55c4b4dfff00 2024-04-21T09:08:52.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f6369640 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4dff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e3b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e002e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001c8c0 tx=0x7fd6e00aa070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ed6a309df8e348 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6d3fff640 1 -- 172.21.15.26:0/4004169159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b5070 con 0x55c4b4dfff00 2024-04-21T09:08:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6d3fff640 1 -- 172.21.15.26:0/4004169159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e00b6040 con 0x55c4b4dfff00 2024-04-21T09:08:52.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6d3fff640 1 -- 172.21.15.26:0/4004169159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00043a0 con 0x55c4b4dfff00 2024-04-21T09:08:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- 172.21.15.26:0/4004169159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 msgr2=0x55c4b4e002e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e002e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001c8c0 tx=0x7fd6e00aa070 comp rx=0 tx=0).stop 2024-04-21T09:08:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- 172.21.15.26:0/4004169159 shutdown_connections 2024-04-21T09:08:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e3b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e002e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/4004169159 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4dff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- 172.21.15.26:0/4004169159 >> 172.21.15.26:0/4004169159 conn(0x55c4b4ce1b00 msgr2=0x55c4b4e38ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- 172.21.15.26:0/4004169159 shutdown_connections 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- 172.21.15.26:0/4004169159 wait complete. 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- start start 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 Processor -- start 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4e35650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4e35b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4dfa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4d04d40 con 0x55c4b4e368a0 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4c01eb0 con 0x55c4b4dfff00 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c4b4c422a0 con 0x55c4b4e3b120 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 10 client.0 _ll_register_callbacks cb 0x55c4b4de5a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4e35b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4e35b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57432/0 (socket says 172.21.15.26:57432) 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/3145564591 learned_addr learned my addr 172.21.15.26:0/3145564591 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f6369640 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4e35650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4dfa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 msgr2=0x55c4b4dfa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4dfa8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 msgr2=0x55c4b4e35650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4e35650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 -- 172.21.15.26:0/3145564591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b4c8db30 con 0x55c4b4e368a0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4e35b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001b8a0 tx=0x7fd6e001d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c218f62ee13cc2f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3145564591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b5040 con 0x55c4b4e368a0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3145564591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fd6e00c5b10 con 0x55c4b4e368a0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.786+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c4b4be1060 con 0x55c4b4e368a0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3145564591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd6e00c5d10 con 0x55c4b4e368a0 2024-04-21T09:08:52.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 10 client.4953 fetch_fsmap learned FSMap version 8 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55c4b4be6b70 con 0x55c4b4e368a0 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3145564591 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55c4b4be1060 con 0x55c4b4e368a0 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3145564591 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fd6e00a8850 con 0x55c4b4e368a0 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 10 client.4953 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 10 client.4953 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 20 client.4953 populate_metadata read hostname 'smithi026' 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4dfb610 0x55c4b4dfb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 4 client.4953 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4b4c1fe30 con 0x55c4b4dfb610 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6f6369640 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4dfb610 0x55c4b4dfb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6f6369640 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4dfb610 0x55c4b4dfb9f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b432dcff9dcd6662 server_cookie=5fd03cdec1591e57 in_seq=0 out_seq=0 2024-04-21T09:08:52.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6d17fa640 10 client.4953 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3145564591 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c4b4c1fe30 con 0x55c4b4dfb610 2024-04-21T09:08:52.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6d17fa640 10 client.4953 handle_command_reply: tid=0 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 client.4953 shutdown 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 msgr2=0x55c4b4e35b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4e35b90 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001b8a0 tx=0x7fd6e001d4d0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 shutdown_connections 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4dfb610 0x55c4b4dfb9f0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4dfa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4e35b90 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6d17fa640 0 client.4953 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3145564591 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4e35650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 >> 172.21.15.26:0/3145564591 conn(0x55c4b4ce1b00 msgr2=0x55c4b4e3a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 shutdown_connections 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3145564591 wait complete. 2024-04-21T09:08:52.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.790+0000 7fd6fb74f000 20 client.4953 trim_cache size 0 max 16384 2024-04-21T09:08:52.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 Processor -- start 2024-04-21T09:08:52.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- start start 2024-04-21T09:08:52.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4ea1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4df9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4df9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f01f1ee0 con 0x55c4b4e368a0 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f0072f30 con 0x55c4b4dfff00 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd6f01f1830 con 0x55c4b4e3b120 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4df9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4df9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57436/0 (socket says 172.21.15.26:57436) 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 -- 172.21.15.26:0/478889584 learned_addr learned my addr 172.21.15.26:0/478889584 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f6369640 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4ea1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4df9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 -- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 msgr2=0x55c4b4df9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4df9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 -- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 msgr2=0x55c4b4ea1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4ea1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 -- 172.21.15.26:0/478889584 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b4cc95e0 con 0x55c4b4e368a0 2024-04-21T09:08:52.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f6369640 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4ea1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:08:52.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4df9410 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001c8c0 tx=0x7fd6e00b2050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2454e27d70705958 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6d37fe640 1 -- 172.21.15.26:0/478889584 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00d4030 con 0x55c4b4e368a0 2024-04-21T09:08:52.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6d37fe640 1 -- 172.21.15.26:0/478889584 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e001cf80 con 0x55c4b4e368a0 2024-04-21T09:08:52.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6d37fe640 1 -- 172.21.15.26:0/478889584 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6e00b5040 con 0x55c4b4e368a0 2024-04-21T09:08:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- 172.21.15.26:0/478889584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 msgr2=0x55c4b4df9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4df9410 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd6e001c8c0 tx=0x7fd6e00b2050 comp rx=0 tx=0).stop 2024-04-21T09:08:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- 172.21.15.26:0/478889584 shutdown_connections 2024-04-21T09:08:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e3b120 0x55c4b4df9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4e368a0 0x55c4b4df9410 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/478889584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4dfff00 0x55c4b4ea1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- 172.21.15.26:0/478889584 >> 172.21.15.26:0/478889584 conn(0x55c4b4ce1b00 msgr2=0x55c4b4dfda00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- 172.21.15.26:0/478889584 shutdown_connections 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- 172.21.15.26:0/478889584 wait complete. 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 -- start start 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.810+0000 7fd6fb74f000 1 Processor -- start 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e54830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4e54d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e552b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4c46970 con 0x55c4b4dfff00 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55c4b4bfc8f0 con 0x55c4b4e3b120 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55c4b4c4bc90 con 0x55c4b4e368a0 2024-04-21T09:08:52.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 10 client.0 _ll_register_callbacks cb 0x7fd6dc003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e54830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e54830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57444/0 (socket says 172.21.15.26:57444) 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 -- 172.21.15.26:0/3513581363 learned_addr learned my addr 172.21.15.26:0/3513581363 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4e54d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6b6a640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 -- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 msgr2=0x55c4b4e54d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4e54d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 -- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 msgr2=0x55c4b4e552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 -- 172.21.15.26:0/3513581363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b4bd9ae0 con 0x55c4b4dfff00 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4e54d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f6369640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e54830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00dac0 tx=0x7fd6ec000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb28681a472edf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:08:52.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3513581363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec006d70 con 0x55c4b4dfff00 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3513581363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fd6ec0260b0 con 0x55c4b4dfff00 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6e001cf80 con 0x55c4b4dfff00 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3513581363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd6ec035050 con 0x55c4b4dfff00 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 10 client.4959 fetch_fsmap learned FSMap version 8 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55c4b4bdcd80 con 0x55c4b4dfff00 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3513581363 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6e001cf80 con 0x55c4b4dfff00 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3513581363 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fd6ec038020 con 0x55c4b4dfff00 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 10 client.4959 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 10 client.4959 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 20 client.4959 populate_metadata read hostname 'smithi026' 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4eb55a0 0x55c4b4eb7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 4 client.4959 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9ddd2aa0", "release": true, "await": true}] 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9ddd2aa0", "release": true, "await": true}) -- 0x55c4b4be50d0 con 0x55c4b4eb55a0 2024-04-21T09:08:52.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4eb55a0 0x55c4b4eb7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 10 client.4959 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6f5b68640 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4eb55a0 0x55c4b4eb7990 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c802477e7b41c3b7 server_cookie=8da7717721790e3e in_seq=0 out_seq=0 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 1 -- 172.21.15.26:0/3513581363 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55c4b4be50d0 con 0x55c4b4eb55a0 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 10 client.4959 handle_command_reply: tid=0 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 client.4959 shutdown 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 msgr2=0x55c4b4e54830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e54830 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00dac0 tx=0x7fd6ec000f50 comp rx=0 tx=0).stop 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 shutdown_connections 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55c4b4eb55a0 0x55c4b4eb7990 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c4b4e3b120 0x55c4b4e552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6d17fa640 0 client.4959 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c4b4e368a0 0x55c4b4e54d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 --2- 172.21.15.26:0/3513581363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55c4b4dfff00 0x55c4b4e54830 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 >> 172.21.15.26:0/3513581363 conn(0x55c4b4ce1b00 msgr2=0x55c4b4df9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 shutdown_connections 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 1 -- 172.21.15.26:0/3513581363 wait complete. 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.814+0000 7fd6fb74f000 20 client.4959 trim_cache size 0 max 16384 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 12, 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "9ddd2aa0": { 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 12, 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:08:52.822 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 70.0, 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:52.823 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:52.824 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:08:52.824 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:08:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd6d4068380 msgr2=0x7fd6d406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd6d4068380 0x7fd6d406a840 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec007fd0 tx=0x7fd6ec009040 comp rx=0 tx=0).stop 2024-04-21T09:08:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f0152e60 msgr2=0x7fd6f00ca940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:08:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f0152e60 0x7fd6f00ca940 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c480 tx=0x7fd6e800c940 comp rx=0 tx=0).stop 2024-04-21T09:08:52.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 shutdown_connections 2024-04-21T09:08:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd6d4068380 0x7fd6d406a840 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6f0152e60 0x7fd6f00ca940 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6f00ccba0 0x7fd6f01eed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 --2- 172.21.15.26:0/2848693910 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6f00c5e90 0x7fd6f00c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:08:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 >> 172.21.15.26:0/2848693910 conn(0x7fd6f00cbef0 msgr2=0x7fd6f006cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:08:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 shutdown_connections 2024-04-21T09:08:52.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:08:52.818+0000 7fd6f85cd640 1 -- 172.21.15.26:0/2848693910 wait complete. 2024-04-21T09:08:52.834 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 9ddd2aa0, seconds elapsed: 13.9 2024-04-21T09:08:54.176 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:08:54.179 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:09:24.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:09:24.352 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:09:54.389 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:09:54.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:10:19.686 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 1% (148/12485) Updating files: 2% (250/12485) Updating files: 2% (297/12485) Updating files: 3% (375/12485) Updating files: 3% (423/12485) Updating files: 4% (500/12485) Updating files: 4% (581/12485) Updating files: 5% (625/12485) Updating files: 5% (731/12485) Updating files: 6% (750/12485) Updating files: 6% (861/12485) Updating files: 7% (874/12485) Updating files: 7% (962/12485) Updating files: 8% (999/12485) Updating files: 8% (1050/12485) Updating files: 9% (1124/12485) Updating files: 9% (1129/12485) Updating files: 10% (1249/12485) Updating files: 10% (1257/12485) Updating files: 11% (1374/12485) Updating files: 11% (1377/12485) Updating files: 11% (1487/12485) Updating files: 12% (1499/12485) Updating files: 12% (1584/12485) Updating files: 13% (1624/12485) Updating files: 13% (1653/12485) Updating files: 14% (1748/12485) Updating files: 14% (1753/12485) Updating files: 14% (1837/12485) Updating files: 15% (1873/12485) Updating files: 15% (1933/12485) Updating files: 16% (1998/12485) Updating files: 16% (2019/12485) Updating files: 16% (2105/12485) Updating files: 17% (2123/12485) Updating files: 17% (2193/12485) Updating files: 18% (2248/12485) Updating files: 18% (2275/12485) Updating files: 18% (2357/12485) Updating files: 19% (2373/12485) Updating files: 19% (2432/12485) Updating files: 19% (2487/12485) Updating files: 20% (2497/12485) Updating files: 20% (2568/12485) Updating files: 21% (2622/12485) Updating files: 21% (2653/12485) Updating files: 21% (2744/12485) Updating files: 22% (2747/12485) Updating files: 22% (2842/12485) Updating files: 23% (2872/12485) Updating files: 23% (2940/12485) Updating files: 24% (2997/12485) Updating files: 24% (3030/12485) Updating files: 25% (3122/12485) Updating files: 25% (3132/12485) Updating files: 25% (3229/12485) Updating files: 26% (3247/12485) Updating files: 26% (3332/12485) Updating files: 27% (3371/12485) Updating files: 27% (3428/12485) Updating files: 28% (3496/12485) Updating files: 28% (3521/12485) Updating files: 28% (3619/12485) Updating files: 29% (3621/12485) Updating files: 29% (3711/12485) Updating files: 30% (3746/12485) Updating files: 30% (3798/12485) Updating files: 31% (3871/12485) Updating files: 31% (3892/12485) Updating files: 31% (3993/12485) Updating files: 32% (3996/12485) Updating files: 32% (4083/12485) Updating files: 33% (4121/12485) Updating files: 33% (4181/12485) Updating files: 34% (4245/12485) Updating files: 34% (4292/12485) Updating files: 34% (4295/12485) Updating files: 34% (4296/12485) Updating files: 35% (4370/12485) Updating files: 35% (4387/12485) Updating files: 35% (4482/12485) Updating files: 36% (4495/12485) Updating files: 36% (4576/12485) Updating files: 37% (4620/12485) Updating files: 37% (4709/12485) Updating files: 38% (4745/12485) Updating files: 38% (4839/12485) Updating files: 39% (4870/12485) Updating files: 39% (4954/12485) Updating files: 40% (4994/12485) Updating files: 40% (5060/12485) Updating files: 41% (5119/12485) Updating files: 41% (5197/12485) Updating files: 42% (5244/12485) Updating files: 42% (5301/12485) Updating files: 42% (5363/12485) Updating files: 43% (5369/12485) Updating files: 43% (5439/12485) Updating files: 44% (5494/12485) Updating files: 44% (5545/12485) Updating files: 45% (5619/12485) Updating files: 45% (5667/12485) Updating files: 46% (5744/12485) Updating files: 46% (5801/12485) Updating files: 47% (5868/12485) Updating files: 47% (5926/12485) Updating files: 48% (5993/12485) Updating files: 48% (6061/12485) Updating files: 49% (6118/12485) Updating files: 49% (6177/12485) Updating files: 50% (6243/12485) Updating files: 50% (6287/12485) Updating files: 51% (6368/12485) Updating files: 51% (6399/12485) Updating files: 52% (6493/12485) Updating files: 52% (6521/12485) Updating files: 53% (6618/12485) Updating files: 53% (6644/12485) Updating files: 54% (6742/12485) Updating files: 54% (6748/12485) Updating files: 55% (6867/12485) Updating files: 55% (6902/12485) Updating files: 56% (6992/12485) Updating files: 56% (7044/12485) Updating files: 57% (7117/12485) Updating files: 57% (7168/12485) Updating files: 58% (7242/12485) Updating files: 58% (7290/12485) Updating files: 59% (7367/12485) Updating files: 59% (7411/12485) Updating files: 60% (7491/12485) Updating files: 60% (7615/12485) Updating files: 61% (7616/12485) Updating files: 61% (7720/12485) Updating files: 62% (7741/12485) Updating files: 62% (7857/12485) Updating files: 63% (7866/12485) Updating files: 63% (7972/12485) Updating files: 64% (7991/12485) Updating files: 64% (8084/12485) Updating files: 65% (8116/12485) Updating files: 65% (8182/12485) Updating files: 66% (8241/12485) Updating files: 66% (8288/12485) Updating files: 66% (8359/12485) Updating files: 67% (8365/12485) Updating files: 67% (8413/12485) Updating files: 67% (8472/12485) Updating files: 68% (8490/12485) Updating files: 68% (8534/12485) Updating files: 68% (8593/12485) Updating files: 69% (8615/12485) Updating files: 69% (8655/12485) Updating files: 69% (8717/12485) Updating files: 70% (8740/12485) Updating files: 70% (8780/12485) Updating files: 70% (8847/12485) Updating files: 71% (8865/12485) Updating files: 71% (8911/12485) Updating files: 71% (8971/12485) Updating files: 72% (8990/12485) Updating files: 72% (9038/12485) Updating files: 72% (9103/12485) Updating files: 73% (9115/12485) Updating files: 73% (9185/12485) Updating files: 74% (9239/12485) Updating files: 74% (9262/12485) Updating files: 74% (9321/12485) Updating files: 75% (9364/12485) Updating files: 75% (9389/12485) Updating files: 75% (9463/12485) Updating files: 76% (9489/12485) Updating files: 76% (9538/12485) Updating files: 77% (9614/12485) Updating files: 77% (9625/12485) Updating files: 77% (9702/12485) Updating files: 78% (9739/12485) Updating files: 78% (9788/12485) Updating files: 79% (9864/12485) Updating files: 79% (9874/12485) Updating files: 79% (9922/12485) Updating files: 79% (9943/12485) Updating files: 80% (9988/12485) Updating files: 80% (10027/12485) Updating files: 81% (10113/12485) Updating files: 81% (10211/12485) Updating files: 82% (10238/12485) Updating files: 82% (10310/12485) Updating files: 83% (10363/12485) Updating files: 83% (10462/12485) Updating files: 84% (10488/12485) Updating files: 84% (10591/12485) Updating files: 85% (10613/12485) Updating files: 85% (10724/12485) Updating files: 86% (10738/12485) Updating files: 86% (10849/12485) Updating files: 87% (10862/12485) Updating files: 87% (10945/12485) Updating files: 88% (10987/12485) Updating files: 88% (11049/12485) Updating files: 89% (11112/12485) Updating files: 89% (11134/12485) Updating files: 89% (11215/12485) Updating files: 90% (11237/12485) Updating files: 90% (11322/12485) Updating files: 91% (11362/12485) Updating files: 91% (11443/12485) Updating files: 92% (11487/12485) Updating files: 92% (11531/12485) Updating files: 93% (11612/12485) Updating files: 93% (11629/12485) Updating files: 94% (11736/12485) Updating files: 94% (11747/12485) Updating files: 94% (11849/12485) Updating files: 95% (11861/12485) Updating files: 95% (11967/12485) Updating files: 96% (11986/12485) Updating files: 96% (12047/12485) Updating files: 97% (12111/12485) Updating files: 97% (12153/12485) Updating files: 98% (12236/12485) Updating files: 98% (12273/12485) Updating files: 99% (12361/12485) Updating files: 99% (12385/12485) Updating files: 100% (12485/12485) Updating files: 100% (12485/12485), done. 2024-04-21T09:10:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:+ trap - EXIT 2024-04-21T09:10:19.809 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ceph 2024-04-21T09:10:19.810 INFO:tasks.workunit.client.0.smithi026.stderr:+ seq 1 90 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:+ versions=1 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:2 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:3 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:4 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:5 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:6 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:7 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:8 2024-04-21T09:10:19.812 INFO:tasks.workunit.client.0.smithi026.stderr:9 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:10 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:11 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:12 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:13 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:14 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:15 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:16 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:17 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:18 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:19 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:20 2024-04-21T09:10:19.813 INFO:tasks.workunit.client.0.smithi026.stderr:21 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:22 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:23 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:24 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:25 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:26 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:27 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:28 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:29 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:30 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:31 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:32 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:33 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:34 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:35 2024-04-21T09:10:19.814 INFO:tasks.workunit.client.0.smithi026.stderr:36 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:37 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:38 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:39 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:40 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:41 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:42 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:43 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:44 2024-04-21T09:10:19.815 INFO:tasks.workunit.client.0.smithi026.stderr:45 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:46 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:47 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:48 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:49 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:50 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:51 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:52 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:53 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:54 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:55 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:56 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:57 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:58 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:59 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:60 2024-04-21T09:10:19.816 INFO:tasks.workunit.client.0.smithi026.stderr:61 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:62 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:63 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:64 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:65 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:66 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:67 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:68 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:69 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:70 2024-04-21T09:10:19.817 INFO:tasks.workunit.client.0.smithi026.stderr:71 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:72 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:73 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:74 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:75 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:76 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:77 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:78 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:79 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:80 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:81 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:82 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:83 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:84 2024-04-21T09:10:19.818 INFO:tasks.workunit.client.0.smithi026.stderr:85 2024-04-21T09:10:19.819 INFO:tasks.workunit.client.0.smithi026.stderr:86 2024-04-21T09:10:19.819 INFO:tasks.workunit.client.0.smithi026.stderr:87 2024-04-21T09:10:19.819 INFO:tasks.workunit.client.0.smithi026.stderr:88 2024-04-21T09:10:19.819 INFO:tasks.workunit.client.0.smithi026.stderr:89 2024-04-21T09:10:19.819 INFO:tasks.workunit.client.0.smithi026.stderr:90 2024-04-21T09:10:19.819 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 1 -eq 48 ] 2024-04-21T09:10:19.819 INFO:tasks.workunit.client.0.smithi026.stdout:v0.1 2024-04-21T09:10:19.820 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.1 2024-04-21T09:10:19.820 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.1 2024-04-21T09:10:19.820 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.1 2024-04-21T09:10:22.835 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-21T09:10:22.835 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.2 2024-04-21T09:10:22.836 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:10:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c4a847640 1 Processor -- start 2024-04-21T09:10:22.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c4a847640 1 -- start start 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c4a847640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c44154cc0 0x7f3c440ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c4a847640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3c441550a0 0x7f3c440d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c4a847640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c4415ef30 con 0x7f3c440ccfe0 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c4a847640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3c440b3fd0 con 0x7f3c44154cc0 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c4a847640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3c440b42b0 con 0x7f3c441550a0 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c43fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c44154cc0 0x7f3c440ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c43fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3c44154cc0 0x7f3c440ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49100/0 (socket says 172.21.15.26:49100) 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c43fff640 1 -- 172.21.15.26:0/508403860 learned_addr learned my addr 172.21.15.26:0/508403860 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c437fe640 1 --2- 172.21.15.26:0/508403860 >> v2:172.21.15.169:3300/0 conn(0x7f3c441550a0 0x7f3c440d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c43fff640 1 -- 172.21.15.26:0/508403860 >> v2:172.21.15.169:3300/0 conn(0x7f3c441550a0 msgr2=0x7f3c440d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:22.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c43fff640 1 --2- 172.21.15.26:0/508403860 >> v2:172.21.15.169:3300/0 conn(0x7f3c441550a0 0x7f3c440d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:22.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c43fff640 1 -- 172.21.15.26:0/508403860 >> v1:172.21.15.169:6789/0 conn(0x7f3c440ccfe0 legacy=0x7f3c4415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:22.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.973+0000 7f3c43fff640 1 -- 172.21.15.26:0/508403860 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c440b4590 con 0x7f3c44154cc0 2024-04-21T09:10:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c43fff640 1 --2- 172.21.15.26:0/508403860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c44154cc0 0x7f3c440ccaa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3c440cde20 tx=0x7f3c3401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8131321b84dede83 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c42ffd640 1 -- 172.21.15.26:0/508403860 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c340b5070 con 0x7f3c44154cc0 2024-04-21T09:10:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c42ffd640 1 -- 172.21.15.26:0/508403860 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c340a8a10 con 0x7f3c44154cc0 2024-04-21T09:10:22.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c42ffd640 1 -- 172.21.15.26:0/508403860 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c340a8de0 con 0x7f3c44154cc0 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 -- 172.21.15.26:0/508403860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c44154cc0 msgr2=0x7f3c440ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 --2- 172.21.15.26:0/508403860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c44154cc0 0x7f3c440ccaa0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3c440cde20 tx=0x7f3c3401ed10 comp rx=0 tx=0).stop 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 -- 172.21.15.26:0/508403860 shutdown_connections 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 --2- 172.21.15.26:0/508403860 >> v2:172.21.15.169:3300/0 conn(0x7f3c441550a0 0x7f3c440d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 --2- 172.21.15.26:0/508403860 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c44154cc0 0x7f3c440ccaa0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 -- 172.21.15.26:0/508403860 >> 172.21.15.26:0/508403860 conn(0x7f3c4406de80 msgr2=0x7f3c4406e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 -- 172.21.15.26:0/508403860 shutdown_connections 2024-04-21T09:10:22.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.977+0000 7f3c4a847640 1 -- 172.21.15.26:0/508403860 wait complete. 2024-04-21T09:10:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 Processor -- start 2024-04-21T09:10:22.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 -- start start 2024-04-21T09:10:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c440ccfe0 0x7f3c44159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:22.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c44154cc0 0x7f3c441f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c441550a0 0x7f3c441539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3c4415ae60 con 0x7f3c441550a0 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3c440b5070 con 0x7f3c44154cc0 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3c440d0890 con 0x7f3c440ccfe0 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c441550a0 0x7f3c441539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c441550a0 0x7f3c441539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49114/0 (socket says 172.21.15.26:49114) 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 -- 172.21.15.26:0/3521981995 learned_addr learned my addr 172.21.15.26:0/3521981995 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c43fff640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c440ccfe0 0x7f3c44159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c437fe640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c44154cc0 0x7f3c441f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 -- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c440ccfe0 msgr2=0x7f3c44159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c440ccfe0 0x7f3c44159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 -- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c44154cc0 msgr2=0x7f3c441f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:22.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c44154cc0 0x7f3c441f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 -- 172.21.15.26:0/3521981995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c440c6ca0 con 0x7f3c441550a0 2024-04-21T09:10:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c48de4640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c441550a0 0x7f3c441539b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c430 tx=0x7f3c3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c40ff9640 1 -- 172.21.15.26:0/3521981995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c005220 con 0x7f3c441550a0 2024-04-21T09:10:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c40ff9640 1 -- 172.21.15.26:0/3521981995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c3c0053c0 con 0x7f3c441550a0 2024-04-21T09:10:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c441f12a0 con 0x7f3c441550a0 2024-04-21T09:10:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c40ff9640 1 -- 172.21.15.26:0/3521981995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c007270 con 0x7f3c441550a0 2024-04-21T09:10:22.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c44159900 con 0x7f3c441550a0 2024-04-21T09:10:22.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.981+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c44154280 con 0x7f3c441550a0 2024-04-21T09:10:22.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.985+0000 7f3c40ff9640 1 -- 172.21.15.26:0/3521981995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3c3c019020 con 0x7f3c441550a0 2024-04-21T09:10:22.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.985+0000 7f3c40ff9640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3c30068380 0x7f3c3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:22.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.985+0000 7f3c40ff9640 1 -- 172.21.15.26:0/3521981995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f3c3c086140 con 0x7f3c441550a0 2024-04-21T09:10:22.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.985+0000 7f3c43fff640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3c30068380 0x7f3c3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:22.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.985+0000 7f3c43fff640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3c30068380 0x7f3c3006a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c340b2000 tx=0x7f3c34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:22.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:22.989+0000 7f3c40ff9640 1 -- 172.21.15.26:0/3521981995 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3c3c020020 con 0x7f3c441550a0 2024-04-21T09:10:23.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c44152010 con 0x7f3c441550a0 2024-04-21T09:10:23.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c40ff9640 1 -- 172.21.15.26:0/3521981995 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f3c3c056150 con 0x7f3c441550a0 2024-04-21T09:10:23.198 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:10:23.198 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:10:23.199 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:10:23.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3c30068380 msgr2=0x7f3c3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3c30068380 0x7f3c3006a840 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3c340b2000 tx=0x7f3c34008040 comp rx=0 tx=0).stop 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c441550a0 msgr2=0x7f3c441539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c441550a0 0x7f3c441539b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c00c430 tx=0x7f3c3c00c8f0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 shutdown_connections 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3c30068380 0x7f3c3006a840 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3c441550a0 0x7f3c441539b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3c44154cc0 0x7f3c441f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 --2- 172.21.15.26:0/3521981995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3c440ccfe0 0x7f3c44159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 >> 172.21.15.26:0/3521981995 conn(0x7f3c4406de80 msgr2=0x7f3c440cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 shutdown_connections 2024-04-21T09:10:23.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.197+0000 7f3c4a847640 1 -- 172.21.15.26:0/3521981995 wait complete. 2024-04-21T09:10:23.218 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 79.2 --await' 2024-04-21T09:10:23.218 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 79.2 --await 2024-04-21T09:10:23.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a14c5c640 1 Processor -- start 2024-04-21T09:10:23.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a14c5c640 1 -- start start 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a14c5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a100c8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a14c5c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0a10067af0 0x7f0a100c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a14c5c640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a1014f870 con 0x7f0a1014f490 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a14c5c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f0a100c6d20 con 0x7f0a10067af0 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a14c5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0a100c5140 con 0x7f0a10159400 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0dd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a100c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0dd9b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a100c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:55662/0 (socket says 172.21.15.26:55662) 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2597585108 learned_addr learned my addr 172.21.15.26:0/2597585108 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:23.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/2597585108 >> v2:172.21.15.169:3300/0 conn(0x7f0a10067af0 0x7f0a100c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2597585108 >> v2:172.21.15.169:3300/0 conn(0x7f0a10067af0 msgr2=0x7f0a100c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/2597585108 >> v2:172.21.15.169:3300/0 conn(0x7f0a10067af0 0x7f0a100c8c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2597585108 >> v1:172.21.15.169:6789/0 conn(0x7f0a1014f490 legacy=0x7f0a100c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.353+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2597585108 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a100c6760 con 0x7f0a10159400 2024-04-21T09:10:23.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/2597585108 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a100c8730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009870 tx=0x7f09f801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45c9c310eb256419 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:23.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a0d59a640 1 -- 172.21.15.26:0/2597585108 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f80a7070 con 0x7f0a10159400 2024-04-21T09:10:23.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a0d59a640 1 -- 172.21.15.26:0/2597585108 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f80b0070 con 0x7f0a10159400 2024-04-21T09:10:23.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a0d59a640 1 -- 172.21.15.26:0/2597585108 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f80ab890 con 0x7f0a10159400 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2597585108 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 msgr2=0x7f0a100c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2597585108 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a100c8730 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f09f8009870 tx=0x7f09f801c560 comp rx=0 tx=0).stop 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2597585108 shutdown_connections 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2597585108 >> v2:172.21.15.169:3300/0 conn(0x7f0a10067af0 0x7f0a100c8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2597585108 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a100c8730 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2597585108 >> 172.21.15.26:0/2597585108 conn(0x7f0a100c92f0 msgr2=0x7f0a100c9700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2597585108 shutdown_connections 2024-04-21T09:10:23.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2597585108 wait complete. 2024-04-21T09:10:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 Processor -- start 2024-04-21T09:10:23.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- start start 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a10067af0 0x7f0a10150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a1014f490 0x7f0a101445a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a10151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0a100c71f0 con 0x7f0a1014f490 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a100c75a0 con 0x7f0a10067af0 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a14c5c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0a100c4c00 con 0x7f0a10159400 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.357+0000 7f0a0dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a1014f490 0x7f0a101445a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a1014f490 0x7f0a101445a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49124/0 (socket says 172.21.15.26:49124) 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2512819854 learned_addr learned my addr 172.21.15.26:0/2512819854 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a10151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a10067af0 0x7f0a10150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 msgr2=0x7f0a10151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a10151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a10067af0 msgr2=0x7f0a10150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a10067af0 0x7f0a10150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/2512819854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a101f4bf0 con 0x7f0a1014f490 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a10067af0 0x7f0a10150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a1014f490 0x7f0a101445a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09f80ad040 tx=0x7f09f801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a06ffd640 1 -- 172.21.15.26:0/2512819854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f80be630 con 0x7f0a1014f490 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a10151160 con 0x7f0a1014f490 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a06ffd640 1 -- 172.21.15.26:0/2512819854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f80be7f0 con 0x7f0a1014f490 2024-04-21T09:10:23.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a06ffd640 1 -- 172.21.15.26:0/2512819854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f80bebe0 con 0x7f0a1014f490 2024-04-21T09:10:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a10151720 con 0x7f0a1014f490 2024-04-21T09:10:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a06ffd640 1 -- 172.21.15.26:0/2512819854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f09f80b43f0 con 0x7f0a1014f490 2024-04-21T09:10:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a06ffd640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f09f0068380 0x7f09f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a06ffd640 1 -- 172.21.15.26:0/2512819854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f09f8120dd0 con 0x7f0a1014f490 2024-04-21T09:10:23.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.361+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f09f0068380 0x7f09f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f09f0068380 0x7f09f006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001670 tx=0x7f0a08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 Processor -- start 2024-04-21T09:10:23.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- start start 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a1975a0 0x559f5a197980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a19c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a19cd70 0x559f5a19d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559f5a042650 con 0x559f5a1975a0 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f59faabf0 con 0x559f5a19cd70 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559f59f500c0 con 0x559f5a19c450 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a1975a0 0x559f5a197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a1975a0 0x559f5a197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49136/0 (socket says 172.21.15.26:49136) 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 -- 172.21.15.26:0/1927786393 learned_addr learned my addr 172.21.15.26:0/1927786393 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a19cd70 0x559f5a19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a19c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 -- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 msgr2=0x559f5a19c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a19c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 -- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a19cd70 msgr2=0x559f5a19d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a19cd70 0x559f5a19d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 -- 172.21.15.26:0/1927786393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f59f6cfe0 con 0x559f5a1975a0 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a1975a0 0x559f5a197980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001e50 tx=0x7f0a08011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1369f3acd484d16 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f09effff640 1 -- 172.21.15.26:0/1927786393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a08003600 con 0x559f5a1975a0 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f09effff640 1 -- 172.21.15.26:0/1927786393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a080037a0 con 0x559f5a1975a0 2024-04-21T09:10:23.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f09effff640 1 -- 172.21.15.26:0/1927786393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a08003b70 con 0x559f5a1975a0 2024-04-21T09:10:23.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- 172.21.15.26:0/1927786393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a1975a0 msgr2=0x559f5a197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a1975a0 0x559f5a197980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001e50 tx=0x7f0a08011000 comp rx=0 tx=0).stop 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- 172.21.15.26:0/1927786393 shutdown_connections 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a19cd70 0x559f5a19d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a19c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1927786393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a1975a0 0x559f5a197980 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- 172.21.15.26:0/1927786393 >> 172.21.15.26:0/1927786393 conn(0x559f5a198200 msgr2=0x559f5a19a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- 172.21.15.26:0/1927786393 shutdown_connections 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- 172.21.15.26:0/1927786393 wait complete. 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 -- start start 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.365+0000 7f0a17dde000 1 Processor -- start 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19c450 0x559f5a19d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19cd70 0x559f5a19d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559f59f66540 con 0x559f5a19c450 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f59fa9f00 con 0x559f5a1975a0 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559f59faf220 con 0x559f5a19cd70 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 10 client.0 _ll_register_callbacks cb 0x559f5a1469a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19c450 0x559f5a19d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19c450 0x559f5a19d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49144/0 (socket says 172.21.15.26:49144) 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/155336118 learned_addr learned my addr 172.21.15.26:0/155336118 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19cd70 0x559f5a19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19cd70 msgr2=0x559f5a19d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19cd70 0x559f5a19d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 msgr2=0x559f5a160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 -- 172.21.15.26:0/155336118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f59fb7570 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19c450 0x559f5a19d150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f09f80f0aa0 tx=0x7f09f80f07c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd04a9ce06415537 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f09ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f09ed7fa640 1 -- 172.21.15.26:0/155336118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f80c3040 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a080037a0 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f09ed7fa640 1 -- 172.21.15.26:0/155336118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f09f80ed410 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f09ed7fa640 1 -- 172.21.15.26:0/155336118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f09f80f98d0 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 10 client.4974 fetch_fsmap learned FSMap version 8 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559f59f50310 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f09ed7fa640 1 -- 172.21.15.26:0/155336118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a080037a0 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f09ed7fa640 1 -- 172.21.15.26:0/155336118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f09f80f01f0 con 0x559f5a19c450 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 10 client.4974 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 10 client.4974 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 20 client.4974 populate_metadata read hostname 'smithi026' 2024-04-21T09:10:23.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a195eb0 0x559f5a196290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 4 client.4974 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:10:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f59f44880 con 0x559f5a195eb0 2024-04-21T09:10:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a195eb0 0x559f5a196290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a195eb0 0x559f5a196290 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69aad33f757c437d server_cookie=8cc7d89bf59ecd0b in_seq=0 out_seq=0 2024-04-21T09:10:23.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.369+0000 7f09ed7fa640 10 client.4974 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f09ed7fa640 1 -- 172.21.15.26:0/155336118 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559f59f44880 con 0x559f5a195eb0 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f09ed7fa640 10 client.4974 handle_command_reply: tid=0 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 client.4974 shutdown 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19c450 msgr2=0x559f5a19d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19c450 0x559f5a19d150 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f09f80f0aa0 tx=0x7f09f80f07c0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 shutdown_connections 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a195eb0 0x559f5a196290 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19cd70 0x559f5a19d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19c450 0x559f5a19d150 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 --2- 172.21.15.26:0/155336118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 >> 172.21.15.26:0/155336118 conn(0x559f5a198200 msgr2=0x559f5a197980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f09ed7fa640 0 client.4974 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 shutdown_connections 2024-04-21T09:10:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 1 -- 172.21.15.26:0/155336118 wait complete. 2024-04-21T09:10:23.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.373+0000 7f0a17dde000 20 client.4974 trim_cache size 0 max 16384 2024-04-21T09:10:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 Processor -- start 2024-04-21T09:10:23.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- start start 2024-04-21T09:10:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a194ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a1b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a1b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0a10072fd0 con 0x559f5a19cd70 2024-04-21T09:10:23.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0a101402d0 con 0x559f5a1975a0 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0a10140920 con 0x559f5a19c450 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a1b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a1b8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49160/0 (socket says 172.21.15.26:49160) 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/1528770184 learned_addr learned my addr 172.21.15.26:0/1528770184 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a194ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a1b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 msgr2=0x559f5a1b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a1b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 msgr2=0x559f5a194ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a194ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/1528770184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f59f76ab0 con 0x559f5a19cd70 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a194ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:10:23.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a1b8cf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0a00003cc0 tx=0x7f0a00009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78d493fb352e3d63 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f09ef7fe640 1 -- 172.21.15.26:0/1528770184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00017820 con 0x559f5a19cd70 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f09ef7fe640 1 -- 172.21.15.26:0/1528770184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a000179c0 con 0x559f5a19cd70 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f09ef7fe640 1 -- 172.21.15.26:0/1528770184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00017d70 con 0x559f5a19cd70 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- 172.21.15.26:0/1528770184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 msgr2=0x559f5a1b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a1b8cf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f0a00003cc0 tx=0x7f0a00009750 comp rx=0 tx=0).stop 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- 172.21.15.26:0/1528770184 shutdown_connections 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a1b8cf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a1b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- 172.21.15.26:0/1528770184 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a194ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- 172.21.15.26:0/1528770184 >> 172.21.15.26:0/1528770184 conn(0x559f5a198200 msgr2=0x559f5a196290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- 172.21.15.26:0/1528770184 shutdown_connections 2024-04-21T09:10:23.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- 172.21.15.26:0/1528770184 wait complete. 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- start start 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 Processor -- start 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a2125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a212b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a2133f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559f59f41470 con 0x559f5a19cd70 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559f59fb7e00 con 0x559f5a1975a0 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559f59f6eb70 con 0x559f5a19c450 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a17dde000 10 client.0 _ll_register_callbacks cb 0x7f0a000099d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:10:23.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.393+0000 7f0a0ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a2133f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a2133f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49176/0 (socket says 172.21.15.26:49176) 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/4101367995 learned_addr learned my addr 172.21.15.26:0/4101367995 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a212b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a2125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 msgr2=0x559f5a212b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a212b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 msgr2=0x559f5a2125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a2125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 -- 172.21.15.26:0/4101367995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f5a02b660 con 0x559f5a19cd70 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0dd9b640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a212b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0ed9d640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a2133f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000b010 tx=0x7f0a00004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8682e3495c26639e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f09ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f09ed7fa640 1 -- 172.21.15.26:0/4101367995 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a0001f810 con 0x559f5a19cd70 2024-04-21T09:10:23.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f09ed7fa640 1 -- 172.21.15.26:0/4101367995 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f0a0002bb10 con 0x559f5a19cd70 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a000179c0 con 0x559f5a19cd70 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f09ed7fa640 1 -- 172.21.15.26:0/4101367995 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0a0002bd50 con 0x559f5a19cd70 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 10 client.4980 fetch_fsmap learned FSMap version 8 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559f59f406a0 con 0x559f5a19cd70 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f09ed7fa640 1 -- 172.21.15.26:0/4101367995 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a000179c0 con 0x559f5a19cd70 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f09ed7fa640 1 -- 172.21.15.26:0/4101367995 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0a0001f9b0 con 0x559f5a19cd70 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 10 client.4980 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 10 client.4980 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 20 client.4980 populate_metadata read hostname 'smithi026' 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a2142f0 0x559f5a214700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 4 client.4980 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.2, "await": true}] 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.2, "await": true}) -- 0x559f59fb8610 con 0x559f5a2142f0 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a2142f0 0x559f5a214700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:23.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f09ed7fa640 10 client.4980 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:23.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:23.397+0000 7f0a0e59c640 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a2142f0 0x559f5a214700 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5b1409c394f8a4d server_cookie=ef562f774937a6ae in_seq=0 out_seq=0 2024-04-21T09:10:24.447 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:10:24.450 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f09ed7fa640 1 -- 172.21.15.26:0/4101367995 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x559f59fb8610 con 0x559f5a2142f0 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f09ed7fa640 10 client.4980 handle_command_reply: tid=0 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 client.4980 shutdown 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 msgr2=0x559f5a2133f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a2133f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000b010 tx=0x7f0a00004ac0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 shutdown_connections 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559f5a2142f0 0x559f5a214700 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559f5a19cd70 0x559f5a2133f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559f5a19c450 0x559f5a212b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 --2- 172.21.15.26:0/4101367995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559f5a1975a0 0x559f5a2125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f09ed7fa640 0 client.4980 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 >> 172.21.15.26:0/4101367995 conn(0x559f5a198200 msgr2=0x559f5a193fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 shutdown_connections 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 1 -- 172.21.15.26:0/4101367995 wait complete. 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a17dde000 20 client.4980 trim_cache size 0 max 16384 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:10:28.508 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 14, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "42c47c49": { 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 14, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 79.2, 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:10:28.509 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:28.510 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:10:28.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f09f0068380 msgr2=0x7f09f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:28.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f09f0068380 0x7f09f006a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0a08001670 tx=0x7f0a08009040 comp rx=0 tx=0).stop 2024-04-21T09:10:28.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a1014f490 msgr2=0x7f0a101445a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:28.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a1014f490 0x7f0a101445a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f09f80ad040 tx=0x7f09f801ada0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 shutdown_connections 2024-04-21T09:10:28.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a10159400 0x7f0a10151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f09f0068380 0x7f09f006a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0a1014f490 0x7f0a101445a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 --2- 172.21.15.26:0/2512819854 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a10067af0 0x7f0a10150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 >> 172.21.15.26:0/2512819854 conn(0x7f0a100c92f0 msgr2=0x7f0a100c8630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 shutdown_connections 2024-04-21T09:10:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:28.509+0000 7f0a14c5c640 1 -- 172.21.15.26:0/2512819854 wait complete. 2024-04-21T09:10:28.539 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 42c47c49, quiesce duration: 19.2 2024-04-21T09:10:47.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:10:47.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f01206f3640 1 Processor -- start 2024-04-21T09:10:47.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f01206f3640 1 -- start start 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f01206f3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 0x7f01180c9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f01206f3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180c6050 con 0x7f01180c52b0 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f01206f3640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180c3470 con 0x7f0118073b50 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f01206f3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01180c5e00 con 0x7f01180c5690 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f01180c52b0 0x7f01181529d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51652/0 (socket says 172.21.15.26:51652) 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 -- 172.21.15.26:0/2992493937 learned_addr learned my addr 172.21.15.26:0/2992493937 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011ec90640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 0x7f01180c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3495299602 0 0) 0x7f01180c6050 con 0x7f01180c52b0 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0104003530 con 0x7f01180c52b0 2024-04-21T09:10:47.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2892218523 0 0) 0x7f0104003530 con 0x7f01180c52b0 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 msgr2=0x7f01180c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 0x7f01180c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 >> v1:172.21.15.169:6789/0 conn(0x7f0118073b50 legacy=0x7f011806ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01180c3750 con 0x7f01180c52b0 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f0114001680 con 0x7f01180c52b0 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 >> v1:172.21.15.26:6789/0 conn(0x7f01180c52b0 legacy=0x7f01181529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01040039f0 0x7f0104003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 0x7f0104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 0x7f01040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f01180c5e00 con 0x7f01040039f0 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f010400bb60 con 0x7f0104004d50 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f010400bd30 con 0x7f01180c5690 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01040039f0 0x7f0104003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011dc8e640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 0x7f0104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011ec90640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 0x7f01040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 -- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 msgr2=0x7f0104004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:47.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01180c5690 0x7f0104004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:47.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 -- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 msgr2=0x7f01040051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:47.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 0x7f01040051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:47.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.876+0000 7f011e48f640 1 -- 172.21.15.26:0/2992493937 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104003530 con 0x7f01040039f0 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f011e48f640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01040039f0 0x7f0104003df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f011400c270 tx=0x7f011401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a7793335723181 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114007d40 con 0x7f01040039f0 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01140a9070 con 0x7f01040039f0 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f011d48d640 1 -- 172.21.15.26:0/2992493937 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0114005d40 con 0x7f01040039f0 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 -- 172.21.15.26:0/2992493937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01040039f0 msgr2=0x7f0104003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 --2- 172.21.15.26:0/2992493937 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01040039f0 0x7f0104003df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f011400c270 tx=0x7f011401cca0 comp rx=0 tx=0).stop 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f011ec90640 1 -- 172.21.15.26:0/2992493937 reap_dead start 2024-04-21T09:10:47.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 -- 172.21.15.26:0/2992493937 shutdown_connections 2024-04-21T09:10:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 -- 172.21.15.26:0/2992493937 >> 172.21.15.26:0/2992493937 conn(0x7f01180c8960 msgr2=0x7f01180c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 -- 172.21.15.26:0/2992493937 shutdown_connections 2024-04-21T09:10:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 -- 172.21.15.26:0/2992493937 wait complete. 2024-04-21T09:10:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 Processor -- start 2024-04-21T09:10:47.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.880+0000 7f01206f3640 1 -- start start 2024-04-21T09:10:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01040039f0 0x7f0118161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01181472d0 0x7f01181477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0118147d10 0x7f01180be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0118159960 con 0x7f01181472d0 2024-04-21T09:10:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01181597e0 con 0x7f0118147d10 2024-04-21T09:10:47.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01180c6330 con 0x7f01040039f0 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01181472d0 0x7f01181477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01181472d0 0x7f01181477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38694/0 (socket says 172.21.15.26:38694) 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 -- 172.21.15.26:0/358098275 learned_addr learned my addr 172.21.15.26:0/358098275 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011e48f640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01040039f0 0x7f0118161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 -- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01040039f0 msgr2=0x7f0118161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01040039f0 0x7f0118161870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011ec90640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0118147d10 0x7f01180be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 -- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0118147d10 msgr2=0x7f01180be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0118147d10 0x7f01180be990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 -- 172.21.15.26:0/358098275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01181f7db0 con 0x7f01181472d0 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011e48f640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01040039f0 0x7f0118161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011dc8e640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01181472d0 0x7f01181477d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f010800d820 tx=0x7f010800dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f010effd640 1 -- 172.21.15.26:0/358098275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108005480 con 0x7f01181472d0 2024-04-21T09:10:47.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f010effd640 1 -- 172.21.15.26:0/358098275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0108017070 con 0x7f01181472d0 2024-04-21T09:10:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f010effd640 1 -- 172.21.15.26:0/358098275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010800b8d0 con 0x7f01181472d0 2024-04-21T09:10:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01181585c0 con 0x7f01181472d0 2024-04-21T09:10:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01181f72d0 con 0x7f01181472d0 2024-04-21T09:10:47.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0118075ef0 con 0x7f01181472d0 2024-04-21T09:10:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f010effd640 1 -- 172.21.15.26:0/358098275 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f010800ba70 con 0x7f01181472d0 2024-04-21T09:10:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f010effd640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00fc068380 0x7f00fc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f010effd640 1 -- 172.21.15.26:0/358098275 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f0108086970 con 0x7f01181472d0 2024-04-21T09:10:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011e48f640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00fc068380 0x7f00fc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:47.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.888+0000 7f011e48f640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00fc068380 0x7f00fc06a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01140ab000 tx=0x7f01140a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:47.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:47.892+0000 7f010effd640 1 -- 172.21.15.26:0/358098275 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0108019310 con 0x7f01181472d0 2024-04-21T09:10:48.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0118152780 con 0x7f01181472d0 2024-04-21T09:10:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f010effd640 1 -- 172.21.15.26:0/358098275 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f0108056ef0 con 0x7f01181472d0 2024-04-21T09:10:48.094 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:10:48.094 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:10:48.095 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:10:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00fc068380 msgr2=0x7f00fc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00fc068380 0x7f00fc06a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01140ab000 tx=0x7f01140a7070 comp rx=0 tx=0).stop 2024-04-21T09:10:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01181472d0 msgr2=0x7f01181477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01181472d0 0x7f01181477d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f010800d820 tx=0x7f010800dce0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 shutdown_connections 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0118147d10 0x7f01180be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00fc068380 0x7f00fc06a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01181472d0 0x7f01181477d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 --2- 172.21.15.26:0/358098275 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01040039f0 0x7f0118161870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 >> 172.21.15.26:0/358098275 conn(0x7f01180c8960 msgr2=0x7f011806eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 shutdown_connections 2024-04-21T09:10:48.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.092+0000 7f01206f3640 1 -- 172.21.15.26:0/358098275 wait complete. 2024-04-21T09:10:48.113 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id 42c47c49 --release --await' 2024-04-21T09:10:48.114 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id 42c47c49 --release --await 2024-04-21T09:10:48.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a92af5640 1 Processor -- start 2024-04-21T09:10:48.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a92af5640 1 -- start start 2024-04-21T09:10:48.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a92af5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a8c15ec80 0x7f9a8c0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a92af5640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9a8c0c8370 0x7f9a8c072a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a92af5640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c0c73c0 con 0x7f9a8c155190 2024-04-21T09:10:48.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a92af5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9a8c0c6260 con 0x7f9a8c15ec80 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a92af5640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9a8c0c76a0 con 0x7f9a8c0c8370 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a8bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a8c15ec80 0x7f9a8c0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a8bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9a8c15ec80 0x7f9a8c0c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38710/0 (socket says 172.21.15.26:38710) 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a8bfff640 1 -- 172.21.15.26:0/3591666965 learned_addr learned my addr 172.21.15.26:0/3591666965 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a91092640 1 --2- 172.21.15.26:0/3591666965 >> v2:172.21.15.169:3300/0 conn(0x7f9a8c0c8370 0x7f9a8c072a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a8bfff640 1 -- 172.21.15.26:0/3591666965 >> v2:172.21.15.169:3300/0 conn(0x7f9a8c0c8370 msgr2=0x7f9a8c072a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/3591666965 >> v2:172.21.15.169:3300/0 conn(0x7f9a8c0c8370 0x7f9a8c072a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a8bfff640 1 -- 172.21.15.26:0/3591666965 >> v1:172.21.15.169:6789/0 conn(0x7f9a8c155190 legacy=0x7f9a8c0c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a8bfff640 1 -- 172.21.15.26:0/3591666965 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c0c6600 con 0x7f9a8c15ec80 2024-04-21T09:10:48.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.240+0000 7f9a91092640 1 --2- 172.21.15.26:0/3591666965 >> v2:172.21.15.169:3300/0 conn(0x7f9a8c0c8370 0x7f9a8c072a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:10:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/3591666965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c0c7e30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0c79b0 tx=0x7f9a8001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5510f54d446eeec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a8b7fe640 1 -- 172.21.15.26:0/3591666965 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ab430 con 0x7f9a8c15ec80 2024-04-21T09:10:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a8b7fe640 1 -- 172.21.15.26:0/3591666965 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a800b0070 con 0x7f9a8c15ec80 2024-04-21T09:10:48.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a8b7fe640 1 -- 172.21.15.26:0/3591666965 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ab7f0 con 0x7f9a8c15ec80 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 -- 172.21.15.26:0/3591666965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 msgr2=0x7f9a8c0c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 --2- 172.21.15.26:0/3591666965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c0c7e30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0c79b0 tx=0x7f9a8001c520 comp rx=0 tx=0).stop 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 -- 172.21.15.26:0/3591666965 shutdown_connections 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 --2- 172.21.15.26:0/3591666965 >> v2:172.21.15.169:3300/0 conn(0x7f9a8c0c8370 0x7f9a8c072a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 --2- 172.21.15.26:0/3591666965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c0c7e30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 -- 172.21.15.26:0/3591666965 >> 172.21.15.26:0/3591666965 conn(0x7f9a8c0702c0 msgr2=0x7f9a8c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 -- 172.21.15.26:0/3591666965 shutdown_connections 2024-04-21T09:10:48.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 -- 172.21.15.26:0/3591666965 wait complete. 2024-04-21T09:10:48.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 Processor -- start 2024-04-21T09:10:48.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.244+0000 7f9a92af5640 1 -- start start 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a8c0c8370 0x7f9a8c15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a8c155190 0x7f9a8c0c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c1ece10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c167e00 con 0x7f9a8c15ec80 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c15f0d0 con 0x7f9a8c0c8370 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8c167f80 con 0x7f9a8c155190 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c1ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c1ece10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38714/0 (socket says 172.21.15.26:38714) 2024-04-21T09:10:48.250 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 -- 172.21.15.26:0/84323455 learned_addr learned my addr 172.21.15.26:0/84323455 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a8c155190 0x7f9a8c0c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a90891640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a8c0c8370 0x7f9a8c15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 -- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a8c155190 msgr2=0x7f9a8c0c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a8c155190 0x7f9a8c0c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 -- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a8c0c8370 msgr2=0x7f9a8c15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a8c0c8370 0x7f9a8c15daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 -- 172.21.15.26:0/84323455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c1f7720 con 0x7f9a8c15ec80 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a91092640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c1ece10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00e810 tx=0x7f9a7c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a897fa640 1 -- 172.21.15.26:0/84323455 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c017070 con 0x7f9a8c15ec80 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a897fa640 1 -- 172.21.15.26:0/84323455 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a7c00c6d0 con 0x7f9a8c15ec80 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a897fa640 1 -- 172.21.15.26:0/84323455 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c00f040 con 0x7f9a8c15ec80 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c1f79f0 con 0x7f9a8c15ec80 2024-04-21T09:10:48.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8c1f3c70 con 0x7f9a8c15ec80 2024-04-21T09:10:48.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a897fa640 1 -- 172.21.15.26:0/84323455 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9a7c01a070 con 0x7f9a8c15ec80 2024-04-21T09:10:48.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a897fa640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a78068380 0x7f9a7806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a897fa640 1 -- 172.21.15.26:0/84323455 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9a7c086620 con 0x7f9a8c15ec80 2024-04-21T09:10:48.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.248+0000 7f9a90891640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a78068380 0x7f9a7806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 Processor -- start 2024-04-21T09:10:48.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- start start 2024-04-21T09:10:48.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a90891640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a78068380 0x7f9a7806a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a84001d50 tx=0x7f9a84009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6b4e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b8a120 0x55fff6b8a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fff6996660 con 0x55fff6b4ef00 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fff693b5d0 con 0x55fff6b8a120 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55fff6992620 con 0x55fff6b858a0 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38722/0 (socket says 172.21.15.26:38722) 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 -- 172.21.15.26:0/1053942473 learned_addr learned my addr 172.21.15.26:0/1053942473 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a90891640 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6b4e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 -- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 msgr2=0x55fff6b4e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a91092640 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b8a120 0x55fff6b8a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6b4e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 -- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b8a120 msgr2=0x55fff6b8a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b8a120 0x55fff6b8a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 -- 172.21.15.26:0/1053942473 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff696fbd0 con 0x55fff6b4ef00 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4f2e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9a8001ca00 tx=0x7f9a80004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aa29cf38953ae83 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a727fc640 1 -- 172.21.15.26:0/1053942473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a800ba070 con 0x55fff6b4ef00 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a727fc640 1 -- 172.21.15.26:0/1053942473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a800b0040 con 0x55fff6b4ef00 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a727fc640 1 -- 172.21.15.26:0/1053942473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a800aba70 con 0x55fff6b4ef00 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- 172.21.15.26:0/1053942473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 msgr2=0x55fff6b4f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4f2e0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f9a8001ca00 tx=0x7f9a80004740 comp rx=0 tx=0).stop 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- 172.21.15.26:0/1053942473 shutdown_connections 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b8a120 0x55fff6b8a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4f2e0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- 172.21.15.26:0/1053942473 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6b4e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- 172.21.15.26:0/1053942473 >> 172.21.15.26:0/1053942473 conn(0x55fff6a30b00 msgr2=0x55fff6b87ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- 172.21.15.26:0/1053942473 shutdown_connections 2024-04-21T09:10:48.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- 172.21.15.26:0/1053942473 wait complete. 2024-04-21T09:10:48.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- start start 2024-04-21T09:10:48.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 Processor -- start 2024-04-21T09:10:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b84650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 0x55fff6b84b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 0x55fff6b49900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fff6a53d40 con 0x55fff6b4ef00 2024-04-21T09:10:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fff6950eb0 con 0x55fff6b858a0 2024-04-21T09:10:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55fff69912a0 con 0x55fff6b8a120 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a95c77000 10 client.0 _ll_register_callbacks cb 0x55fff6b34a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.252+0000 7f9a90891640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b84650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b84650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38738/0 (socket says 172.21.15.26:38738) 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 -- 172.21.15.26:0/660824964 learned_addr learned my addr 172.21.15.26:0/660824964 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 0x55fff6b84b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a91092640 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 0x55fff6b49900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 -- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 msgr2=0x55fff6b49900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 0x55fff6b49900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 -- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 msgr2=0x55fff6b84b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 0x55fff6b84b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 -- 172.21.15.26:0/660824964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fff69dcb30 con 0x55fff6b4ef00 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a90891640 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b84650 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400eb20 tx=0x7f9a84000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df8bd3452b9e541 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:10:48.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/660824964 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84027060 con 0x55fff6b4ef00 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/660824964 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9a84010040 con 0x55fff6b4ef00 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fff6930060 con 0x55fff6b4ef00 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/660824964 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9a84013420 con 0x55fff6b4ef00 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 10 client.4998 fetch_fsmap learned FSMap version 8 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55fff6935b70 con 0x55fff6b4ef00 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/660824964 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fff6930060 con 0x55fff6b4ef00 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/660824964 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f9a840226a0 con 0x55fff6b4ef00 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 10 client.4998 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 10 client.4998 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 20 client.4998 populate_metadata read hostname 'smithi026' 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6b4a5b0 0x55fff6b4a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 4 client.4998 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fff696ee30 con 0x55fff6b4a5b0 2024-04-21T09:10:48.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6b4a5b0 0x55fff6b4a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6b4a5b0 0x55fff6b4a9c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9b94eb562da5c40 server_cookie=b02637ce799d8f11 in_seq=0 out_seq=0 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 10 client.4998 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/660824964 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fff696ee30 con 0x55fff6b4a5b0 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 10 client.4998 handle_command_reply: tid=0 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 client.4998 shutdown 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 msgr2=0x55fff6b84650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b84650 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9a8400eb20 tx=0x7f9a84000f50 comp rx=0 tx=0).stop 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 shutdown_connections 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6b4a5b0 0x55fff6b4a9c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 0x55fff6b49900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 0x55fff6b84b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a6b7fe640 0 client.4998 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 --2- 172.21.15.26:0/660824964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b84650 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.256+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 >> 172.21.15.26:0/660824964 conn(0x55fff6a30b00 msgr2=0x55fff6b899a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.260+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 shutdown_connections 2024-04-21T09:10:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.260+0000 7f9a95c77000 1 -- 172.21.15.26:0/660824964 wait complete. 2024-04-21T09:10:48.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.260+0000 7f9a95c77000 20 client.4998 trim_cache size 0 max 16384 2024-04-21T09:10:48.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 Processor -- start 2024-04-21T09:10:48.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- start start 2024-04-21T09:10:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 0x55fff6b4d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 0x55fff6ba0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c1ff870 con 0x55fff6b4ef00 2024-04-21T09:10:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c153b50 con 0x55fff6b858a0 2024-04-21T09:10:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8c1ff250 con 0x55fff6b8a120 2024-04-21T09:10:48.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38748/0 (socket says 172.21.15.26:38748) 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 -- 172.21.15.26:0/2704254702 learned_addr learned my addr 172.21.15.26:0/2704254702 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 -- 172.21.15.26:0/2704254702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 msgr2=0x55fff6ba0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 --2- 172.21.15.26:0/2704254702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 0x55fff6ba0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 -- 172.21.15.26:0/2704254702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 msgr2=0x55fff6b4d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 --2- 172.21.15.26:0/2704254702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 0x55fff6b4d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 -- 172.21.15.26:0/2704254702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fff6a185e0 con 0x55fff6b4ef00 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a90891640 1 --2- 172.21.15.26:0/2704254702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4d230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009010 tx=0x7f9a8401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cdd1e537e79194 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a71ffb640 1 -- 172.21.15.26:0/2704254702 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840054a0 con 0x55fff6b4ef00 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a71ffb640 1 -- 172.21.15.26:0/2704254702 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8400e8a0 con 0x55fff6b4ef00 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a71ffb640 1 -- 172.21.15.26:0/2704254702 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84022bf0 con 0x55fff6b4ef00 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- 172.21.15.26:0/2704254702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 msgr2=0x55fff6b4d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 --2- 172.21.15.26:0/2704254702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4d230 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009010 tx=0x7f9a8401f000 comp rx=0 tx=0).stop 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- 172.21.15.26:0/2704254702 shutdown_connections 2024-04-21T09:10:48.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 --2- 172.21.15.26:0/2704254702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b8a120 0x55fff6ba0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 --2- 172.21.15.26:0/2704254702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b858a0 0x55fff6b4d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 --2- 172.21.15.26:0/2704254702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b4ef00 0x55fff6b4d230 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- 172.21.15.26:0/2704254702 >> 172.21.15.26:0/2704254702 conn(0x55fff6a30b00 msgr2=0x55fff6b85080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- 172.21.15.26:0/2704254702 shutdown_connections 2024-04-21T09:10:48.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.276+0000 7f9a95c77000 1 -- 172.21.15.26:0/2704254702 wait complete. 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- start start 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 Processor -- start 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b4ef00 0x55fff6ba3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6ba3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b8a120 0x55fff6ba41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fff6995970 con 0x55fff6b8a120 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55fff694b8f0 con 0x55fff6b4ef00 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x55fff699ac90 con 0x55fff6b858a0 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 10 client.0 _ll_register_callbacks cb 0x7f9a84001ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b8a120 0x55fff6ba41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b8a120 0x55fff6ba41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38760/0 (socket says 172.21.15.26:38760) 2024-04-21T09:10:48.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 -- 172.21.15.26:0/3395753688 learned_addr learned my addr 172.21.15.26:0/3395753688 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a90891640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b4ef00 0x55fff6ba3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6ba3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 -- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 msgr2=0x55fff6ba3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6ba3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 -- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b4ef00 msgr2=0x55fff6ba3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b4ef00 0x55fff6ba3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 -- 172.21.15.26:0/3395753688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fff6928ae0 con 0x55fff6b8a120 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a8bfff640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6ba3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a91092640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b8a120 0x55fff6ba41b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c056420 tx=0x7f9a7c056490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e225b724ae4f8d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/3395753688 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7c021040 con 0x55fff6b8a120 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/3395753688 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9a7c055ae0 con 0x55fff6b8a120 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a8400e8a0 con 0x55fff6b8a120 2024-04-21T09:10:48.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/3395753688 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9a7c0860c0 con 0x55fff6b8a120 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 10 client.5004 fetch_fsmap learned FSMap version 8 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55fff692bd80 con 0x55fff6b8a120 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/3395753688 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a8400e8a0 con 0x55fff6b8a120 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/3395753688 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f9a7c012050 con 0x55fff6b8a120 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 10 client.5004 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 10 client.5004 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 20 client.5004 populate_metadata read hostname 'smithi026' 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6c045a0 0x55fff6c06990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 4 client.5004 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "42c47c49", "release": true, "await": true}] 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "42c47c49", "release": true, "await": true}) -- 0x55fff69340d0 con 0x55fff6c045a0 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a90891640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6c045a0 0x55fff6c06990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a90891640 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6c045a0 0x55fff6c06990 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b18948e091fcb5b1 server_cookie=9a79adca6b1d4608 in_seq=0 out_seq=0 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 10 client.5004 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:48.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 1 -- 172.21.15.26:0/3395753688 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55fff69340d0 con 0x55fff6c045a0 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a6b7fe640 10 client.5004 handle_command_reply: tid=0 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 client.5004 shutdown 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b8a120 msgr2=0x55fff6ba41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.280+0000 7f9a95c77000 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b8a120 0x55fff6ba41b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c056420 tx=0x7f9a7c056490 comp rx=0 tx=0).stop 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 shutdown_connections 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55fff6c045a0 0x55fff6c06990 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fff6b8a120 0x55fff6ba41b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55fff6b858a0 0x55fff6ba3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a6b7fe640 0 client.5004 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 --2- 172.21.15.26:0/3395753688 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55fff6b4ef00 0x55fff6ba3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 >> 172.21.15.26:0/3395753688 conn(0x55fff6a30b00 msgr2=0x55fff6b48d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 shutdown_connections 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 1 -- 172.21.15.26:0/3395753688 wait complete. 2024-04-21T09:10:48.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a95c77000 20 client.5004 trim_cache size 0 max 16384 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 16, 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "42c47c49": { 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 16, 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:10:48.290 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 79.2, 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:48.291 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:10:48.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a78068380 msgr2=0x7f9a7806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a78068380 0x7f9a7806a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9a84001d50 tx=0x7f9a84009040 comp rx=0 tx=0).stop 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 msgr2=0x7f9a8c1ece10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c1ece10 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c00e810 tx=0x7f9a7c00ecd0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 shutdown_connections 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a78068380 0x7f9a7806a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a8c15ec80 0x7f9a8c1ece10 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a8c155190 0x7f9a8c0c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 --2- 172.21.15.26:0/84323455 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a8c0c8370 0x7f9a8c15daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 >> 172.21.15.26:0/84323455 conn(0x7f9a8c0702c0 msgr2=0x7f9a8c0c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 shutdown_connections 2024-04-21T09:10:48.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.284+0000 7f9a92af5640 1 -- 172.21.15.26:0/84323455 wait complete. 2024-04-21T09:10:48.302 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 42c47c49, seconds elapsed: 25.5 2024-04-21T09:10:48.302 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.2 2024-04-21T09:10:48.303 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:10:48.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 Processor -- start 2024-04-21T09:10:48.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- start start 2024-04-21T09:10:48.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff05c1589e0 0x7ff05c158e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff05c15a800 0x7ff05c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff05c071ff0 con 0x7ff05c14e1e0 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c0722d0 con 0x7ff05c15a800 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff05c0725b0 con 0x7ff05c1589e0 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff05c15a800 0x7ff05c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff05c15a800 0x7ff05c15ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38768/0 (socket says 172.21.15.26:38768) 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/2083842026 learned_addr learned my addr 172.21.15.26:0/2083842026 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff052ffd640 1 --2- 172.21.15.26:0/2083842026 >> v2:172.21.15.169:3300/0 conn(0x7ff05c1589e0 0x7ff05c158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/2083842026 >> v2:172.21.15.169:3300/0 conn(0x7ff05c1589e0 msgr2=0x7ff05c158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- 172.21.15.26:0/2083842026 >> v2:172.21.15.169:3300/0 conn(0x7ff05c1589e0 0x7ff05c158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/2083842026 >> v1:172.21.15.169:6789/0 conn(0x7ff05c14e1e0 legacy=0x7ff05c06de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/2083842026 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c072890 con 0x7ff05c15a800 2024-04-21T09:10:48.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- 172.21.15.26:0/2083842026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c15ac50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0c9a80 tx=0x7ff05401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1738f41cdb61c0db server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05affd640 1 -- 172.21.15.26:0/2083842026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a55f0 con 0x7ff05c15a800 2024-04-21T09:10:48.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05affd640 1 -- 172.21.15.26:0/2083842026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0540a5790 con 0x7ff05c15a800 2024-04-21T09:10:48.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05affd640 1 -- 172.21.15.26:0/2083842026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0540a5b60 con 0x7ff05c15a800 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- 172.21.15.26:0/2083842026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 msgr2=0x7ff05c15ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- 172.21.15.26:0/2083842026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c15ac50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff05c0c9a80 tx=0x7ff05401c9b0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- 172.21.15.26:0/2083842026 shutdown_connections 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- 172.21.15.26:0/2083842026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c15ac50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- 172.21.15.26:0/2083842026 >> v2:172.21.15.169:3300/0 conn(0x7ff05c1589e0 0x7ff05c158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- 172.21.15.26:0/2083842026 >> 172.21.15.26:0/2083842026 conn(0x7ff05c0c8960 msgr2=0x7ff05c0c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- 172.21.15.26:0/2083842026 shutdown_connections 2024-04-21T09:10:48.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- 172.21.15.26:0/2083842026 wait complete. 2024-04-21T09:10:48.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 Processor -- start 2024-04-21T09:10:48.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- start start 2024-04-21T09:10:48.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff05c14e1e0 0x7ff05c0c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff05c1589e0 0x7ff05c147620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c1f3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c0c9810 con 0x7ff05c15a800 2024-04-21T09:10:48.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff05c0c9690 con 0x7ff05c14e1e0 2024-04-21T09:10:48.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff0621c3640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff05c161b50 con 0x7ff05c1589e0 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c1f3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c1f3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38782/0 (socket says 172.21.15.26:38782) 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/4135299478 learned_addr learned my addr 172.21.15.26:0/4135299478 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff052ffd640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff05c1589e0 0x7ff05c147620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05b7fe640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff05c14e1e0 0x7ff05c0c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff05c1589e0 msgr2=0x7ff05c147620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff05c1589e0 0x7ff05c147620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff05c14e1e0 msgr2=0x7ff05c0c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff05c14e1e0 0x7ff05c0c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 -- 172.21.15.26:0/4135299478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff05c14dae0 con 0x7ff05c15a800 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05b7fe640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff05c14e1e0 0x7ff05c0c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.424+0000 7ff05bfff640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c1f3730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff0540af040 tx=0x7ff054019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff058ff9640 1 -- 172.21.15.26:0/4135299478 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0540bc020 con 0x7ff05c15a800 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff058ff9640 1 -- 172.21.15.26:0/4135299478 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0540b8670 con 0x7ff05c15a800 2024-04-21T09:10:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff05c0c6c80 con 0x7ff05c15a800 2024-04-21T09:10:48.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff058ff9640 1 -- 172.21.15.26:0/4135299478 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff054009510 con 0x7ff05c15a800 2024-04-21T09:10:48.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff05c0c8300 con 0x7ff05c15a800 2024-04-21T09:10:48.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff05c075ef0 con 0x7ff05c15a800 2024-04-21T09:10:48.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff058ff9640 1 -- 172.21.15.26:0/4135299478 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff0540bf020 con 0x7ff05c15a800 2024-04-21T09:10:48.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff058ff9640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff03c068380 0x7ff03c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff058ff9640 1 -- 172.21.15.26:0/4135299478 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7ff054121850 con 0x7ff05c15a800 2024-04-21T09:10:48.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff05b7fe640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff03c068380 0x7ff03c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.428+0000 7ff05b7fe640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff03c068380 0x7ff03c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff04c003ec0 tx=0x7ff04c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.436+0000 7ff058ff9640 1 -- 172.21.15.26:0/4135299478 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff0540c6030 con 0x7ff05c15a800 2024-04-21T09:10:48.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.632+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff05c06e600 con 0x7ff05c15a800 2024-04-21T09:10:48.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.632+0000 7ff058ff9640 1 -- 172.21.15.26:0/4135299478 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7ff0540165a0 con 0x7ff05c15a800 2024-04-21T09:10:48.636 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:10:48.636 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:10:48.636 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff03c068380 msgr2=0x7ff03c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff03c068380 0x7ff03c06a840 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff04c003ec0 tx=0x7ff04c009040 comp rx=0 tx=0).stop 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 msgr2=0x7ff05c1f3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c1f3730 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff0540af040 tx=0x7ff054019750 comp rx=0 tx=0).stop 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 shutdown_connections 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff03c068380 0x7ff03c06a840 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff05c15a800 0x7ff05c1f3730 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff05c1589e0 0x7ff05c147620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 --2- 172.21.15.26:0/4135299478 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff05c14e1e0 0x7ff05c0c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 >> 172.21.15.26:0/4135299478 conn(0x7ff05c0c8960 msgr2=0x7ff05c153f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 shutdown_connections 2024-04-21T09:10:48.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.640+0000 7ff0621c3640 1 -- 172.21.15.26:0/4135299478 wait complete. 2024-04-21T09:10:48.653 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 79.2 --await' 2024-04-21T09:10:48.653 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 79.2 --await 2024-04-21T09:10:48.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc111516640 1 Processor -- start 2024-04-21T09:10:48.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc111516640 1 -- start start 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc111516640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc10c152ca0 0x7fc10c06bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc111516640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c06c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc111516640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc10c15bd20 con 0x7fc10c1528c0 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc111516640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc10c158750 con 0x7fc10c152ca0 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc111516640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c0c6c80 con 0x7fc10c06fc00 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc10a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc10c152ca0 0x7fc10c06bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc10affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc10c1528c0 0x7fc10c158f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51668/0 (socket says 172.21.15.26:51668) 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc10affd640 1 -- 172.21.15.26:0/625890361 learned_addr learned my addr 172.21.15.26:0/625890361 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.784+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/625890361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c06c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc10a7fc640 1 -- 172.21.15.26:0/625890361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 msgr2=0x7fc10c06c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/625890361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c06c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc10a7fc640 1 -- 172.21.15.26:0/625890361 >> v1:172.21.15.26:6789/0 conn(0x7fc10c1528c0 legacy=0x7fc10c158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc10a7fc640 1 -- 172.21.15.26:0/625890361 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c0c6f60 con 0x7fc10c152ca0 2024-04-21T09:10:48.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc109ffb640 1 -- 172.21.15.26:0/625890361 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928199679 0 0) 0x7fc0fc001120 con 0x7fc10c1528c0 2024-04-21T09:10:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/625890361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c152ca0 0x7fc10c06bde0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc1000097c0 tx=0x7fc10001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca1817cabf533d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc109ffb640 1 -- 172.21.15.26:0/625890361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000b0070 con 0x7fc10c152ca0 2024-04-21T09:10:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc109ffb640 1 -- 172.21.15.26:0/625890361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1000ab600 con 0x7fc10c152ca0 2024-04-21T09:10:48.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc109ffb640 1 -- 172.21.15.26:0/625890361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000ab9d0 con 0x7fc10c152ca0 2024-04-21T09:10:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 -- 172.21.15.26:0/625890361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c152ca0 msgr2=0x7fc10c06bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 --2- 172.21.15.26:0/625890361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c152ca0 0x7fc10c06bde0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc1000097c0 tx=0x7fc10001c410 comp rx=0 tx=0).stop 2024-04-21T09:10:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 -- 172.21.15.26:0/625890361 shutdown_connections 2024-04-21T09:10:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 --2- 172.21.15.26:0/625890361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c06c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 --2- 172.21.15.26:0/625890361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c152ca0 0x7fc10c06bde0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 -- 172.21.15.26:0/625890361 >> 172.21.15.26:0/625890361 conn(0x7fc10c0c8d40 msgr2=0x7fc10c0c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 -- 172.21.15.26:0/625890361 shutdown_connections 2024-04-21T09:10:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.788+0000 7fc111516640 1 -- 172.21.15.26:0/625890361 wait complete. 2024-04-21T09:10:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 Processor -- start 2024-04-21T09:10:48.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 -- start start 2024-04-21T09:10:48.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c14faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c1528c0 0x7fc10c144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc10c152ca0 0x7fc10c0c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0c86b0 con 0x7fc10c1528c0 2024-04-21T09:10:48.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0c8530 con 0x7fc10c152ca0 2024-04-21T09:10:48.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c0c6840 con 0x7fc10c06fc00 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c1528c0 0x7fc10c144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c1528c0 0x7fc10c144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38798/0 (socket says 172.21.15.26:38798) 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 -- 172.21.15.26:0/2944114223 learned_addr learned my addr 172.21.15.26:0/2944114223 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10affd640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c14faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc10c152ca0 0x7fc10c0c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 -- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 msgr2=0x7fc10c14faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c14faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 -- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc10c152ca0 msgr2=0x7fc10c0c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc10c152ca0 0x7fc10c0c3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 -- 172.21.15.26:0/2944114223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10c0c51a0 con 0x7fc10c1528c0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c1528c0 0x7fc10c144f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc10001a040 tx=0x7fc10001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc0f37fe640 1 -- 172.21.15.26:0/2944114223 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000b0050 con 0x7fc10c1528c0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc0f37fe640 1 -- 172.21.15.26:0/2944114223 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1000bc070 con 0x7fc10c1528c0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10c158080 con 0x7fc10c1528c0 2024-04-21T09:10:48.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc0f37fe640 1 -- 172.21.15.26:0/2944114223 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1000b5830 con 0x7fc10c1528c0 2024-04-21T09:10:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc10c0728e0 con 0x7fc10c1528c0 2024-04-21T09:10:48.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.792+0000 7fc0f37fe640 1 -- 172.21.15.26:0/2944114223 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc1000b59d0 con 0x7fc10c1528c0 2024-04-21T09:10:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc0f37fe640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc0f8068380 0x7fc0f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc0f37fe640 1 -- 172.21.15.26:0/2944114223 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fc1001210e0 con 0x7fc10c1528c0 2024-04-21T09:10:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10affd640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc0f8068380 0x7fc0f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 Processor -- start 2024-04-21T09:10:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- start start 2024-04-21T09:10:48.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10affd640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc0f8068380 0x7fc0f806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc000f70 tx=0x7fc0fc007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x55916951a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951f450 0x55916951f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951fd70 0x559169520150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5591693c5650 con 0x55916951fd70 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55916932dbf0 con 0x55916951f450 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5591692d30c0 con 0x55916951a5a0 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951fd70 0x559169520150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951fd70 0x559169520150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38804/0 (socket says 172.21.15.26:38804) 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 -- 172.21.15.26:0/1340352916 learned_addr learned my addr 172.21.15.26:0/1340352916 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951f450 0x55916951f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10affd640 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x55916951a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 -- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 msgr2=0x55916951a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x55916951a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 -- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951f450 msgr2=0x55916951f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951f450 0x55916951f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 -- 172.21.15.26:0/1340352916 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591692effe0 con 0x55916951fd70 2024-04-21T09:10:48.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951fd70 0x559169520150 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc104009ee0 tx=0x7fc104003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29dacc6c8fdb4b18 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc0f0ff9640 1 -- 172.21.15.26:0/1340352916 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104004800 con 0x55916951fd70 2024-04-21T09:10:48.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc0f0ff9640 1 -- 172.21.15.26:0/1340352916 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10401a070 con 0x55916951fd70 2024-04-21T09:10:48.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc0f0ff9640 1 -- 172.21.15.26:0/1340352916 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc104015620 con 0x55916951fd70 2024-04-21T09:10:48.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- 172.21.15.26:0/1340352916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951fd70 msgr2=0x559169520150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951fd70 0x559169520150 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc104009ee0 tx=0x7fc104003d70 comp rx=0 tx=0).stop 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- 172.21.15.26:0/1340352916 shutdown_connections 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951fd70 0x559169520150 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951f450 0x55916951f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 --2- 172.21.15.26:0/1340352916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x55916951a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- 172.21.15.26:0/1340352916 >> 172.21.15.26:0/1340352916 conn(0x55916951b200 msgr2=0x55916951d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- 172.21.15.26:0/1340352916 shutdown_connections 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- 172.21.15.26:0/1340352916 wait complete. 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.796+0000 7fc114698000 1 -- start start 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 Processor -- start 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x5591694e3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951f450 0x559169520150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x559169520690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5591692e9540 con 0x55916951f450 2024-04-21T09:10:48.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55916932cf00 con 0x55916951fd70 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559169332220 con 0x55916951a5a0 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 10 client.0 _ll_register_callbacks cb 0x5591694c99a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951f450 0x559169520150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951f450 0x559169520150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38818/0 (socket says 172.21.15.26:38818) 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 -- 172.21.15.26:0/940644360 learned_addr learned my addr 172.21.15.26:0/940644360 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10affd640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x5591694e3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x559169520690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 -- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 msgr2=0x5591694e3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x5591694e3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 -- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 msgr2=0x559169520690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x559169520690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 -- 172.21.15.26:0/940644360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55916933a570 con 0x55916951f450 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x559169520690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:10:48.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951f450 0x559169520150 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1000f0fa0 tx=0x7fc1000191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a177081e95cad1 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc0e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/940644360 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc10011d060 con 0x55916951f450 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/940644360 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fc1000f96b0 con 0x55916951f450 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc10401a070 con 0x55916951f450 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/940644360 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc10010e050 con 0x55916951f450 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 10 client.5025 fetch_fsmap learned FSMap version 8 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5591692d3310 con 0x55916951f450 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/940644360 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc10401a070 con 0x55916951f450 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/940644360 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fc1000f0460 con 0x55916951f450 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 10 client.5025 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 10 client.5025 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 20 client.5025 populate_metadata read hostname 'smithi026' 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559169518eb0 0x559169519290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 4 client.5025 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:10:48.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591692c7880 con 0x559169518eb0 2024-04-21T09:10:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10affd640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559169518eb0 0x559169519290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc10affd640 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559169518eb0 0x559169519290 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b703e3f9e67a6f server_cookie=bbc328f7a4638d7a in_seq=0 out_seq=0 2024-04-21T09:10:48.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.800+0000 7fc0e9ffb640 10 client.5025 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:48.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.904+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/940644360 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5591692c7880 con 0x559169518eb0 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.904+0000 7fc0e9ffb640 10 client.5025 handle_command_reply: tid=0 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.904+0000 7fc114698000 1 client.5025 shutdown 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951f450 msgr2=0x559169520150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951f450 0x559169520150 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc1000f0fa0 tx=0x7fc1000191b0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 shutdown_connections 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559169518eb0 0x559169519290 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x559169520690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951f450 0x559169520150 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc0e9ffb640 0 client.5025 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 --2- 172.21.15.26:0/940644360 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951a5a0 0x5591694e3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 >> 172.21.15.26:0/940644360 conn(0x55916951b200 msgr2=0x55916951a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 shutdown_connections 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 1 -- 172.21.15.26:0/940644360 wait complete. 2024-04-21T09:10:48.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.908+0000 7fc114698000 20 client.5025 trim_cache size 0 max 16384 2024-04-21T09:10:48.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.936+0000 7fc114698000 1 Processor -- start 2024-04-21T09:10:48.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.936+0000 7fc114698000 1 -- start start 2024-04-21T09:10:48.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x559169519bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c1428d0 con 0x55916951a5a0 2024-04-21T09:10:48.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc10c0c2900 con 0x55916951fd70 2024-04-21T09:10:48.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc10c142280 con 0x55916951f450 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x559169519bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x559169519bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38834/0 (socket says 172.21.15.26:38834) 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 -- 172.21.15.26:0/3096510064 learned_addr learned my addr 172.21.15.26:0/3096510064 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 -- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 msgr2=0x55916953b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 -- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 msgr2=0x55916953bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 -- 172.21.15.26:0/3096510064 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591692f9ab0 con 0x55916951a5a0 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc10affd640 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x559169519bb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0015f0 tx=0x7fc0fc00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a389b4ed3d664872 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc0ebfff640 1 -- 172.21.15.26:0/3096510064 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc023a00 con 0x55916951a5a0 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc0ebfff640 1 -- 172.21.15.26:0/3096510064 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc023ba0 con 0x55916951a5a0 2024-04-21T09:10:48.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc0ebfff640 1 -- 172.21.15.26:0/3096510064 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0133f0 con 0x55916951a5a0 2024-04-21T09:10:48.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- 172.21.15.26:0/3096510064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 msgr2=0x559169519bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:48.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x559169519bb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc0015f0 tx=0x7fc0fc00c000 comp rx=0 tx=0).stop 2024-04-21T09:10:48.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- 172.21.15.26:0/3096510064 shutdown_connections 2024-04-21T09:10:48.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 --2- 172.21.15.26:0/3096510064 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x559169519bb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- 172.21.15.26:0/3096510064 >> 172.21.15.26:0/3096510064 conn(0x55916951b200 msgr2=0x559169519290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- 172.21.15.26:0/3096510064 shutdown_connections 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.940+0000 7fc114698000 1 -- 172.21.15.26:0/3096510064 wait complete. 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 -- start start 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 Processor -- start 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x55916953e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5591692c4470 con 0x55916951a5a0 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x55916933ae00 con 0x55916951fd70 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5591692f1b70 con 0x55916951f450 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 10 client.0 _ll_register_callbacks cb 0x7fc100009190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x55916953e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x55916953e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38844/0 (socket says 172.21.15.26:38844) 2024-04-21T09:10:48.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 -- 172.21.15.26:0/2217984976 learned_addr learned my addr 172.21.15.26:0/2217984976 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10b7fe640 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 -- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 msgr2=0x55916953ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 -- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 msgr2=0x55916953f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 -- 172.21.15.26:0/2217984976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591693ae660 con 0x55916951a5a0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10affd640 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x55916953e9e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009010 tx=0x7fc0fc000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a9826d00bd90ba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc0e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/2217984976 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc0136c0 con 0x55916951a5a0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/2217984976 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fc0fc010040 con 0x55916951a5a0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0fc023ba0 con 0x55916951a5a0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/2217984976 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc0fc03b050 con 0x55916951a5a0 2024-04-21T09:10:48.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 10 client.5031 fetch_fsmap learned FSMap version 8 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5591692c36a0 con 0x55916951a5a0 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/2217984976 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0fc023ba0 con 0x55916951a5a0 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/2217984976 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fc0fc03e020 con 0x55916951a5a0 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 10 client.5031 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 10 client.5031 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 20 client.5031 populate_metadata read hostname 'smithi026' 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55916953f9a0 0x55916953fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 4 client.5031 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.2, "await": true}] 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.2, "await": true}) -- 0x55916933b610 con 0x55916953f9a0 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55916953f9a0 0x55916953fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc0e9ffb640 10 client.5031 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:48.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:48.944+0000 7fc10a7fc640 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55916953f9a0 0x55916953fdb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d4f2739f9f56b13 server_cookie=61fadae83089abcf in_seq=0 out_seq=0 2024-04-21T09:10:54.610 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:10:54.613 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:10:56.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.592+0000 7fc0e9ffb640 1 -- 172.21.15.26:0/2217984976 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55916933b610 con 0x55916953f9a0 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.592+0000 7fc0e9ffb640 10 client.5031 handle_command_reply: tid=0 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.592+0000 7fc114698000 1 client.5031 shutdown 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 msgr2=0x55916953e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x55916953e9e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc009010 tx=0x7fc0fc000ee0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 shutdown_connections 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x55916953f9a0 0x55916953fdb0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55916951fd70 0x55916953f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55916951f450 0x55916953ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc0e9ffb640 0 client.5031 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 --2- 172.21.15.26:0/2217984976 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55916951a5a0 0x55916953e9e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 >> 172.21.15.26:0/2217984976 conn(0x55916951b200 msgr2=0x559169519290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:56.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 shutdown_connections 2024-04-21T09:10:56.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 1 -- 172.21.15.26:0/2217984976 wait complete. 2024-04-21T09:10:56.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc114698000 20 client.5031 trim_cache size 0 max 16384 2024-04-21T09:10:56.595 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:10:56.595 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:10:56.595 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 18, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "48a5e727": { 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 18, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 79.2, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:10:56.596 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:10:56.597 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc0f8068380 msgr2=0x7fc0f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc0f8068380 0x7fc0f806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc000f70 tx=0x7fc0fc007df0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c1528c0 msgr2=0x7fc10c144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c1528c0 0x7fc10c144f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc10001a040 tx=0x7fc10001ac50 comp rx=0 tx=0).stop 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 shutdown_connections 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc10c152ca0 0x7fc10c0c3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc0f8068380 0x7fc0f806a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc10c1528c0 0x7fc10c144f00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 --2- 172.21.15.26:0/2944114223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc10c06fc00 0x7fc10c14faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 >> 172.21.15.26:0/2944114223 conn(0x7fc10c0c8d40 msgr2=0x7fc10c0c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:10:56.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 shutdown_connections 2024-04-21T09:10:56.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:10:56.596+0000 7fc111516640 1 -- 172.21.15.26:0/2944114223 wait complete. 2024-04-21T09:10:56.622 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: 48a5e727, quiesce duration: 19.2 2024-04-21T09:11:15.824 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:11:15.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea710d640 1 Processor -- start 2024-04-21T09:11:15.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea710d640 1 -- start start 2024-04-21T09:11:15.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea710d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faea0154c70 0x7faea015b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea710d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea00c8da0 con 0x7faea006be50 2024-04-21T09:11:15.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea710d640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faea015bb60 con 0x7faea006b9e0 2024-04-21T09:11:15.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea710d640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7faea0155050 con 0x7faea0154c70 2024-04-21T09:11:15.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faea006be50 0x7faea00c8690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57018/0 (socket says 172.21.15.26:57018) 2024-04-21T09:11:15.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 -- 172.21.15.26:0/888262429 learned_addr learned my addr 172.21.15.26:0/888262429 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:11:15.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea4ea9640 1 --2- 172.21.15.26:0/888262429 >> v2:172.21.15.169:3300/0 conn(0x7faea0154c70 0x7faea015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3541188572 0 0) 0x7faea00c8da0 con 0x7faea006be50 2024-04-21T09:11:15.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae8c003530 con 0x7faea006be50 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3808676051 0 0) 0x7fae8c003530 con 0x7faea006be50 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 >> v2:172.21.15.169:3300/0 conn(0x7faea0154c70 msgr2=0x7faea015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 --2- 172.21.15.26:0/888262429 >> v2:172.21.15.169:3300/0 conn(0x7faea0154c70 0x7faea015b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 >> v1:172.21.15.169:6789/0 conn(0x7faea006b9e0 legacy=0x7faea00c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea00c75b0 con 0x7faea006be50 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7fae90001680 con 0x7faea006be50 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 >> v1:172.21.15.26:6789/0 conn(0x7faea006be50 legacy=0x7faea00c8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae8c0039c0 0x7fae8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c004810 0x7fae8c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0051d0 0x7fae8c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faea0155050 con 0x7fae8c0051d0 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00c0a0 con 0x7fae8c004810 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fae8c00c2a0 con 0x7fae8c0039c0 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0051d0 0x7fae8c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea4ea9640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae8c0039c0 0x7fae8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7fae9ffff640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c004810 0x7fae8c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 -- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae8c0039c0 msgr2=0x7fae8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae8c0039c0 0x7fae8c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 -- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c004810 msgr2=0x7fae8c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c004810 0x7fae8c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea56aa640 1 -- 172.21.15.26:0/888262429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c003530 con 0x7fae8c0051d0 2024-04-21T09:11:15.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.960+0000 7faea4ea9640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fae8c0039c0 0x7fae8c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea56aa640 1 -- 172.21.15.26:0/888262429 reap_dead start 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea56aa640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0051d0 0x7fae8c00b9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fae9000c240 tx=0x7fae9001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dfaae8891c6ff6b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90007d20 con 0x7fae8c0051d0 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae900a9070 con 0x7fae8c0051d0 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7fae9f7fe640 1 -- 172.21.15.26:0/888262429 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae900a5dc0 con 0x7fae8c0051d0 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea710d640 1 -- 172.21.15.26:0/888262429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0051d0 msgr2=0x7fae8c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea710d640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0051d0 0x7fae8c00b9d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fae9000c240 tx=0x7fae9001cc80 comp rx=0 tx=0).stop 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea710d640 1 -- 172.21.15.26:0/888262429 shutdown_connections 2024-04-21T09:11:15.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea710d640 1 --2- 172.21.15.26:0/888262429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae8c0051d0 0x7fae8c00b9d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea710d640 1 -- 172.21.15.26:0/888262429 >> 172.21.15.26:0/888262429 conn(0x7faea00702c0 msgr2=0x7faea00cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea710d640 1 -- 172.21.15.26:0/888262429 shutdown_connections 2024-04-21T09:11:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.964+0000 7faea710d640 1 -- 172.21.15.26:0/888262429 wait complete. 2024-04-21T09:11:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 Processor -- start 2024-04-21T09:11:15.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 -- start start 2024-04-21T09:11:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c0051d0 0x7faea01f1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faea0156b20 0x7faea01576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea014db90 0x7faea01f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faea0072aa0 con 0x7faea014db90 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7faea00727c0 con 0x7fae8c0051d0 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7faea0072d80 con 0x7faea0156b20 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea014db90 0x7faea01f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea014db90 0x7faea01f3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55704/0 (socket says 172.21.15.26:55704) 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 -- 172.21.15.26:0/4158842148 learned_addr learned my addr 172.21.15.26:0/4158842148 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7fae9ffff640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faea0156b20 0x7faea01576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea4ea9640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c0051d0 0x7faea01f1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 -- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faea0156b20 msgr2=0x7faea01576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faea0156b20 0x7faea01576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 -- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c0051d0 msgr2=0x7faea01f1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c0051d0 0x7faea01f1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:15.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 -- 172.21.15.26:0/4158842148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea01f42c0 con 0x7faea014db90 2024-04-21T09:11:15.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea56aa640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea014db90 0x7faea01f3620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fae9001d520 tx=0x7fae8c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:15.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7fae9d7fa640 1 -- 172.21.15.26:0/4158842148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90007d20 con 0x7faea014db90 2024-04-21T09:11:15.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7fae9d7fa640 1 -- 172.21.15.26:0/4158842148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae900b2020 con 0x7faea014db90 2024-04-21T09:11:15.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea0156040 con 0x7faea014db90 2024-04-21T09:11:15.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7fae9d7fa640 1 -- 172.21.15.26:0/4158842148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90004c00 con 0x7faea014db90 2024-04-21T09:11:15.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea0156600 con 0x7faea014db90 2024-04-21T09:11:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faea0075ef0 con 0x7faea014db90 2024-04-21T09:11:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7fae9d7fa640 1 -- 172.21.15.26:0/4158842148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae90007090 con 0x7faea014db90 2024-04-21T09:11:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.968+0000 7fae9d7fa640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae800683b0 0x7fae8006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.972+0000 7fae9d7fa640 1 -- 172.21.15.26:0/4158842148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fae9011ffa0 con 0x7faea014db90 2024-04-21T09:11:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.972+0000 7faea4ea9640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae800683b0 0x7fae8006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:15.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.972+0000 7faea4ea9640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae800683b0 0x7fae8006a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fae980098d0 tx=0x7fae98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:15.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:15.976+0000 7fae9d7fa640 1 -- 172.21.15.26:0/4158842148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae900bc030 con 0x7faea014db90 2024-04-21T09:11:16.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.172+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faea01567d0 con 0x7faea014db90 2024-04-21T09:11:16.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7fae9d7fa640 1 -- 172.21.15.26:0/4158842148 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fae90016990 con 0x7faea014db90 2024-04-21T09:11:16.173 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:11:16.173 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:11:16.174 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:11:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae800683b0 msgr2=0x7fae8006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae800683b0 0x7fae8006a870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fae980098d0 tx=0x7fae98008040 comp rx=0 tx=0).stop 2024-04-21T09:11:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea014db90 msgr2=0x7faea01f3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea014db90 0x7faea01f3620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fae9001d520 tx=0x7fae8c005840 comp rx=0 tx=0).stop 2024-04-21T09:11:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 shutdown_connections 2024-04-21T09:11:16.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fae800683b0 0x7fae8006a870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faea014db90 0x7faea01f3620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faea0156b20 0x7faea01576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 --2- 172.21.15.26:0/4158842148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fae8c0051d0 0x7faea01f1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 >> 172.21.15.26:0/4158842148 conn(0x7faea00702c0 msgr2=0x7faea0151940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 shutdown_connections 2024-04-21T09:11:16.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.176+0000 7faea710d640 1 -- 172.21.15.26:0/4158842148 wait complete. 2024-04-21T09:11:16.191 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id 48a5e727 --release --await' 2024-04-21T09:11:16.191 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id 48a5e727 --release --await 2024-04-21T09:11:16.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a4175f640 1 Processor -- start 2024-04-21T09:11:16.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a4175f640 1 -- start start 2024-04-21T09:11:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a4175f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 0x7f9a3c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a4175f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9a3c0cb340 0x7f9a3c0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a4175f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c15e260 con 0x7f9a3c154e70 2024-04-21T09:11:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a4175f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f9a3c15e540 con 0x7f9a3c0cb340 2024-04-21T09:11:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a4175f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c15e820 con 0x7f9a3c0cc8d0 2024-04-21T09:11:16.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9a3c154e70 0x7f9a3c0d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57020/0 (socket says 172.21.15.26:57020) 2024-04-21T09:11:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3affd640 1 -- 172.21.15.26:0/2353579767 learned_addr learned my addr 172.21.15.26:0/2353579767 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:11:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 0x7f9a3c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/2353579767 >> v2:172.21.15.169:3300/0 conn(0x7f9a3c0cb340 0x7f9a3c0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947042202 0 0) 0x7f9a3c15e260 con 0x7f9a3c154e70 2024-04-21T09:11:16.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a28003530 con 0x7f9a3c154e70 2024-04-21T09:11:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1769443271 0 0) 0x7f9a28003530 con 0x7f9a3c154e70 2024-04-21T09:11:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 msgr2=0x7f9a3c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 0x7f9a3c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 >> v2:172.21.15.169:3300/0 conn(0x7f9a3c0cb340 msgr2=0x7f9a3c0c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 --2- 172.21.15.26:0/2353579767 >> v2:172.21.15.169:3300/0 conn(0x7f9a3c0cb340 0x7f9a3c0c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c15eb00 con 0x7f9a3c154e70 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f9a24001a00 con 0x7f9a3c154e70 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 >> v1:172.21.15.26:6789/0 conn(0x7f9a3c154e70 legacy=0x7f9a3c0d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a280039c0 0x7f9a28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a28004810 0x7f9a28004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 0x7f9a280051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c15e540 con 0x7f9a28004810 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c15e820 con 0x7f9a280039c0 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a2800b9d0 con 0x7f9a3c0cc8d0 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a28004810 0x7f9a28004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3affd640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a280039c0 0x7f9a28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 0x7f9a280051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 msgr2=0x7f9a280051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a3c0cc8d0 0x7f9a280051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a280039c0 msgr2=0x7f9a28003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a280039c0 0x7f9a28003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.328+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/2353579767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a28003530 con 0x7f9a28004810 2024-04-21T09:11:16.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a28004810 0x7f9a28004c90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009ab0 tx=0x7f9a2c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ce71313f99c22c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:16.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0b2070 con 0x7f9a28004810 2024-04-21T09:11:16.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2c0a5560 con 0x7f9a28004810 2024-04-21T09:11:16.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a39ffb640 1 -- 172.21.15.26:0/2353579767 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0096b0 con 0x7f9a28004810 2024-04-21T09:11:16.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a4175f640 1 -- 172.21.15.26:0/2353579767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a28004810 msgr2=0x7f9a28004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a4175f640 1 --2- 172.21.15.26:0/2353579767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a28004810 0x7f9a28004c90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009ab0 tx=0x7f9a2c01ca50 comp rx=0 tx=0).stop 2024-04-21T09:11:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/2353579767 reap_dead start 2024-04-21T09:11:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a4175f640 1 -- 172.21.15.26:0/2353579767 shutdown_connections 2024-04-21T09:11:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a4175f640 1 -- 172.21.15.26:0/2353579767 >> 172.21.15.26:0/2353579767 conn(0x7f9a3c06de70 msgr2=0x7f9a3c06e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a4175f640 1 -- 172.21.15.26:0/2353579767 shutdown_connections 2024-04-21T09:11:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.332+0000 7f9a4175f640 1 -- 172.21.15.26:0/2353579767 wait complete. 2024-04-21T09:11:16.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 Processor -- start 2024-04-21T09:11:16.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 -- start start 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a28004810 0x7f9a3c14f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a3c14e3d0 0x7f9a3c14fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c14e810 0x7f9a3c150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c0d0a60 con 0x7f9a3c14e810 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c155250 con 0x7f9a3c14e3d0 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c0d0be0 con 0x7f9a28004810 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c14e810 0x7f9a3c150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c14e810 0x7f9a3c150790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55728/0 (socket says 172.21.15.26:55728) 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/1641528465 learned_addr learned my addr 172.21.15.26:0/1641528465 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3affd640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a28004810 0x7f9a3c14f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a3c14e3d0 0x7f9a3c14fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a28004810 msgr2=0x7f9a3c14f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a28004810 0x7f9a3c14f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a3c14e3d0 msgr2=0x7f9a3c14fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a3c14e3d0 0x7f9a3c14fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/1641528465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c1f13a0 con 0x7f9a3c14e810 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a3c14e3d0 0x7f9a3c14fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c14e810 0x7f9a3c150790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c08e160 tx=0x7f9a34011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a337fe640 1 -- 172.21.15.26:0/1641528465 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34004240 con 0x7f9a3c14e810 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a337fe640 1 -- 172.21.15.26:0/1641528465 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3401b070 con 0x7f9a3c14e810 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c1f1680 con 0x7f9a3c14e810 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a337fe640 1 -- 172.21.15.26:0/1641528465 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a3400f6c0 con 0x7f9a3c14e810 2024-04-21T09:11:16.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.336+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a3c1f4080 con 0x7f9a3c14e810 2024-04-21T09:11:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a337fe640 1 -- 172.21.15.26:0/1641528465 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9a34012040 con 0x7f9a3c14e810 2024-04-21T09:11:16.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a337fe640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a1c068380 0x7f9a1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a337fe640 1 -- 172.21.15.26:0/1641528465 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9a34086920 con 0x7f9a3c14e810 2024-04-21T09:11:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3affd640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a1c068380 0x7f9a1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 Processor -- start 2024-04-21T09:11:16.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 -- start start 2024-04-21T09:11:16.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3affd640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a1c068380 0x7f9a1c06a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a240018e0 tx=0x7f9a2400a060 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:16.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca12e8a0 0x5595ca0f79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca0f7f00 0x5595ca0f82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca133120 0x5595ca133500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5595c9f3f660 con 0x5595ca0f7f00 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5595c9ee45d0 con 0x5595ca12e8a0 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5595c9f3b620 con 0x5595ca133120 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca0f7f00 0x5595ca0f82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca0f7f00 0x5595ca0f82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55736/0 (socket says 172.21.15.26:55736) 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/40607176 learned_addr learned my addr 172.21.15.26:0/40607176 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3affd640 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca12e8a0 0x5595ca0f79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca133120 0x5595ca133500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca133120 msgr2=0x5595ca133500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca133120 0x5595ca133500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca12e8a0 msgr2=0x5595ca0f79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca12e8a0 0x5595ca0f79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/40607176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c9f18bd0 con 0x5595ca0f7f00 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca0f7f00 0x5595ca0f82e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c000c10 tx=0x7f9a2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258c364f1a52c9a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a30ff9640 1 -- 172.21.15.26:0/40607176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0b2040 con 0x5595ca0f7f00 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a30ff9640 1 -- 172.21.15.26:0/40607176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a2c0a5560 con 0x5595ca0f7f00 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.340+0000 7f9a30ff9640 1 -- 172.21.15.26:0/40607176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0a5930 con 0x5595ca0f7f00 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/40607176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca0f7f00 msgr2=0x5595ca0f82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca0f7f00 0x5595ca0f82e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c000c10 tx=0x7f9a2c004740 comp rx=0 tx=0).stop 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/40607176 shutdown_connections 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca133120 0x5595ca133500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca0f7f00 0x5595ca0f82e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- 172.21.15.26:0/40607176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca12e8a0 0x5595ca0f79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/40607176 >> 172.21.15.26:0/40607176 conn(0x5595c9fd9b00 msgr2=0x5595ca130ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/40607176 shutdown_connections 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/40607176 wait complete. 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- start start 2024-04-21T09:11:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 Processor -- start 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca12d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 0x5595ca12db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca0f2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5595c9ffcd40 con 0x5595ca133120 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5595c9ef9eb0 con 0x5595ca0f7f00 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5595c9f3a2a0 con 0x5595ca12e8a0 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 10 client.0 _ll_register_callbacks cb 0x5595ca0dda90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:11:16.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca0f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca0f2900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55746/0 (socket says 172.21.15.26:55746) 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3851940952 learned_addr learned my addr 172.21.15.26:0/3851940952 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 0x5595ca12db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3affd640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca12d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 msgr2=0x5595ca12db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 0x5595ca12db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 msgr2=0x5595ca12d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca12d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3851940952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c9f85b30 con 0x5595ca133120 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3affd640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca12d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca0f2900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a34000c10 tx=0x7f9a3405aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1d554cd722c874 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3851940952 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34054a30 con 0x5595ca133120 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3851940952 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9a3405f060 con 0x5595ca133120 2024-04-21T09:11:16.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5595c9ed9060 con 0x5595ca133120 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3851940952 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9a34055ac0 con 0x5595ca133120 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 10 client.5049 fetch_fsmap learned FSMap version 8 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5595c9edeb70 con 0x5595ca133120 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3851940952 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5595c9ed9060 con 0x5595ca133120 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3851940952 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f9a34055c60 con 0x5595ca133120 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 10 client.5049 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 10 client.5049 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 20 client.5049 populate_metadata read hostname 'smithi026' 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca0f3670 0x5595ca0f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 4 client.5049 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5595c9f17e30 con 0x5595ca0f3670 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.344+0000 7f9a3affd640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca0f3670 0x5595ca0f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a3affd640 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca0f3670 0x5595ca0f3a50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfdd68d482a8c2b1 server_cookie=10635bea94c1e3bf in_seq=0 out_seq=0 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a19ffb640 10 client.5049 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3851940952 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5595c9f17e30 con 0x5595ca0f3670 2024-04-21T09:11:16.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a19ffb640 10 client.5049 handle_command_reply: tid=0 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 client.5049 shutdown 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 msgr2=0x5595ca0f2900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca0f2900 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9a34000c10 tx=0x7f9a3405aae0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 shutdown_connections 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca0f3670 0x5595ca0f3a50 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca0f2900 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 0x5595ca12db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3851940952 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca12d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 >> 172.21.15.26:0/3851940952 conn(0x5595c9fd9b00 msgr2=0x5595ca1329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a19ffb640 0 client.5049 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 shutdown_connections 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 1 -- 172.21.15.26:0/3851940952 wait complete. 2024-04-21T09:11:16.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.348+0000 7f9a448e1000 20 client.5049 trim_cache size 0 max 16384 2024-04-21T09:11:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 Processor -- start 2024-04-21T09:11:16.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 -- start start 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 0x5595ca19d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca19d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c1fcaf0 con 0x5595ca133120 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3c150fb0 con 0x5595ca0f7f00 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9a3c1fc460 con 0x5595ca12e8a0 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca19d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a3b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca19d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55748/0 (socket says 172.21.15.26:55748) 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3818490466 learned_addr learned my addr 172.21.15.26:0/3818490466 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.364+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3818490466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 msgr2=0x5595ca19d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/3818490466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 0x5595ca19d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3818490466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 msgr2=0x5595ca19cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/3818490466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3b7fe640 1 -- 172.21.15.26:0/3818490466 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595c9fc15e0 con 0x5595ca133120 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3b7fe640 1 --2- 172.21.15.26:0/3818490466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca19d780 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a34052a80 tx=0x7f9a3406e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b89a9594774d2ce server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a1bfff640 1 -- 172.21.15.26:0/3818490466 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34054a30 con 0x5595ca133120 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a1bfff640 1 -- 172.21.15.26:0/3818490466 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3406d040 con 0x5595ca133120 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a1bfff640 1 -- 172.21.15.26:0/3818490466 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a34054710 con 0x5595ca133120 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3818490466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 msgr2=0x5595ca19d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3818490466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca19d780 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9a34052a80 tx=0x7f9a3406e000 comp rx=0 tx=0).stop 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3818490466 shutdown_connections 2024-04-21T09:11:16.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3818490466 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca133120 0x5595ca19d780 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3818490466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca12e8a0 0x5595ca19d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3818490466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca0f7f00 0x5595ca19cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3818490466 >> 172.21.15.26:0/3818490466 conn(0x5595c9fd9b00 msgr2=0x5595ca0f5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3818490466 shutdown_connections 2024-04-21T09:11:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3818490466 wait complete. 2024-04-21T09:11:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- start start 2024-04-21T09:11:16.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 Processor -- start 2024-04-21T09:11:16.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca0f7f00 0x5595ca14d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca12e8a0 0x5595ca14d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca133120 0x5595ca14dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5595c9f3e970 con 0x5595ca12e8a0 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5595c9ef48f0 con 0x5595ca133120 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5595c9f43c90 con 0x5595ca0f7f00 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 10 client.0 _ll_register_callbacks cb 0x7f9a340529d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca12e8a0 0x5595ca14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca12e8a0 0x5595ca14d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55760/0 (socket says 172.21.15.26:55760) 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/3414482269 learned_addr learned my addr 172.21.15.26:0/3414482269 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca0f7f00 msgr2=0x5595ca14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca0f7f00 0x5595ca14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca133120 msgr2=0x5595ca14dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca133120 0x5595ca14dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 -- 172.21.15.26:0/3414482269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595c9ed1ae0 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a3a7fc640 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca12e8a0 0x5595ca14d670 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c004780 tx=0x7f9a2c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c60d2259fad79f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3414482269 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c0b2040 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3414482269 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9a2c0c4b40 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a3406d040 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3414482269 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9a2c0c4d40 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 10 client.5055 fetch_fsmap learned FSMap version 8 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5595c9ed4d80 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3414482269 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a3406d040 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3414482269 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f9a2c004020 con 0x5595ca12e8a0 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 10 client.5055 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 10 client.5055 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 20 client.5055 populate_metadata read hostname 'smithi026' 2024-04-21T09:11:16.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca1ad5a0 0x5595ca1af990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 4 client.5055 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "48a5e727", "release": true, "await": true}] 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.368+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "48a5e727", "release": true, "await": true}) -- 0x5595c9edd0d0 con 0x5595ca1ad5a0 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a3affd640 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca1ad5a0 0x5595ca1af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a3affd640 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca1ad5a0 0x5595ca1af990 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621da44487a23630 server_cookie=a5dfd0ad7a7dd1fd in_seq=0 out_seq=0 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a19ffb640 10 client.5055 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a19ffb640 1 -- 172.21.15.26:0/3414482269 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5595c9edd0d0 con 0x5595ca1ad5a0 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a19ffb640 10 client.5055 handle_command_reply: tid=0 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 client.5055 shutdown 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca12e8a0 msgr2=0x5595ca14d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca12e8a0 0x5595ca14d670 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c004780 tx=0x7f9a2c0197f0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 shutdown_connections 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5595ca1ad5a0 0x5595ca1af990 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5595ca133120 0x5595ca14dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5595ca12e8a0 0x5595ca14d670 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 --2- 172.21.15.26:0/3414482269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5595ca0f7f00 0x5595ca14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a19ffb640 0 client.5055 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 >> 172.21.15.26:0/3414482269 conn(0x5595c9fd9b00 msgr2=0x5595ca0f62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 shutdown_connections 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 1 -- 172.21.15.26:0/3414482269 wait complete. 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a448e1000 20 client.5055 trim_cache size 0 max 16384 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:11:16.375 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 20, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "48a5e727": { 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 20, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 79.2, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:11:16.376 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:11:16.377 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:11:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a1c068380 msgr2=0x7f9a1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a1c068380 0x7f9a1c06a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9a240018e0 tx=0x7f9a2400a060 comp rx=0 tx=0).stop 2024-04-21T09:11:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c14e810 msgr2=0x7f9a3c150790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:11:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c14e810 0x7f9a3c150790 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c08e160 tx=0x7f9a34011cf0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 shutdown_connections 2024-04-21T09:11:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9a1c068380 0x7f9a1c06a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9a3c14e810 0x7f9a3c150790 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9a3c14e3d0 0x7f9a3c14fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 --2- 172.21.15.26:0/1641528465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9a28004810 0x7f9a3c14f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:11:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 >> 172.21.15.26:0/1641528465 conn(0x7f9a3c06de70 msgr2=0x7f9a3c152610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:11:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 shutdown_connections 2024-04-21T09:11:16.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:11:16.372+0000 7f9a4175f640 1 -- 172.21.15.26:0/1641528465 wait complete. 2024-04-21T09:11:16.387 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: 48a5e727, seconds elapsed: 28.1 2024-04-21T09:11:24.758 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:11:24.761 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:11:54.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:11:54.833 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:12:24.893 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:12:24.897 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:12:54.991 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:12:54.994 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:13:25.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:13:25.383 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:13:55.420 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:13:55.423 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:14:07.394 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 0% (117/13275) Updating files: 1% (133/13275) Updating files: 1% (224/13275) Updating files: 2% (266/13275) Updating files: 2% (299/13275) Updating files: 2% (303/13275) Updating files: 2% (304/13275) Updating files: 2% (313/13275) Updating files: 2% (314/13275) Updating files: 2% (366/13275) Updating files: 3% (399/13275) Updating files: 3% (464/13275) Updating files: 4% (531/13275) Updating files: 4% (563/13275) Updating files: 5% (664/13275) Updating files: 5% (665/13275) Updating files: 5% (742/13275) Updating files: 6% (797/13275) Updating files: 6% (851/13275) Updating files: 7% (930/13275) Updating files: 7% (940/13275) Updating files: 7% (992/13275) Updating files: 8% (1062/13275) Updating files: 8% (1082/13275) Updating files: 8% (1159/13275) Updating files: 9% (1195/13275) Updating files: 9% (1228/13275) Updating files: 9% (1322/13275) Updating files: 10% (1328/13275) Updating files: 10% (1396/13275) Updating files: 11% (1461/13275) Updating files: 11% (1474/13275) Updating files: 11% (1548/13275) Updating files: 12% (1593/13275) Updating files: 12% (1607/13275) Updating files: 12% (1662/13275) Updating files: 13% (1726/13275) Updating files: 13% (1734/13275) Updating files: 13% (1793/13275) Updating files: 13% (1857/13275) Updating files: 14% (1859/13275) Updating files: 14% (1936/13275) Updating files: 14% (1987/13275) Updating files: 15% (1992/13275) Updating files: 15% (2054/13275) Updating files: 15% (2115/13275) Updating files: 16% (2124/13275) Updating files: 16% (2182/13275) Updating files: 16% (2243/13275) Updating files: 17% (2257/13275) Updating files: 17% (2303/13275) Updating files: 17% (2362/13275) Updating files: 18% (2390/13275) Updating files: 18% (2413/13275) Updating files: 18% (2473/13275) Updating files: 19% (2523/13275) Updating files: 19% (2531/13275) Updating files: 19% (2588/13275) Updating files: 19% (2647/13275) Updating files: 20% (2655/13275) Updating files: 20% (2714/13275) Updating files: 20% (2775/13275) Updating files: 21% (2788/13275) Updating files: 21% (2816/13275) Updating files: 21% (2893/13275) Updating files: 22% (2921/13275) Updating files: 22% (2961/13275) Updating files: 22% (3023/13275) Updating files: 23% (3054/13275) Updating files: 23% (3095/13275) Updating files: 23% (3163/13275) Updating files: 24% (3186/13275) Updating files: 24% (3235/13275) Updating files: 25% (3319/13275) Updating files: 25% (3321/13275) Updating files: 25% (3396/13275) Updating files: 26% (3452/13275) Updating files: 26% (3469/13275) Updating files: 26% (3541/13275) Updating files: 27% (3585/13275) Updating files: 27% (3605/13275) Updating files: 27% (3671/13275) Updating files: 28% (3717/13275) Updating files: 28% (3737/13275) Updating files: 28% (3802/13275) Updating files: 29% (3850/13275) Updating files: 29% (3869/13275) Updating files: 29% (3932/13275) Updating files: 30% (3983/13275) Updating files: 30% (4006/13275) Updating files: 30% (4075/13275) Updating files: 31% (4116/13275) Updating files: 31% (4146/13275) Updating files: 31% (4219/13275) Updating files: 32% (4248/13275) Updating files: 32% (4285/13275) Updating files: 32% (4355/13275) Updating files: 33% (4381/13275) Updating files: 33% (4412/13275) Updating files: 33% (4475/13275) Updating files: 34% (4514/13275) Updating files: 34% (4541/13275) Updating files: 34% (4625/13275) Updating files: 35% (4647/13275) Updating files: 35% (4736/13275) Updating files: 36% (4779/13275) Updating files: 36% (4824/13275) Updating files: 36% (4909/13275) Updating files: 37% (4912/13275) Updating files: 37% (5013/13275) Updating files: 38% (5045/13275) Updating files: 38% (5080/13275) Updating files: 38% (5151/13275) Updating files: 39% (5178/13275) Updating files: 39% (5233/13275) Updating files: 39% (5297/13275) Updating files: 40% (5310/13275) Updating files: 40% (5352/13275) Updating files: 40% (5401/13275) Updating files: 41% (5443/13275) Updating files: 41% (5484/13275) Updating files: 41% (5565/13275) Updating files: 42% (5576/13275) Updating files: 42% (5641/13275) Updating files: 43% (5709/13275) Updating files: 43% (5729/13275) Updating files: 44% (5841/13275) Updating files: 44% (5859/13275) Updating files: 44% (5969/13275) Updating files: 45% (5974/13275) Updating files: 45% (6057/13275) Updating files: 46% (6107/13275) Updating files: 46% (6144/13275) Updating files: 46% (6230/13275) Updating files: 47% (6240/13275) Updating files: 47% (6318/13275) Updating files: 48% (6372/13275) Updating files: 48% (6407/13275) Updating files: 48% (6491/13275) Updating files: 49% (6505/13275) Updating files: 49% (6584/13275) Updating files: 50% (6638/13275) Updating files: 50% (6665/13275) Updating files: 50% (6749/13275) Updating files: 51% (6771/13275) Updating files: 51% (6848/13275) Updating files: 52% (6903/13275) Updating files: 52% (6937/13275) Updating files: 53% (7036/13275) Updating files: 53% (7040/13275) Updating files: 53% (7135/13275) Updating files: 54% (7169/13275) Updating files: 54% (7234/13275) Updating files: 55% (7302/13275) Updating files: 55% (7340/13275) Updating files: 56% (7434/13275) Updating files: 56% (7458/13275) Updating files: 56% (7551/13275) Updating files: 57% (7567/13275) Updating files: 57% (7673/13275) Updating files: 58% (7700/13275) Updating files: 58% (7760/13275) Updating files: 59% (7833/13275) Updating files: 59% (7852/13275) Updating files: 59% (7930/13275) Updating files: 60% (7965/13275) Updating files: 60% (7988/13275) Updating files: 60% (8073/13275) Updating files: 61% (8098/13275) Updating files: 61% (8130/13275) Updating files: 61% (8186/13275) Updating files: 62% (8231/13275) Updating files: 62% (8234/13275) Updating files: 62% (8282/13275) Updating files: 62% (8327/13275) Updating files: 63% (8364/13275) Updating files: 63% (8371/13275) Updating files: 63% (8420/13275) Updating files: 63% (8465/13275) Updating files: 64% (8496/13275) Updating files: 64% (8513/13275) Updating files: 64% (8555/13275) Updating files: 64% (8601/13275) Updating files: 65% (8629/13275) Updating files: 65% (8643/13275) Updating files: 65% (8691/13275) Updating files: 65% (8741/13275) Updating files: 66% (8762/13275) Updating files: 66% (8788/13275) Updating files: 66% (8838/13275) Updating files: 66% (8886/13275) Updating files: 67% (8895/13275) Updating files: 67% (8931/13275) Updating files: 67% (9016/13275) Updating files: 68% (9027/13275) Updating files: 68% (9066/13275) Updating files: 68% (9111/13275) Updating files: 68% (9156/13275) Updating files: 69% (9160/13275) Updating files: 69% (9202/13275) Updating files: 69% (9258/13275) Updating files: 70% (9293/13275) Updating files: 70% (9311/13275) Updating files: 70% (9397/13275) Updating files: 71% (9426/13275) Updating files: 71% (9481/13275) Updating files: 71% (9556/13275) Updating files: 72% (9558/13275) Updating files: 72% (9630/13275) Updating files: 73% (9691/13275) Updating files: 73% (9722/13275) Updating files: 73% (9787/13275) Updating files: 74% (9824/13275) Updating files: 74% (9858/13275) Updating files: 74% (9913/13275) Updating files: 75% (9957/13275) Updating files: 75% (9985/13275) Updating files: 75% (10065/13275) Updating files: 76% (10089/13275) Updating files: 76% (10149/13275) Updating files: 77% (10222/13275) Updating files: 77% (10249/13275) Updating files: 78% (10355/13275) Updating files: 78% (10377/13275) Updating files: 79% (10488/13275) Updating files: 79% (10509/13275) Updating files: 79% (10599/13275) Updating files: 80% (10620/13275) Updating files: 80% (10680/13275) Updating files: 81% (10753/13275) Updating files: 81% (10771/13275) Updating files: 81% (10849/13275) Updating files: 82% (10886/13275) Updating files: 82% (10924/13275) Updating files: 82% (10999/13275) Updating files: 83% (11019/13275) Updating files: 83% (11085/13275) Updating files: 84% (11151/13275) Updating files: 84% (11171/13275) Updating files: 84% (11257/13275) Updating files: 85% (11284/13275) Updating files: 85% (11350/13275) Updating files: 86% (11417/13275) Updating files: 86% (11422/13275) Updating files: 86% (11502/13275) Updating files: 87% (11550/13275) Updating files: 87% (11595/13275) Updating files: 87% (11678/13275) Updating files: 88% (11682/13275) Updating files: 88% (11773/13275) Updating files: 89% (11815/13275) Updating files: 89% (11880/13275) Updating files: 90% (11948/13275) Updating files: 90% (11974/13275) Updating files: 90% (12070/13275) Updating files: 91% (12081/13275) Updating files: 91% (12163/13275) Updating files: 92% (12213/13275) Updating files: 92% (12230/13275) Updating files: 92% (12322/13275) Updating files: 93% (12346/13275) Updating files: 93% (12439/13275) Updating files: 94% (12479/13275) Updating files: 94% (12573/13275) Updating files: 95% (12612/13275) Updating files: 95% (12712/13275) Updating files: 96% (12744/13275) Updating files: 96% (12799/13275) Updating files: 97% (12877/13275) Updating files: 97% (12896/13275) Updating files: 97% (12996/13275) Updating files: 98% (13010/13275) Updating files: 98% (13068/13275) Updating files: 98% (13127/13275) Updating files: 99% (13143/13275) Updating files: 99% (13198/13275) Updating files: 99% (13267/13275) Updating files: 100% (13275/13275) Updating files: 100% (13275/13275), done. 2024-04-21T09:14:07.627 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2024-04-21T09:14:07.636 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.1 2024-04-21T09:14:07.745 INFO:tasks.workunit.client.0.smithi026.stdout:v0.2 2024-04-21T09:14:07.746 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 2 -eq 48 ] 2024-04-21T09:14:07.746 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.2 2024-04-21T09:14:07.746 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.2 2024-04-21T09:14:07.746 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.2 2024-04-21T09:14:12.393 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 38% (86/222) Updating files: 39% (87/222) Updating files: 40% (89/222) Updating files: 41% (92/222) Updating files: 42% (94/222) Updating files: 43% (96/222) Updating files: 44% (98/222) Updating files: 45% (100/222) Updating files: 46% (103/222) Updating files: 47% (105/222) Updating files: 48% (107/222) Updating files: 49% (109/222) Updating files: 50% (111/222) Updating files: 51% (114/222) Updating files: 52% (116/222) Updating files: 53% (118/222) Updating files: 54% (120/222) Updating files: 55% (123/222) Updating files: 56% (125/222) Updating files: 57% (127/222) Updating files: 58% (129/222) Updating files: 59% (131/222) Updating files: 60% (134/222) Updating files: 61% (136/222) Updating files: 62% (138/222) Updating files: 63% (140/222) Updating files: 64% (143/222) Updating files: 65% (145/222) Updating files: 66% (147/222) Updating files: 67% (149/222) Updating files: 68% (151/222) Updating files: 69% (154/222) Updating files: 70% (156/222) Updating files: 71% (158/222) Updating files: 72% (160/222) Updating files: 73% (163/222) Updating files: 74% (165/222) Updating files: 75% (167/222) Updating files: 76% (169/222) Updating files: 77% (171/222) Updating files: 78% (174/222) Updating files: 79% (176/222) Updating files: 80% (178/222) Updating files: 81% (180/222) Updating files: 82% (183/222) Updating files: 83% (185/222) Updating files: 84% (187/222) Updating files: 85% (189/222) Updating files: 86% (191/222) Updating files: 87% (194/222) Updating files: 88% (196/222) Updating files: 89% (198/222) Updating files: 90% (200/222) Updating files: 91% (203/222) Updating files: 92% (205/222) Updating files: 93% (207/222) Updating files: 94% (209/222) Updating files: 95% (211/222) Updating files: 96% (214/222) Updating files: 97% (216/222) Updating files: 98% (218/222) Updating files: 99% (220/222) Updating files: 100% (222/222) Updating files: 100% (222/222), done. 2024-04-21T09:14:12.693 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 2b5f76f48e9 readme 2024-04-21T09:14:12.702 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.2 2024-04-21T09:14:12.855 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 3 -eq 48 ] 2024-04-21T09:14:12.855 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.3 2024-04-21T09:14:12.855 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.3 2024-04-21T09:14:12.855 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.3 2024-04-21T09:14:12.856 INFO:tasks.workunit.client.0.smithi026.stdout:v0.3 2024-04-21T09:14:18.142 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 30% (91/295) Updating files: 31% (92/295) Updating files: 32% (95/295) Updating files: 33% (98/295) Updating files: 34% (101/295) Updating files: 35% (104/295) Updating files: 36% (107/295) Updating files: 37% (110/295) Updating files: 38% (113/295) Updating files: 39% (116/295) Updating files: 40% (118/295) Updating files: 41% (121/295) Updating files: 42% (124/295) Updating files: 43% (127/295) Updating files: 44% (130/295) Updating files: 45% (133/295) Updating files: 46% (136/295) Updating files: 47% (139/295) Updating files: 48% (142/295) Updating files: 49% (145/295) Updating files: 50% (148/295) Updating files: 51% (151/295) Updating files: 52% (154/295) Updating files: 53% (157/295) Updating files: 54% (160/295) Updating files: 55% (163/295) Updating files: 56% (166/295) Updating files: 57% (169/295) Updating files: 57% (170/295) Updating files: 58% (172/295) Updating files: 59% (175/295) Updating files: 60% (177/295) Updating files: 61% (180/295) Updating files: 62% (183/295) Updating files: 63% (186/295) Updating files: 64% (189/295) Updating files: 65% (192/295) Updating files: 66% (195/295) Updating files: 67% (198/295) Updating files: 68% (201/295) Updating files: 69% (204/295) Updating files: 70% (207/295) Updating files: 71% (210/295) Updating files: 72% (213/295) Updating files: 73% (216/295) Updating files: 74% (219/295) Updating files: 75% (222/295) Updating files: 76% (225/295) Updating files: 77% (228/295) Updating files: 78% (231/295) Updating files: 79% (234/295) Updating files: 80% (236/295) Updating files: 81% (239/295) Updating files: 82% (242/295) Updating files: 83% (245/295) Updating files: 84% (248/295) Updating files: 85% (251/295) Updating files: 86% (254/295) Updating files: 87% (257/295) Updating files: 88% (260/295) Updating files: 89% (263/295) Updating files: 90% (266/295) Updating files: 91% (269/295) Updating files: 92% (272/295) Updating files: 93% (275/295) Updating files: 94% (278/295) Updating files: 95% (281/295) Updating files: 96% (284/295) Updating files: 97% (287/295) Updating files: 98% (290/295) Updating files: 99% (293/295) Updating files: 100% (295/295) Updating files: 100% (295/295), done. 2024-04-21T09:14:18.312 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 2e986fe9ddf include ceph.spec in configure.ac 2024-04-21T09:14:18.319 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.3 2024-04-21T09:14:18.453 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 4 -eq 48 ] 2024-04-21T09:14:18.454 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.4 2024-04-21T09:14:18.454 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.4 2024-04-21T09:14:18.454 INFO:tasks.workunit.client.0.smithi026.stdout:v0.4 2024-04-21T09:14:18.454 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.4 2024-04-21T09:14:23.512 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 34% (85/247) Updating files: 35% (87/247) Updating files: 36% (89/247) Updating files: 37% (92/247) Updating files: 38% (94/247) Updating files: 39% (97/247) Updating files: 40% (99/247) Updating files: 41% (102/247) Updating files: 42% (104/247) Updating files: 43% (107/247) Updating files: 44% (109/247) Updating files: 45% (112/247) Updating files: 46% (114/247) Updating files: 47% (117/247) Updating files: 48% (119/247) Updating files: 49% (122/247) Updating files: 50% (124/247) Updating files: 51% (126/247) Updating files: 52% (129/247) Updating files: 53% (131/247) Updating files: 54% (134/247) Updating files: 55% (136/247) Updating files: 56% (139/247) Updating files: 57% (141/247) Updating files: 58% (144/247) Updating files: 59% (146/247) Updating files: 60% (149/247) Updating files: 61% (151/247) Updating files: 62% (154/247) Updating files: 63% (156/247) Updating files: 63% (157/247) Updating files: 64% (159/247) Updating files: 65% (161/247) Updating files: 66% (164/247) Updating files: 67% (166/247) Updating files: 68% (168/247) Updating files: 69% (171/247) Updating files: 70% (173/247) Updating files: 71% (176/247) Updating files: 72% (178/247) Updating files: 73% (181/247) Updating files: 74% (183/247) Updating files: 75% (186/247) Updating files: 76% (188/247) Updating files: 77% (191/247) Updating files: 78% (193/247) Updating files: 79% (196/247) Updating files: 80% (198/247) Updating files: 81% (201/247) Updating files: 82% (203/247) Updating files: 83% (206/247) Updating files: 84% (208/247) Updating files: 85% (210/247) Updating files: 86% (213/247) Updating files: 87% (215/247) Updating files: 88% (218/247) Updating files: 89% (220/247) Updating files: 90% (223/247) Updating files: 91% (225/247) Updating files: 92% (228/247) Updating files: 93% (230/247) Updating files: 94% (233/247) Updating files: 95% (235/247) Updating files: 96% (238/247) Updating files: 97% (240/247) Updating files: 98% (243/247) Updating files: 99% (245/247) Updating files: 100% (247/247) Updating files: 100% (247/247), done. 2024-04-21T09:14:23.718 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 13b1bf7c492 kclient: initializing kaddr (merge fix) 2024-04-21T09:14:23.726 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.4 2024-04-21T09:14:23.847 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 5 -eq 48 ] 2024-04-21T09:14:23.847 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.5 2024-04-21T09:14:23.848 INFO:tasks.workunit.client.0.smithi026.stdout:v0.5 2024-04-21T09:14:23.848 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.5 2024-04-21T09:14:23.848 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.5 2024-04-21T09:14:25.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:14:25.753 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:14:28.615 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (88/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 61% (151/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 88% (217/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-21T09:14:28.862 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 1dd420957f9 journal: detect size of raw block devices properly 2024-04-21T09:14:28.866 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.5 2024-04-21T09:14:29.029 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 6 -eq 48 ] 2024-04-21T09:14:29.029 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.6 2024-04-21T09:14:29.029 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.6 2024-04-21T09:14:29.029 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.6 2024-04-21T09:14:29.029 INFO:tasks.workunit.client.0.smithi026.stdout:v0.6 2024-04-21T09:14:34.050 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 27% (63/227) Updating files: 28% (64/227) Updating files: 29% (66/227) Updating files: 30% (69/227) Updating files: 31% (71/227) Updating files: 32% (73/227) Updating files: 33% (75/227) Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 55% (127/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-04-21T09:14:34.271 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at a4c752df713 v0.6 2024-04-21T09:14:34.278 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.6 2024-04-21T09:14:34.457 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 7 -eq 48 ] 2024-04-21T09:14:34.458 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.7 2024-04-21T09:14:34.458 INFO:tasks.workunit.client.0.smithi026.stdout:v0.7 2024-04-21T09:14:34.459 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.7 2024-04-21T09:14:34.459 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.7 2024-04-21T09:14:39.002 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 37% (75/201) Updating files: 38% (77/201) Updating files: 39% (79/201) Updating files: 40% (81/201) Updating files: 41% (83/201) Updating files: 42% (85/201) Updating files: 43% (87/201) Updating files: 44% (89/201) Updating files: 45% (91/201) Updating files: 46% (93/201) Updating files: 47% (95/201) Updating files: 48% (97/201) Updating files: 49% (99/201) Updating files: 50% (101/201) Updating files: 51% (103/201) Updating files: 52% (105/201) Updating files: 53% (107/201) Updating files: 54% (109/201) Updating files: 55% (111/201) Updating files: 56% (113/201) Updating files: 57% (115/201) Updating files: 58% (117/201) Updating files: 59% (119/201) Updating files: 60% (121/201) Updating files: 61% (123/201) Updating files: 62% (125/201) Updating files: 63% (127/201) Updating files: 64% (129/201) Updating files: 65% (131/201) Updating files: 66% (133/201) Updating files: 67% (135/201) Updating files: 68% (137/201) Updating files: 69% (139/201) Updating files: 70% (141/201) Updating files: 70% (142/201) Updating files: 71% (143/201) Updating files: 72% (145/201) Updating files: 73% (147/201) Updating files: 74% (149/201) Updating files: 75% (151/201) Updating files: 76% (153/201) Updating files: 77% (155/201) Updating files: 78% (157/201) Updating files: 79% (159/201) Updating files: 80% (161/201) Updating files: 81% (163/201) Updating files: 82% (165/201) Updating files: 83% (167/201) Updating files: 84% (169/201) Updating files: 85% (171/201) Updating files: 86% (173/201) Updating files: 87% (175/201) Updating files: 88% (177/201) Updating files: 89% (179/201) Updating files: 90% (181/201) Updating files: 91% (183/201) Updating files: 92% (185/201) Updating files: 93% (187/201) Updating files: 94% (189/201) Updating files: 95% (191/201) Updating files: 96% (193/201) Updating files: 97% (195/201) Updating files: 98% (197/201) Updating files: 99% (199/201) Updating files: 100% (201/201) Updating files: 100% (201/201), done. 2024-04-21T09:14:39.188 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at c46e1b320c6 mkcephfs: btrfsctl -a between mkfs and mount 2024-04-21T09:14:39.193 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.7 2024-04-21T09:14:39.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 8 -eq 48 ] 2024-04-21T09:14:39.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.8 2024-04-21T09:14:39.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.8 2024-04-21T09:14:39.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.8 2024-04-21T09:14:39.513 INFO:tasks.workunit.client.0.smithi026.stdout:v0.8 2024-04-21T09:14:44.032 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 36% (83/225) Updating files: 37% (84/225) Updating files: 38% (86/225) Updating files: 39% (88/225) Updating files: 40% (90/225) Updating files: 41% (93/225) Updating files: 42% (95/225) Updating files: 43% (97/225) Updating files: 44% (99/225) Updating files: 45% (102/225) Updating files: 46% (104/225) Updating files: 47% (106/225) Updating files: 48% (108/225) Updating files: 49% (111/225) Updating files: 50% (113/225) Updating files: 51% (115/225) Updating files: 52% (117/225) Updating files: 53% (120/225) Updating files: 54% (122/225) Updating files: 55% (124/225) Updating files: 56% (126/225) Updating files: 57% (129/225) Updating files: 58% (131/225) Updating files: 59% (133/225) Updating files: 60% (135/225) Updating files: 61% (138/225) Updating files: 62% (140/225) Updating files: 63% (142/225) Updating files: 64% (144/225) Updating files: 65% (147/225) Updating files: 66% (149/225) Updating files: 67% (151/225) Updating files: 68% (153/225) Updating files: 69% (156/225) Updating files: 70% (158/225) Updating files: 71% (160/225) Updating files: 72% (162/225) Updating files: 72% (163/225) Updating files: 73% (165/225) Updating files: 74% (167/225) Updating files: 75% (169/225) Updating files: 76% (171/225) Updating files: 77% (174/225) Updating files: 78% (176/225) Updating files: 79% (178/225) Updating files: 80% (180/225) Updating files: 81% (183/225) Updating files: 82% (185/225) Updating files: 83% (187/225) Updating files: 84% (189/225) Updating files: 85% (192/225) Updating files: 86% (194/225) Updating files: 87% (196/225) Updating files: 88% (198/225) Updating files: 89% (201/225) Updating files: 90% (203/225) Updating files: 91% (205/225) Updating files: 92% (207/225) Updating files: 93% (210/225) Updating files: 94% (212/225) Updating files: 95% (214/225) Updating files: 96% (216/225) Updating files: 97% (219/225) Updating files: 98% (221/225) Updating files: 99% (223/225) Updating files: 100% (225/225) Updating files: 100% (225/225), done. 2024-04-21T09:14:44.203 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 284161c00ab kclient: kill dput/d_drop debug cruft 2024-04-21T09:14:44.210 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.8 2024-04-21T09:14:44.287 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 9 -eq 48 ] 2024-04-21T09:14:44.287 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.9 2024-04-21T09:14:44.287 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.9 2024-04-21T09:14:44.287 INFO:tasks.workunit.client.0.smithi026.stdout:v0.9 2024-04-21T09:14:44.288 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.9 2024-04-21T09:14:48.515 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 46% (90/193) Updating files: 47% (91/193) Updating files: 48% (93/193) Updating files: 49% (95/193) Updating files: 50% (97/193) Updating files: 51% (99/193) Updating files: 52% (101/193) Updating files: 53% (103/193) Updating files: 54% (105/193) Updating files: 55% (107/193) Updating files: 56% (109/193) Updating files: 57% (111/193) Updating files: 58% (112/193) Updating files: 59% (114/193) Updating files: 60% (116/193) Updating files: 61% (118/193) Updating files: 62% (120/193) Updating files: 63% (122/193) Updating files: 64% (124/193) Updating files: 65% (126/193) Updating files: 66% (128/193) Updating files: 67% (130/193) Updating files: 68% (132/193) Updating files: 69% (134/193) Updating files: 70% (136/193) Updating files: 71% (138/193) Updating files: 72% (139/193) Updating files: 73% (141/193) Updating files: 74% (143/193) Updating files: 75% (145/193) Updating files: 76% (147/193) Updating files: 77% (149/193) Updating files: 78% (151/193) Updating files: 79% (153/193) Updating files: 80% (155/193) Updating files: 81% (157/193) Updating files: 82% (159/193) Updating files: 83% (161/193) Updating files: 84% (163/193) Updating files: 84% (164/193) Updating files: 85% (165/193) Updating files: 86% (166/193) Updating files: 87% (168/193) Updating files: 88% (170/193) Updating files: 89% (172/193) Updating files: 90% (174/193) Updating files: 91% (176/193) Updating files: 92% (178/193) Updating files: 93% (180/193) Updating files: 94% (182/193) Updating files: 95% (184/193) Updating files: 96% (186/193) Updating files: 97% (188/193) Updating files: 98% (190/193) Updating files: 99% (192/193) Updating files: 100% (193/193) Updating files: 100% (193/193), done. 2024-04-21T09:14:48.695 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 41481853924 kclient: strip out kernel version compatibility cruft 2024-04-21T09:14:48.702 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.9 2024-04-21T09:14:48.878 INFO:tasks.workunit.client.0.smithi026.stdout:v0.10 2024-04-21T09:14:48.878 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 10 -eq 48 ] 2024-04-21T09:14:48.878 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.10 2024-04-21T09:14:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.10 2024-04-21T09:14:48.879 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.10 2024-04-21T09:14:52.694 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 47% (78/164) Updating files: 48% (79/164) Updating files: 49% (81/164) Updating files: 50% (82/164) Updating files: 51% (84/164) Updating files: 52% (86/164) Updating files: 53% (87/164) Updating files: 54% (89/164) Updating files: 55% (91/164) Updating files: 56% (92/164) Updating files: 57% (94/164) Updating files: 58% (96/164) Updating files: 59% (97/164) Updating files: 60% (99/164) Updating files: 61% (101/164) Updating files: 62% (102/164) Updating files: 63% (104/164) Updating files: 64% (105/164) Updating files: 65% (107/164) Updating files: 66% (109/164) Updating files: 67% (110/164) Updating files: 68% (112/164) Updating files: 69% (114/164) Updating files: 70% (115/164) Updating files: 71% (117/164) Updating files: 72% (119/164) Updating files: 73% (120/164) Updating files: 74% (122/164) Updating files: 75% (123/164) Updating files: 76% (125/164) Updating files: 77% (127/164) Updating files: 78% (128/164) Updating files: 79% (130/164) Updating files: 80% (132/164) Updating files: 81% (133/164) Updating files: 82% (135/164) Updating files: 83% (137/164) Updating files: 84% (138/164) Updating files: 85% (140/164) Updating files: 86% (142/164) Updating files: 87% (143/164) Updating files: 88% (145/164) Updating files: 89% (146/164) Updating files: 90% (148/164) Updating files: 91% (150/164) Updating files: 92% (151/164) Updating files: 93% (153/164) Updating files: 94% (155/164) Updating files: 95% (156/164) Updating files: 96% (158/164) Updating files: 97% (160/164) Updating files: 98% (161/164) Updating files: 99% (163/164) Updating files: 100% (164/164) Updating files: 100% (164/164), done. 2024-04-21T09:14:52.942 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 007313fe844 v0.10 2024-04-21T09:14:52.949 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.10 2024-04-21T09:14:53.096 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 11 -eq 48 ] 2024-04-21T09:14:53.096 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.11 2024-04-21T09:14:53.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.11 2024-04-21T09:14:53.097 INFO:tasks.workunit.client.0.smithi026.stdout:v0.11 2024-04-21T09:14:53.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.11 2024-04-21T09:14:55.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:14:55.800 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:14:55.958 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 97% (67/69) Updating files: 98% (68/69) Updating files: 100% (69/69) Updating files: 100% (69/69), done. 2024-04-21T09:14:56.301 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 9fa6f5e7d09 v0.11 2024-04-21T09:14:56.305 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.11 2024-04-21T09:14:56.578 INFO:tasks.workunit.client.0.smithi026.stdout:v0.12 2024-04-21T09:14:56.578 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 12 -eq 48 ] 2024-04-21T09:14:56.578 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.12 2024-04-21T09:14:56.579 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.12 2024-04-21T09:14:56.579 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.12 2024-04-21T09:14:59.302 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 86% (65/75) Updating files: 88% (66/75) Updating files: 89% (67/75) Updating files: 90% (68/75) Updating files: 92% (69/75) Updating files: 93% (70/75) Updating files: 94% (71/75) Updating files: 96% (72/75) Updating files: 97% (73/75) Updating files: 98% (74/75) Updating files: 100% (75/75) Updating files: 100% (75/75), done. 2024-04-21T09:14:59.449 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at f524150822a v0.12 2024-04-21T09:14:59.452 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.12 2024-04-21T09:14:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 13 -eq 48 ] 2024-04-21T09:14:59.667 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.13 2024-04-21T09:14:59.668 INFO:tasks.workunit.client.0.smithi026.stdout:v0.13 2024-04-21T09:14:59.668 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.13 2024-04-21T09:14:59.668 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.13 2024-04-21T09:15:03.070 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 51% (68/133) Updating files: 52% (70/133) Updating files: 53% (71/133) Updating files: 54% (72/133) Updating files: 55% (74/133) Updating files: 56% (75/133) Updating files: 57% (76/133) Updating files: 58% (78/133) Updating files: 59% (79/133) Updating files: 60% (80/133) Updating files: 61% (82/133) Updating files: 62% (83/133) Updating files: 63% (84/133) Updating files: 64% (86/133) Updating files: 65% (87/133) Updating files: 66% (88/133) Updating files: 67% (90/133) Updating files: 68% (91/133) Updating files: 69% (92/133) Updating files: 70% (94/133) Updating files: 71% (95/133) Updating files: 72% (96/133) Updating files: 73% (98/133) Updating files: 74% (99/133) Updating files: 75% (100/133) Updating files: 76% (102/133) Updating files: 77% (103/133) Updating files: 78% (104/133) Updating files: 79% (106/133) Updating files: 80% (107/133) Updating files: 81% (108/133) Updating files: 82% (110/133) Updating files: 83% (111/133) Updating files: 84% (112/133) Updating files: 85% (114/133) Updating files: 86% (115/133) Updating files: 87% (116/133) Updating files: 88% (118/133) Updating files: 89% (119/133) Updating files: 90% (120/133) Updating files: 91% (122/133) Updating files: 92% (123/133) Updating files: 93% (124/133) Updating files: 94% (126/133) Updating files: 95% (127/133) Updating files: 96% (128/133) Updating files: 97% (130/133) Updating files: 98% (131/133) Updating files: 99% (132/133) Updating files: 100% (133/133) Updating files: 100% (133/133), done. 2024-04-21T09:15:03.266 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 2b32297267d v0.13 2024-04-21T09:15:03.271 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.13 2024-04-21T09:15:03.463 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 14 -eq 48 ] 2024-04-21T09:15:03.463 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.14 2024-04-21T09:15:03.463 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.14 2024-04-21T09:15:03.464 INFO:tasks.workunit.client.0.smithi026.stdout:v0.14 2024-04-21T09:15:03.464 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.14 2024-04-21T09:15:07.320 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 47% (71/151) Updating files: 48% (73/151) Updating files: 49% (74/151) Updating files: 50% (76/151) Updating files: 51% (78/151) Updating files: 52% (79/151) Updating files: 53% (81/151) Updating files: 54% (82/151) Updating files: 55% (84/151) Updating files: 56% (85/151) Updating files: 57% (87/151) Updating files: 58% (88/151) Updating files: 59% (90/151) Updating files: 60% (91/151) Updating files: 61% (93/151) Updating files: 62% (94/151) Updating files: 63% (96/151) Updating files: 64% (97/151) Updating files: 65% (99/151) Updating files: 66% (100/151) Updating files: 67% (102/151) Updating files: 68% (103/151) Updating files: 69% (105/151) Updating files: 70% (106/151) Updating files: 71% (108/151) Updating files: 72% (109/151) Updating files: 73% (111/151) Updating files: 74% (112/151) Updating files: 75% (114/151) Updating files: 76% (115/151) Updating files: 77% (117/151) Updating files: 78% (118/151) Updating files: 79% (120/151) Updating files: 80% (121/151) Updating files: 81% (123/151) Updating files: 82% (124/151) Updating files: 83% (126/151) Updating files: 84% (127/151) Updating files: 85% (129/151) Updating files: 86% (130/151) Updating files: 87% (132/151) Updating files: 88% (133/151) Updating files: 89% (135/151) Updating files: 90% (136/151) Updating files: 90% (137/151) Updating files: 91% (138/151) Updating files: 92% (139/151) Updating files: 93% (141/151) Updating files: 94% (142/151) Updating files: 95% (144/151) Updating files: 96% (145/151) Updating files: 97% (147/151) Updating files: 98% (148/151) Updating files: 99% (150/151) Updating files: 100% (151/151) Updating files: 100% (151/151), done. 2024-04-21T09:15:07.529 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 1ec1e8d6fb6 v0.14 2024-04-21T09:15:07.533 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.14 2024-04-21T09:15:07.619 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 15 -eq 48 ] 2024-04-21T09:15:07.619 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.15 2024-04-21T09:15:07.619 INFO:tasks.workunit.client.0.smithi026.stdout:v0.15 2024-04-21T09:15:07.620 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.15 2024-04-21T09:15:07.620 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.15 2024-04-21T09:15:11.133 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 66% (74/112) Updating files: 67% (76/112) Updating files: 68% (77/112) Updating files: 69% (78/112) Updating files: 70% (79/112) Updating files: 71% (80/112) Updating files: 72% (81/112) Updating files: 73% (82/112) Updating files: 74% (83/112) Updating files: 75% (84/112) Updating files: 76% (86/112) Updating files: 77% (87/112) Updating files: 78% (88/112) Updating files: 79% (89/112) Updating files: 80% (90/112) Updating files: 81% (91/112) Updating files: 82% (92/112) Updating files: 83% (93/112) Updating files: 84% (95/112) Updating files: 85% (96/112) Updating files: 86% (97/112) Updating files: 87% (98/112) Updating files: 88% (99/112) Updating files: 89% (100/112) Updating files: 90% (101/112) Updating files: 91% (102/112) Updating files: 92% (104/112) Updating files: 93% (105/112) Updating files: 94% (106/112) Updating files: 95% (107/112) Updating files: 96% (108/112) Updating files: 97% (109/112) Updating files: 98% (110/112) Updating files: 99% (111/112) Updating files: 100% (112/112) Updating files: 100% (112/112), done. 2024-04-21T09:15:11.494 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at ab3c421eb95 v0.15 2024-04-21T09:15:11.498 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.15 2024-04-21T09:15:11.697 INFO:tasks.workunit.client.0.smithi026.stdout:v0.16 2024-04-21T09:15:11.698 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 16 -eq 48 ] 2024-04-21T09:15:11.698 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.16 2024-04-21T09:15:11.698 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.16 2024-04-21T09:15:11.698 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.16 2024-04-21T09:15:15.106 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 70% (75/107) Updating files: 71% (76/107) Updating files: 72% (78/107) Updating files: 73% (79/107) Updating files: 74% (80/107) Updating files: 75% (81/107) Updating files: 76% (82/107) Updating files: 77% (83/107) Updating files: 78% (84/107) Updating files: 79% (85/107) Updating files: 80% (86/107) Updating files: 81% (87/107) Updating files: 82% (88/107) Updating files: 83% (89/107) Updating files: 84% (90/107) Updating files: 85% (91/107) Updating files: 86% (93/107) Updating files: 87% (94/107) Updating files: 88% (95/107) Updating files: 89% (96/107) Updating files: 90% (97/107) Updating files: 91% (98/107) Updating files: 92% (99/107) Updating files: 93% (100/107) Updating files: 94% (101/107) Updating files: 95% (102/107) Updating files: 96% (103/107) Updating files: 97% (104/107) Updating files: 98% (105/107) Updating files: 99% (106/107) Updating files: 100% (107/107) Updating files: 100% (107/107), done. 2024-04-21T09:15:15.321 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 38dbaa5175c v0.16 2024-04-21T09:15:15.325 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.16 2024-04-21T09:15:15.472 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 17 -eq 48 ] 2024-04-21T09:15:15.472 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.17 2024-04-21T09:15:15.472 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.17 2024-04-21T09:15:15.472 INFO:tasks.workunit.client.0.smithi026.stdout:v0.17 2024-04-21T09:15:15.472 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.17 2024-04-21T09:15:19.720 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 50% (110/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-04-21T09:15:19.927 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at dac3a8c35fb v0.17 2024-04-21T09:15:19.929 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.17 2024-04-21T09:15:20.082 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 18 -eq 48 ] 2024-04-21T09:15:20.082 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.18 2024-04-21T09:15:20.082 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.18 2024-04-21T09:15:20.082 INFO:tasks.workunit.client.0.smithi026.stdout:v0.18 2024-04-21T09:15:20.083 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.18 2024-04-21T09:15:25.844 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:15:25.847 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:15:29.193 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 12% (97/779) Updating files: 13% (102/779) Updating files: 14% (110/779) Updating files: 15% (117/779) Updating files: 16% (125/779) Updating files: 17% (133/779) Updating files: 18% (141/779) Updating files: 19% (149/779) Updating files: 20% (156/779) Updating files: 21% (164/779) Updating files: 22% (172/779) Updating files: 23% (180/779) Updating files: 24% (187/779) Updating files: 24% (193/779) Updating files: 25% (195/779) Updating files: 26% (203/779) Updating files: 27% (211/779) Updating files: 28% (219/779) Updating files: 29% (226/779) Updating files: 30% (234/779) Updating files: 31% (242/779) Updating files: 32% (250/779) Updating files: 33% (258/779) Updating files: 34% (265/779) Updating files: 35% (273/779) Updating files: 36% (281/779) Updating files: 37% (289/779) Updating files: 38% (297/779) Updating files: 39% (304/779) Updating files: 40% (312/779) Updating files: 40% (315/779) Updating files: 41% (320/779) Updating files: 42% (328/779) Updating files: 43% (335/779) Updating files: 44% (343/779) Updating files: 45% (351/779) Updating files: 46% (359/779) Updating files: 47% (367/779) Updating files: 48% (374/779) Updating files: 49% (382/779) Updating files: 50% (390/779) Updating files: 51% (398/779) Updating files: 51% (403/779) Updating files: 52% (406/779) Updating files: 53% (413/779) Updating files: 54% (421/779) Updating files: 55% (429/779) Updating files: 56% (437/779) Updating files: 57% (445/779) Updating files: 58% (452/779) Updating files: 59% (460/779) Updating files: 60% (468/779) Updating files: 61% (476/779) Updating files: 62% (483/779) Updating files: 63% (491/779) Updating files: 63% (494/779) Updating files: 64% (499/779) Updating files: 65% (507/779) Updating files: 66% (515/779) Updating files: 67% (522/779) Updating files: 68% (530/779) Updating files: 69% (538/779) Updating files: 70% (546/779) Updating files: 71% (554/779) Updating files: 72% (561/779) Updating files: 73% (569/779) Updating files: 74% (577/779) Updating files: 75% (585/779) Updating files: 76% (593/779) Updating files: 77% (600/779) Updating files: 77% (601/779) Updating files: 78% (608/779) Updating files: 79% (616/779) Updating files: 80% (624/779) Updating files: 81% (631/779) Updating files: 82% (639/779) Updating files: 83% (647/779) Updating files: 84% (655/779) Updating files: 85% (663/779) Updating files: 86% (670/779) Updating files: 86% (673/779) Updating files: 87% (678/779) Updating files: 88% (686/779) Updating files: 89% (694/779) Updating files: 90% (702/779) Updating files: 91% (709/779) Updating files: 92% (717/779) Updating files: 93% (725/779) Updating files: 94% (733/779) Updating files: 95% (741/779) Updating files: 96% (748/779) Updating files: 96% (751/779) Updating files: 97% (756/779) Updating files: 98% (764/779) Updating files: 99% (772/779) Updating files: 100% (779/779) Updating files: 100% (779/779), done. 2024-04-21T09:15:29.641 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 2f10137986a v0.18 2024-04-21T09:15:29.647 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.18 2024-04-21T09:15:29.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 19 -eq 48 ] 2024-04-21T09:15:29.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.19 2024-04-21T09:15:29.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.19 2024-04-21T09:15:29.697 INFO:tasks.workunit.client.0.smithi026.stdout:v0.19 2024-04-21T09:15:29.697 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.19 2024-04-21T09:15:33.760 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (78/217) Updating files: 36% (79/217) Updating files: 37% (81/217) Updating files: 38% (83/217) Updating files: 39% (85/217) Updating files: 40% (87/217) Updating files: 41% (89/217) Updating files: 42% (92/217) Updating files: 43% (94/217) Updating files: 44% (96/217) Updating files: 45% (98/217) Updating files: 46% (100/217) Updating files: 47% (102/217) Updating files: 48% (105/217) Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 66% (145/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-04-21T09:15:34.009 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 98f5be53f85 v0.19 2024-04-21T09:15:34.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.19 2024-04-21T09:15:34.229 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 20 -eq 48 ] 2024-04-21T09:15:34.229 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.20 2024-04-21T09:15:34.230 INFO:tasks.workunit.client.0.smithi026.stdout:v0.20 2024-04-21T09:15:34.230 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.20 2024-04-21T09:15:34.230 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.20 2024-04-21T09:15:38.564 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (88/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 63% (156/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 87% (215/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-21T09:15:38.860 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 266d2076b6c debian: fix up debian scripts 2024-04-21T09:15:38.864 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.20 2024-04-21T09:15:38.971 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 21 -eq 48 ] 2024-04-21T09:15:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.21 2024-04-21T09:15:38.972 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.21 2024-04-21T09:15:38.972 INFO:tasks.workunit.client.0.smithi026.stdout:v0.21 2024-04-21T09:15:38.973 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.21 2024-04-21T09:15:46.761 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 19% (103/537) Updating files: 20% (108/537) Updating files: 21% (113/537) Updating files: 22% (119/537) Updating files: 23% (124/537) Updating files: 24% (129/537) Updating files: 25% (135/537) Updating files: 26% (140/537) Updating files: 27% (145/537) Updating files: 28% (151/537) Updating files: 29% (156/537) Updating files: 30% (162/537) Updating files: 31% (167/537) Updating files: 32% (172/537) Updating files: 33% (178/537) Updating files: 34% (183/537) Updating files: 34% (184/537) Updating files: 35% (188/537) Updating files: 36% (194/537) Updating files: 37% (199/537) Updating files: 38% (205/537) Updating files: 39% (210/537) Updating files: 40% (215/537) Updating files: 41% (221/537) Updating files: 42% (226/537) Updating files: 43% (231/537) Updating files: 44% (237/537) Updating files: 45% (242/537) Updating files: 46% (248/537) Updating files: 46% (252/537) Updating files: 47% (253/537) Updating files: 48% (258/537) Updating files: 49% (264/537) Updating files: 50% (269/537) Updating files: 51% (274/537) Updating files: 52% (280/537) Updating files: 53% (285/537) Updating files: 54% (290/537) Updating files: 55% (296/537) Updating files: 56% (301/537) Updating files: 57% (307/537) Updating files: 58% (312/537) Updating files: 59% (317/537) Updating files: 60% (323/537) Updating files: 60% (324/537) Updating files: 61% (328/537) Updating files: 62% (333/537) Updating files: 63% (339/537) Updating files: 64% (344/537) Updating files: 65% (350/537) Updating files: 66% (355/537) Updating files: 67% (360/537) Updating files: 68% (366/537) Updating files: 69% (371/537) Updating files: 70% (376/537) Updating files: 71% (382/537) Updating files: 72% (387/537) Updating files: 72% (389/537) Updating files: 73% (393/537) Updating files: 74% (398/537) Updating files: 75% (403/537) Updating files: 76% (409/537) Updating files: 77% (414/537) Updating files: 78% (419/537) Updating files: 79% (425/537) Updating files: 80% (430/537) Updating files: 81% (435/537) Updating files: 82% (441/537) Updating files: 83% (446/537) Updating files: 84% (452/537) Updating files: 85% (457/537) Updating files: 86% (462/537) Updating files: 87% (468/537) Updating files: 88% (473/537) Updating files: 89% (478/537) Updating files: 90% (484/537) Updating files: 91% (489/537) Updating files: 92% (495/537) Updating files: 93% (500/537) Updating files: 94% (505/537) Updating files: 95% (511/537) Updating files: 96% (516/537) Updating files: 97% (521/537) Updating files: 97% (526/537) Updating files: 98% (527/537) Updating files: 99% (532/537) Updating files: 100% (537/537) Updating files: 100% (537/537), done. 2024-04-21T09:15:47.125 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 090436f56ac v0.21 2024-04-21T09:15:47.132 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.21 2024-04-21T09:15:47.179 INFO:tasks.workunit.client.0.smithi026.stdout:v0.22 2024-04-21T09:15:47.179 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 22 -eq 48 ] 2024-04-21T09:15:47.179 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.22 2024-04-21T09:15:47.179 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.22 2024-04-21T09:15:47.179 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.22 2024-04-21T09:15:51.115 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 39% (80/204) Updating files: 40% (82/204) Updating files: 41% (84/204) Updating files: 42% (86/204) Updating files: 43% (88/204) Updating files: 44% (90/204) Updating files: 45% (92/204) Updating files: 46% (94/204) Updating files: 47% (96/204) Updating files: 48% (98/204) Updating files: 49% (100/204) Updating files: 50% (102/204) Updating files: 51% (105/204) Updating files: 52% (107/204) Updating files: 53% (109/204) Updating files: 54% (111/204) Updating files: 55% (113/204) Updating files: 56% (115/204) Updating files: 57% (117/204) Updating files: 58% (119/204) Updating files: 59% (121/204) Updating files: 60% (123/204) Updating files: 61% (125/204) Updating files: 62% (127/204) Updating files: 63% (129/204) Updating files: 64% (131/204) Updating files: 65% (133/204) Updating files: 66% (135/204) Updating files: 67% (137/204) Updating files: 68% (139/204) Updating files: 69% (141/204) Updating files: 70% (143/204) Updating files: 71% (145/204) Updating files: 72% (147/204) Updating files: 73% (149/204) Updating files: 74% (151/204) Updating files: 75% (153/204) Updating files: 76% (156/204) Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2024-04-21T09:15:51.437 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 8a7c95f60ad v0.22 2024-04-21T09:15:51.443 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.22 2024-04-21T09:15:51.650 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 23 -eq 48 ] 2024-04-21T09:15:51.650 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.23 2024-04-21T09:15:51.650 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.23 2024-04-21T09:15:51.650 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.23 2024-04-21T09:15:51.650 INFO:tasks.workunit.client.0.smithi026.stdout:v0.23 2024-04-21T09:15:54.948 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 45% (74/163) Updating files: 46% (75/163) Updating files: 47% (77/163) Updating files: 48% (79/163) Updating files: 49% (80/163) Updating files: 50% (82/163) Updating files: 51% (84/163) Updating files: 52% (85/163) Updating files: 53% (87/163) Updating files: 54% (89/163) Updating files: 55% (90/163) Updating files: 56% (92/163) Updating files: 57% (93/163) Updating files: 58% (95/163) Updating files: 59% (97/163) Updating files: 60% (98/163) Updating files: 61% (100/163) Updating files: 62% (102/163) Updating files: 63% (103/163) Updating files: 64% (105/163) Updating files: 65% (106/163) Updating files: 66% (108/163) Updating files: 67% (110/163) Updating files: 68% (111/163) Updating files: 69% (113/163) Updating files: 70% (115/163) Updating files: 71% (116/163) Updating files: 72% (118/163) Updating files: 73% (119/163) Updating files: 74% (121/163) Updating files: 75% (123/163) Updating files: 76% (124/163) Updating files: 77% (126/163) Updating files: 78% (128/163) Updating files: 79% (129/163) Updating files: 80% (131/163) Updating files: 81% (133/163) Updating files: 82% (134/163) Updating files: 83% (136/163) Updating files: 84% (137/163) Updating files: 85% (139/163) Updating files: 86% (141/163) Updating files: 87% (142/163) Updating files: 88% (144/163) Updating files: 89% (146/163) Updating files: 90% (147/163) Updating files: 91% (149/163) Updating files: 92% (150/163) Updating files: 93% (152/163) Updating files: 94% (154/163) Updating files: 95% (155/163) Updating files: 96% (157/163) Updating files: 97% (159/163) Updating files: 98% (160/163) Updating files: 99% (162/163) Updating files: 100% (163/163) Updating files: 100% (163/163), done. 2024-04-21T09:15:55.147 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 5d1d8d0c460 v0.23 2024-04-21T09:15:55.152 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.23 2024-04-21T09:15:55.278 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 24 -eq 48 ] 2024-04-21T09:15:55.278 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.24 2024-04-21T09:15:55.278 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.24 2024-04-21T09:15:55.278 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.24 2024-04-21T09:15:55.279 INFO:tasks.workunit.client.0.smithi026.stdout:v0.24 2024-04-21T09:15:55.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:15:55.978 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:15:59.274 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 36% (67/185) Updating files: 37% (69/185) Updating files: 38% (71/185) Updating files: 39% (73/185) Updating files: 40% (74/185) Updating files: 41% (76/185) Updating files: 42% (78/185) Updating files: 43% (80/185) Updating files: 44% (82/185) Updating files: 45% (84/185) Updating files: 46% (86/185) Updating files: 47% (87/185) Updating files: 48% (89/185) Updating files: 49% (91/185) Updating files: 50% (93/185) Updating files: 51% (95/185) Updating files: 52% (97/185) Updating files: 53% (99/185) Updating files: 54% (100/185) Updating files: 55% (102/185) Updating files: 56% (104/185) Updating files: 57% (106/185) Updating files: 58% (108/185) Updating files: 59% (110/185) Updating files: 60% (111/185) Updating files: 61% (113/185) Updating files: 62% (115/185) Updating files: 63% (117/185) Updating files: 64% (119/185) Updating files: 65% (121/185) Updating files: 66% (123/185) Updating files: 67% (124/185) Updating files: 68% (126/185) Updating files: 69% (128/185) Updating files: 69% (129/185) Updating files: 70% (130/185) Updating files: 71% (132/185) Updating files: 72% (134/185) Updating files: 73% (136/185) Updating files: 74% (137/185) Updating files: 75% (139/185) Updating files: 76% (141/185) Updating files: 77% (143/185) Updating files: 78% (145/185) Updating files: 79% (147/185) Updating files: 80% (148/185) Updating files: 81% (150/185) Updating files: 82% (152/185) Updating files: 83% (154/185) Updating files: 84% (156/185) Updating files: 85% (158/185) Updating files: 86% (160/185) Updating files: 87% (161/185) Updating files: 88% (163/185) Updating files: 89% (165/185) Updating files: 90% (167/185) Updating files: 91% (169/185) Updating files: 92% (171/185) Updating files: 93% (173/185) Updating files: 94% (174/185) Updating files: 95% (176/185) Updating files: 96% (178/185) Updating files: 97% (180/185) Updating files: 98% (182/185) Updating files: 99% (184/185) Updating files: 100% (185/185) Updating files: 100% (185/185), done. 2024-04-21T09:15:59.637 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 180a4176035 v0.24 2024-04-21T09:15:59.642 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.24 2024-04-21T09:15:59.742 INFO:tasks.workunit.client.0.smithi026.stdout:v0.25 2024-04-21T09:15:59.742 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 25 -eq 48 ] 2024-04-21T09:15:59.742 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.25 2024-04-21T09:15:59.742 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.25 2024-04-21T09:15:59.742 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.25 2024-04-21T09:16:08.104 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 13% (87/622) Updating files: 14% (88/622) Updating files: 15% (94/622) Updating files: 16% (100/622) Updating files: 17% (106/622) Updating files: 18% (112/622) Updating files: 19% (119/622) Updating files: 20% (125/622) Updating files: 21% (131/622) Updating files: 22% (137/622) Updating files: 23% (144/622) Updating files: 24% (150/622) Updating files: 24% (152/622) Updating files: 25% (156/622) Updating files: 26% (162/622) Updating files: 27% (168/622) Updating files: 28% (175/622) Updating files: 29% (181/622) Updating files: 30% (187/622) Updating files: 31% (193/622) Updating files: 32% (200/622) Updating files: 33% (206/622) Updating files: 34% (212/622) Updating files: 35% (218/622) Updating files: 36% (224/622) Updating files: 37% (231/622) Updating files: 38% (237/622) Updating files: 38% (239/622) Updating files: 39% (243/622) Updating files: 40% (249/622) Updating files: 41% (256/622) Updating files: 42% (262/622) Updating files: 43% (268/622) Updating files: 44% (274/622) Updating files: 45% (280/622) Updating files: 46% (287/622) Updating files: 47% (293/622) Updating files: 48% (299/622) Updating files: 49% (305/622) Updating files: 50% (311/622) Updating files: 51% (318/622) Updating files: 52% (324/622) Updating files: 53% (330/622) Updating files: 54% (336/622) Updating files: 55% (343/622) Updating files: 56% (349/622) Updating files: 57% (355/622) Updating files: 57% (359/622) Updating files: 58% (361/622) Updating files: 59% (367/622) Updating files: 60% (374/622) Updating files: 61% (380/622) Updating files: 62% (386/622) Updating files: 63% (392/622) Updating files: 64% (399/622) Updating files: 65% (405/622) Updating files: 66% (411/622) Updating files: 67% (417/622) Updating files: 68% (423/622) Updating files: 69% (430/622) Updating files: 69% (432/622) Updating files: 70% (436/622) Updating files: 71% (442/622) Updating files: 72% (448/622) Updating files: 73% (455/622) Updating files: 74% (461/622) Updating files: 75% (467/622) Updating files: 76% (473/622) Updating files: 77% (479/622) Updating files: 78% (486/622) Updating files: 79% (492/622) Updating files: 80% (498/622) Updating files: 80% (503/622) Updating files: 81% (504/622) Updating files: 82% (511/622) Updating files: 83% (517/622) Updating files: 84% (523/622) Updating files: 85% (529/622) Updating files: 86% (535/622) Updating files: 87% (542/622) Updating files: 88% (548/622) Updating files: 89% (554/622) Updating files: 90% (560/622) Updating files: 90% (563/622) Updating files: 91% (567/622) Updating files: 92% (573/622) Updating files: 93% (579/622) Updating files: 94% (585/622) Updating files: 95% (591/622) Updating files: 96% (598/622) Updating files: 97% (604/622) Updating files: 98% (610/622) Updating files: 99% (616/622) Updating files: 100% (622/622) Updating files: 100% (622/622), done. 2024-04-21T09:16:08.489 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 3fa121bf0a8 v0.25 2024-04-21T09:16:08.495 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.25 2024-04-21T09:16:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 26 -eq 48 ] 2024-04-21T09:16:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.26 2024-04-21T09:16:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.26 2024-04-21T09:16:08.549 INFO:tasks.workunit.client.0.smithi026.stdout:v0.26 2024-04-21T09:16:08.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.26 2024-04-21T09:16:13.472 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 36% (87/239) Updating files: 37% (89/239) Updating files: 38% (91/239) Updating files: 39% (94/239) Updating files: 40% (96/239) Updating files: 41% (98/239) Updating files: 42% (101/239) Updating files: 43% (103/239) Updating files: 44% (106/239) Updating files: 45% (108/239) Updating files: 46% (110/239) Updating files: 47% (113/239) Updating files: 48% (115/239) Updating files: 49% (118/239) Updating files: 50% (120/239) Updating files: 51% (122/239) Updating files: 52% (125/239) Updating files: 53% (127/239) Updating files: 54% (130/239) Updating files: 55% (132/239) Updating files: 56% (134/239) Updating files: 57% (137/239) Updating files: 57% (138/239) Updating files: 58% (139/239) Updating files: 59% (142/239) Updating files: 60% (144/239) Updating files: 61% (146/239) Updating files: 62% (149/239) Updating files: 63% (151/239) Updating files: 64% (153/239) Updating files: 65% (156/239) Updating files: 66% (158/239) Updating files: 67% (161/239) Updating files: 68% (163/239) Updating files: 69% (165/239) Updating files: 70% (168/239) Updating files: 71% (170/239) Updating files: 72% (173/239) Updating files: 73% (175/239) Updating files: 74% (177/239) Updating files: 75% (180/239) Updating files: 76% (182/239) Updating files: 77% (185/239) Updating files: 78% (187/239) Updating files: 79% (189/239) Updating files: 80% (192/239) Updating files: 81% (194/239) Updating files: 82% (196/239) Updating files: 83% (199/239) Updating files: 84% (201/239) Updating files: 85% (204/239) Updating files: 86% (206/239) Updating files: 87% (208/239) Updating files: 87% (209/239) Updating files: 88% (211/239) Updating files: 89% (213/239) Updating files: 90% (216/239) Updating files: 91% (218/239) Updating files: 92% (220/239) Updating files: 93% (223/239) Updating files: 94% (225/239) Updating files: 95% (228/239) Updating files: 96% (230/239) Updating files: 97% (232/239) Updating files: 98% (235/239) Updating files: 99% (237/239) Updating files: 100% (239/239) Updating files: 100% (239/239), done. 2024-04-21T09:16:13.694 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 9981ff90968 v0.26 2024-04-21T09:16:13.700 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.26 2024-04-21T09:16:13.912 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 27 -eq 48 ] 2024-04-21T09:16:13.913 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.27 2024-04-21T09:16:13.913 INFO:tasks.workunit.client.0.smithi026.stdout:v0.27 2024-04-21T09:16:13.913 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.27 2024-04-21T09:16:13.913 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.27 2024-04-21T09:16:18.809 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (91/253) Updating files: 36% (92/253) Updating files: 37% (94/253) Updating files: 38% (97/253) Updating files: 39% (99/253) Updating files: 40% (102/253) Updating files: 41% (104/253) Updating files: 42% (107/253) Updating files: 43% (109/253) Updating files: 44% (112/253) Updating files: 45% (114/253) Updating files: 46% (117/253) Updating files: 47% (119/253) Updating files: 48% (122/253) Updating files: 49% (124/253) Updating files: 50% (127/253) Updating files: 51% (130/253) Updating files: 52% (132/253) Updating files: 53% (135/253) Updating files: 54% (137/253) Updating files: 55% (140/253) Updating files: 56% (142/253) Updating files: 57% (145/253) Updating files: 58% (147/253) Updating files: 59% (150/253) Updating files: 60% (152/253) Updating files: 61% (155/253) Updating files: 62% (157/253) Updating files: 63% (160/253) Updating files: 64% (162/253) Updating files: 65% (165/253) Updating files: 66% (167/253) Updating files: 67% (170/253) Updating files: 68% (173/253) Updating files: 69% (175/253) Updating files: 70% (178/253) Updating files: 71% (180/253) Updating files: 72% (183/253) Updating files: 73% (185/253) Updating files: 74% (188/253) Updating files: 75% (190/253) Updating files: 76% (193/253) Updating files: 77% (195/253) Updating files: 78% (198/253) Updating files: 79% (200/253) Updating files: 80% (203/253) Updating files: 81% (205/253) Updating files: 82% (208/253) Updating files: 83% (210/253) Updating files: 84% (213/253) Updating files: 85% (216/253) Updating files: 86% (218/253) Updating files: 87% (221/253) Updating files: 88% (223/253) Updating files: 89% (226/253) Updating files: 90% (228/253) Updating files: 91% (231/253) Updating files: 92% (233/253) Updating files: 93% (236/253) Updating files: 94% (238/253) Updating files: 95% (241/253) Updating files: 96% (243/253) Updating files: 97% (246/253) Updating files: 98% (248/253) Updating files: 99% (251/253) Updating files: 100% (253/253) Updating files: 100% (253/253), done. 2024-04-21T09:16:19.048 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 793034c62c8 v0.27 2024-04-21T09:16:19.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.27 2024-04-21T09:16:19.215 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 28 -eq 48 ] 2024-04-21T09:16:19.215 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.28 2024-04-21T09:16:19.215 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.28 2024-04-21T09:16:19.215 INFO:tasks.workunit.client.0.smithi026.stdout:v0.28 2024-04-21T09:16:19.216 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.28 2024-04-21T09:16:24.207 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 29% (68/227) Updating files: 30% (69/227) Updating files: 31% (71/227) Updating files: 32% (73/227) Updating files: 33% (75/227) Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 51% (117/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 79% (181/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-04-21T09:16:24.555 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 071881d7e55 v0.28 2024-04-21T09:16:24.562 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.28 2024-04-21T09:16:24.704 INFO:tasks.workunit.client.0.smithi026.stdout:v0.29 2024-04-21T09:16:24.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 29 -eq 48 ] 2024-04-21T09:16:24.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.29 2024-04-21T09:16:24.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.29 2024-04-21T09:16:24.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.29 2024-04-21T09:16:26.314 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:16:26.317 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:16:26.411 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-21T09:16:26.417+0000 7f41f8546640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31804) UID: 0 2024-04-21T09:16:26.412 INFO:tasks.ceph.mds.b.smithi169.stderr:2024-04-21T09:16:26.417+0000 7f4b797fa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31804) UID: 0 2024-04-21T09:16:26.412 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-04-21T09:16:26.417+0000 7fe70a6a7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 31804) UID: 0 2024-04-21T09:16:28.361 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 50% (81/159) Updating files: 51% (82/159) Updating files: 52% (83/159) Updating files: 53% (85/159) Updating files: 54% (86/159) Updating files: 55% (88/159) Updating files: 56% (90/159) Updating files: 57% (91/159) Updating files: 58% (93/159) Updating files: 59% (94/159) Updating files: 60% (96/159) Updating files: 61% (97/159) Updating files: 62% (99/159) Updating files: 63% (101/159) Updating files: 64% (102/159) Updating files: 65% (104/159) Updating files: 66% (105/159) Updating files: 67% (107/159) Updating files: 68% (109/159) Updating files: 69% (110/159) Updating files: 70% (112/159) Updating files: 71% (113/159) Updating files: 72% (115/159) Updating files: 73% (117/159) Updating files: 74% (118/159) Updating files: 75% (120/159) Updating files: 76% (121/159) Updating files: 77% (123/159) Updating files: 78% (125/159) Updating files: 79% (126/159) Updating files: 80% (128/159) Updating files: 81% (129/159) Updating files: 82% (131/159) Updating files: 83% (132/159) Updating files: 84% (134/159) Updating files: 85% (136/159) Updating files: 86% (137/159) Updating files: 87% (139/159) Updating files: 88% (140/159) Updating files: 89% (142/159) Updating files: 90% (144/159) Updating files: 91% (145/159) Updating files: 92% (147/159) Updating files: 93% (148/159) Updating files: 94% (150/159) Updating files: 95% (152/159) Updating files: 96% (153/159) Updating files: 97% (155/159) Updating files: 98% (156/159) Updating files: 99% (158/159) Updating files: 100% (159/159) Updating files: 100% (159/159), done. 2024-04-21T09:16:28.568 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 8e69c39f699 v0.29 2024-04-21T09:16:28.575 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.29 2024-04-21T09:16:28.863 INFO:tasks.workunit.client.0.smithi026.stdout:v0.30 2024-04-21T09:16:28.863 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 30 -eq 48 ] 2024-04-21T09:16:28.863 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.30 2024-04-21T09:16:28.864 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.30 2024-04-21T09:16:28.864 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.30 2024-04-21T09:16:33.263 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 41% (118/285) Updating files: 42% (120/285) Updating files: 43% (123/285) Updating files: 44% (126/285) Updating files: 45% (129/285) Updating files: 46% (132/285) Updating files: 47% (134/285) Updating files: 48% (137/285) Updating files: 49% (140/285) Updating files: 50% (143/285) Updating files: 51% (146/285) Updating files: 52% (149/285) Updating files: 53% (152/285) Updating files: 54% (154/285) Updating files: 55% (157/285) Updating files: 56% (160/285) Updating files: 57% (163/285) Updating files: 58% (166/285) Updating files: 59% (169/285) Updating files: 60% (171/285) Updating files: 61% (174/285) Updating files: 62% (177/285) Updating files: 63% (180/285) Updating files: 64% (183/285) Updating files: 65% (186/285) Updating files: 66% (189/285) Updating files: 67% (191/285) Updating files: 68% (194/285) Updating files: 69% (197/285) Updating files: 70% (200/285) Updating files: 71% (203/285) Updating files: 72% (206/285) Updating files: 73% (209/285) Updating files: 74% (211/285) Updating files: 75% (214/285) Updating files: 76% (217/285) Updating files: 77% (220/285) Updating files: 78% (223/285) Updating files: 79% (226/285) Updating files: 80% (228/285) Updating files: 81% (231/285) Updating files: 82% (234/285) Updating files: 83% (237/285) Updating files: 84% (240/285) Updating files: 85% (243/285) Updating files: 86% (246/285) Updating files: 87% (248/285) Updating files: 88% (251/285) Updating files: 89% (254/285) Updating files: 90% (257/285) Updating files: 91% (260/285) Updating files: 92% (263/285) Updating files: 93% (266/285) Updating files: 94% (268/285) Updating files: 95% (271/285) Updating files: 96% (274/285) Updating files: 97% (277/285) Updating files: 97% (278/285) Updating files: 98% (280/285) Updating files: 99% (283/285) Updating files: 100% (285/285) Updating files: 100% (285/285), done. 2024-04-21T09:16:33.478 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 64b1b2c70f0 v0.30 2024-04-21T09:16:33.485 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.30 2024-04-21T09:16:33.718 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 31 -eq 48 ] 2024-04-21T09:16:33.718 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.31 2024-04-21T09:16:33.718 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.31 2024-04-21T09:16:33.718 INFO:tasks.workunit.client.0.smithi026.stdout:v0.31 2024-04-21T09:16:33.719 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.31 2024-04-21T09:16:39.851 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 20% (81/398) Updating files: 21% (84/398) Updating files: 22% (88/398) Updating files: 23% (92/398) Updating files: 24% (96/398) Updating files: 25% (100/398) Updating files: 26% (104/398) Updating files: 27% (108/398) Updating files: 28% (112/398) Updating files: 29% (116/398) Updating files: 30% (120/398) Updating files: 31% (124/398) Updating files: 32% (128/398) Updating files: 33% (132/398) Updating files: 34% (136/398) Updating files: 35% (140/398) Updating files: 36% (144/398) Updating files: 37% (148/398) Updating files: 38% (152/398) Updating files: 39% (156/398) Updating files: 40% (160/398) Updating files: 41% (164/398) Updating files: 42% (168/398) Updating files: 43% (172/398) Updating files: 44% (176/398) Updating files: 45% (180/398) Updating files: 46% (184/398) Updating files: 47% (188/398) Updating files: 48% (192/398) Updating files: 49% (196/398) Updating files: 50% (199/398) Updating files: 51% (203/398) Updating files: 52% (207/398) Updating files: 53% (211/398) Updating files: 54% (215/398) Updating files: 55% (219/398) Updating files: 56% (223/398) Updating files: 57% (227/398) Updating files: 57% (229/398) Updating files: 58% (231/398) Updating files: 59% (235/398) Updating files: 60% (239/398) Updating files: 61% (243/398) Updating files: 62% (247/398) Updating files: 63% (251/398) Updating files: 64% (255/398) Updating files: 65% (259/398) Updating files: 66% (263/398) Updating files: 67% (267/398) Updating files: 68% (271/398) Updating files: 69% (275/398) Updating files: 70% (279/398) Updating files: 71% (283/398) Updating files: 72% (287/398) Updating files: 73% (291/398) Updating files: 74% (295/398) Updating files: 75% (299/398) Updating files: 75% (302/398) Updating files: 76% (303/398) Updating files: 77% (307/398) Updating files: 78% (311/398) Updating files: 79% (315/398) Updating files: 80% (319/398) Updating files: 81% (323/398) Updating files: 82% (327/398) Updating files: 83% (331/398) Updating files: 84% (335/398) Updating files: 85% (339/398) Updating files: 86% (343/398) Updating files: 87% (347/398) Updating files: 88% (351/398) Updating files: 89% (355/398) Updating files: 90% (359/398) Updating files: 91% (363/398) Updating files: 92% (367/398) Updating files: 93% (371/398) Updating files: 94% (375/398) Updating files: 95% (379/398) Updating files: 96% (383/398) Updating files: 97% (387/398) Updating files: 98% (391/398) Updating files: 99% (395/398) Updating files: 100% (398/398) Updating files: 100% (398/398), done. 2024-04-21T09:16:40.094 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 9019c6ce640 v0.31 2024-04-21T09:16:40.101 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.31 2024-04-21T09:16:40.184 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 32 -eq 48 ] 2024-04-21T09:16:40.184 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.32 2024-04-21T09:16:40.184 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.32 2024-04-21T09:16:40.184 INFO:tasks.workunit.client.0.smithi026.stdout:v0.32 2024-04-21T09:16:40.184 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.32 2024-04-21T09:16:44.230 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 41% (80/195) Updating files: 42% (82/195) Updating files: 43% (84/195) Updating files: 44% (86/195) Updating files: 45% (88/195) Updating files: 46% (90/195) Updating files: 47% (92/195) Updating files: 48% (94/195) Updating files: 49% (96/195) Updating files: 50% (98/195) Updating files: 51% (100/195) Updating files: 52% (102/195) Updating files: 53% (104/195) Updating files: 54% (106/195) Updating files: 55% (108/195) Updating files: 56% (110/195) Updating files: 57% (112/195) Updating files: 58% (114/195) Updating files: 59% (116/195) Updating files: 60% (117/195) Updating files: 61% (119/195) Updating files: 62% (121/195) Updating files: 63% (123/195) Updating files: 64% (125/195) Updating files: 64% (126/195) Updating files: 65% (127/195) Updating files: 66% (129/195) Updating files: 67% (131/195) Updating files: 68% (133/195) Updating files: 69% (135/195) Updating files: 70% (137/195) Updating files: 71% (139/195) Updating files: 72% (141/195) Updating files: 73% (143/195) Updating files: 74% (145/195) Updating files: 75% (147/195) Updating files: 76% (149/195) Updating files: 77% (151/195) Updating files: 78% (153/195) Updating files: 79% (155/195) Updating files: 80% (156/195) Updating files: 81% (158/195) Updating files: 82% (160/195) Updating files: 83% (162/195) Updating files: 84% (164/195) Updating files: 85% (166/195) Updating files: 86% (168/195) Updating files: 87% (170/195) Updating files: 88% (172/195) Updating files: 89% (174/195) Updating files: 90% (176/195) Updating files: 91% (178/195) Updating files: 92% (180/195) Updating files: 93% (182/195) Updating files: 94% (184/195) Updating files: 95% (186/195) Updating files: 96% (188/195) Updating files: 97% (190/195) Updating files: 98% (192/195) Updating files: 99% (194/195) Updating files: 100% (195/195) Updating files: 100% (195/195), done. 2024-04-21T09:16:44.885 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at c08d08baa6a v0.32 2024-04-21T09:16:44.891 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.32 2024-04-21T09:16:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 33 -eq 48 ] 2024-04-21T09:16:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.33 2024-04-21T09:16:44.990 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.33 2024-04-21T09:16:44.991 INFO:tasks.workunit.client.0.smithi026.stdout:v0.33 2024-04-21T09:16:44.991 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.33 2024-04-21T09:16:48.498 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 44% (71/160) Updating files: 45% (72/160) Updating files: 46% (74/160) Updating files: 47% (76/160) Updating files: 48% (77/160) Updating files: 49% (79/160) Updating files: 50% (80/160) Updating files: 51% (82/160) Updating files: 52% (84/160) Updating files: 53% (85/160) Updating files: 54% (87/160) Updating files: 55% (88/160) Updating files: 56% (90/160) Updating files: 57% (92/160) Updating files: 58% (93/160) Updating files: 59% (95/160) Updating files: 60% (96/160) Updating files: 61% (98/160) Updating files: 62% (100/160) Updating files: 63% (101/160) Updating files: 64% (103/160) Updating files: 65% (104/160) Updating files: 66% (106/160) Updating files: 67% (108/160) Updating files: 68% (109/160) Updating files: 69% (111/160) Updating files: 70% (112/160) Updating files: 71% (114/160) Updating files: 72% (116/160) Updating files: 73% (117/160) Updating files: 74% (119/160) Updating files: 75% (120/160) Updating files: 76% (122/160) Updating files: 77% (124/160) Updating files: 78% (125/160) Updating files: 79% (127/160) Updating files: 80% (128/160) Updating files: 81% (130/160) Updating files: 82% (132/160) Updating files: 83% (133/160) Updating files: 84% (135/160) Updating files: 85% (136/160) Updating files: 86% (138/160) Updating files: 87% (140/160) Updating files: 88% (141/160) Updating files: 89% (143/160) Updating files: 90% (144/160) Updating files: 91% (146/160) Updating files: 91% (147/160) Updating files: 92% (148/160) Updating files: 93% (149/160) Updating files: 94% (151/160) Updating files: 95% (152/160) Updating files: 96% (154/160) Updating files: 97% (156/160) Updating files: 98% (157/160) Updating files: 99% (159/160) Updating files: 100% (160/160) Updating files: 100% (160/160), done. 2024-04-21T09:16:48.780 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 340b4348bf6 v0.33 2024-04-21T09:16:48.786 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.33 2024-04-21T09:16:48.880 INFO:tasks.workunit.client.0.smithi026.stdout:v0.34 2024-04-21T09:16:48.881 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 34 -eq 48 ] 2024-04-21T09:16:48.881 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.34 2024-04-21T09:16:48.881 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.34 2024-04-21T09:16:48.881 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.34 2024-04-21T09:16:52.268 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 58% (75/129) Updating files: 59% (77/129) Updating files: 60% (78/129) Updating files: 61% (79/129) Updating files: 62% (80/129) Updating files: 63% (82/129) Updating files: 64% (83/129) Updating files: 65% (84/129) Updating files: 66% (86/129) Updating files: 67% (87/129) Updating files: 68% (88/129) Updating files: 69% (90/129) Updating files: 70% (91/129) Updating files: 71% (92/129) Updating files: 72% (93/129) Updating files: 73% (95/129) Updating files: 74% (96/129) Updating files: 75% (97/129) Updating files: 76% (99/129) Updating files: 77% (100/129) Updating files: 78% (101/129) Updating files: 79% (102/129) Updating files: 80% (104/129) Updating files: 81% (105/129) Updating files: 82% (106/129) Updating files: 83% (108/129) Updating files: 84% (109/129) Updating files: 85% (110/129) Updating files: 86% (111/129) Updating files: 87% (113/129) Updating files: 88% (114/129) Updating files: 89% (115/129) Updating files: 90% (117/129) Updating files: 91% (118/129) Updating files: 92% (119/129) Updating files: 93% (120/129) Updating files: 94% (122/129) Updating files: 95% (123/129) Updating files: 96% (124/129) Updating files: 97% (126/129) Updating files: 98% (127/129) Updating files: 99% (128/129) Updating files: 100% (129/129) Updating files: 100% (129/129), done. 2024-04-21T09:16:52.588 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 2f039eeeb74 v0.34 2024-04-21T09:16:52.593 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.34 2024-04-21T09:16:52.669 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 35 -eq 48 ] 2024-04-21T09:16:52.669 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.35 2024-04-21T09:16:52.670 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.35 2024-04-21T09:16:52.670 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.35 2024-04-21T09:16:52.670 INFO:tasks.workunit.client.0.smithi026.stdout:v0.35 2024-04-21T09:16:57.959 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (118/334) Updating files: 36% (121/334) Updating files: 37% (124/334) Updating files: 38% (127/334) Updating files: 39% (131/334) Updating files: 40% (134/334) Updating files: 41% (137/334) Updating files: 42% (141/334) Updating files: 43% (144/334) Updating files: 44% (147/334) Updating files: 45% (151/334) Updating files: 46% (154/334) Updating files: 47% (157/334) Updating files: 48% (161/334) Updating files: 49% (164/334) Updating files: 50% (167/334) Updating files: 51% (171/334) Updating files: 52% (174/334) Updating files: 53% (178/334) Updating files: 54% (181/334) Updating files: 55% (184/334) Updating files: 56% (188/334) Updating files: 57% (191/334) Updating files: 57% (192/334) Updating files: 58% (194/334) Updating files: 59% (198/334) Updating files: 60% (201/334) Updating files: 61% (204/334) Updating files: 62% (208/334) Updating files: 63% (211/334) Updating files: 64% (214/334) Updating files: 65% (218/334) Updating files: 66% (221/334) Updating files: 67% (224/334) Updating files: 68% (228/334) Updating files: 69% (231/334) Updating files: 70% (234/334) Updating files: 71% (238/334) Updating files: 72% (241/334) Updating files: 73% (244/334) Updating files: 74% (248/334) Updating files: 75% (251/334) Updating files: 76% (254/334) Updating files: 77% (258/334) Updating files: 78% (261/334) Updating files: 79% (264/334) Updating files: 79% (265/334) Updating files: 80% (268/334) Updating files: 81% (271/334) Updating files: 82% (274/334) Updating files: 83% (278/334) Updating files: 84% (281/334) Updating files: 85% (284/334) Updating files: 86% (288/334) Updating files: 87% (291/334) Updating files: 88% (294/334) Updating files: 89% (298/334) Updating files: 90% (301/334) Updating files: 91% (304/334) Updating files: 92% (308/334) Updating files: 93% (311/334) Updating files: 94% (314/334) Updating files: 95% (318/334) Updating files: 96% (321/334) Updating files: 97% (324/334) Updating files: 98% (328/334) Updating files: 99% (331/334) Updating files: 100% (334/334) Updating files: 100% (334/334), done. 2024-04-21T09:16:58.126 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 0afda378124 v0.35 2024-04-21T09:16:58.129 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.35 2024-04-21T09:16:58.341 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 36 -eq 48 ] 2024-04-21T09:16:58.341 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.36 2024-04-21T09:16:58.341 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.36 2024-04-21T09:16:58.341 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.36 2024-04-21T09:16:58.341 INFO:tasks.workunit.client.0.smithi026.stdout:v0.36 2024-04-21T09:17:01.988 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 31.6 2024-04-21T09:17:01.989 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:17:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fe2a0640 1 Processor -- start 2024-04-21T09:17:02.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fe2a0640 1 -- start start 2024-04-21T09:17:02.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fe2a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f8152a90 0x7fa5f80c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fe2a0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5f806d4a0 0x7fa5f80c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fe2a0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f8073c00 con 0x7fa5f80c8180 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fe2a0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f80c71b0 con 0x7fa5f806d4a0 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fe2a0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f8071d50 con 0x7fa5f8152a90 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5effff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa5f806d4a0 0x7fa5f80c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fc83d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa5f80c8180 0x7fa5f8158bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:55714/0 (socket says 172.21.15.26:55714) 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5fc83d640 1 -- 172.21.15.26:0/229371569 learned_addr learned my addr 172.21.15.26:0/229371569 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5f7fff640 1 --2- 172.21.15.26:0/229371569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f8152a90 0x7fa5f80c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5effff640 1 -- 172.21.15.26:0/229371569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f8152a90 msgr2=0x7fa5f80c5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5effff640 1 --2- 172.21.15.26:0/229371569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f8152a90 0x7fa5f80c5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5effff640 1 -- 172.21.15.26:0/229371569 >> v1:172.21.15.26:6789/0 conn(0x7fa5f80c8180 legacy=0x7fa5f8158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.127 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.128+0000 7fa5effff640 1 -- 172.21.15.26:0/229371569 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f8152e70 con 0x7fa5f806d4a0 2024-04-21T09:17:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5effff640 1 --2- 172.21.15.26:0/229371569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f806d4a0 0x7fa5f80c6380 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8073dd0 tx=0x7fa5e001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc30aba08e00099 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5f77fe640 1 -- 172.21.15.26:0/229371569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00b2070 con 0x7fa5f806d4a0 2024-04-21T09:17:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5f77fe640 1 -- 172.21.15.26:0/229371569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e00ad640 con 0x7fa5f806d4a0 2024-04-21T09:17:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5f77fe640 1 -- 172.21.15.26:0/229371569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e00ada10 con 0x7fa5f806d4a0 2024-04-21T09:17:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/229371569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f806d4a0 msgr2=0x7fa5f80c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/229371569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f806d4a0 0x7fa5f80c6380 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8073dd0 tx=0x7fa5e001c4a0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/229371569 shutdown_connections 2024-04-21T09:17:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/229371569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f806d4a0 0x7fa5f80c6380 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/229371569 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f8152a90 0x7fa5f80c5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.130 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/229371569 >> 172.21.15.26:0/229371569 conn(0x7fa5f80702c0 msgr2=0x7fa5f80cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/229371569 shutdown_connections 2024-04-21T09:17:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/229371569 wait complete. 2024-04-21T09:17:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 Processor -- start 2024-04-21T09:17:02.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.132+0000 7fa5fe2a0640 1 -- start start 2024-04-21T09:17:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f806d4a0 0x7fa5f80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.133 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f80c8180 0x7fa5f8139520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f8152a90 0x7fa5f813b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8067cf0 con 0x7fa5f8152a90 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f806cf70 con 0x7fa5f80c8180 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f8067e70 con 0x7fa5f806d4a0 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f8152a90 0x7fa5f813b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f8152a90 0x7fa5f813b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54840/0 (socket says 172.21.15.26:54840) 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 -- 172.21.15.26:0/1017383503 learned_addr learned my addr 172.21.15.26:0/1017383503 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f7fff640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f806d4a0 0x7fa5f80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5effff640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f80c8180 0x7fa5f8139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 -- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f806d4a0 msgr2=0x7fa5f80c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f806d4a0 0x7fa5f80c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.134 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 -- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f80c8180 msgr2=0x7fa5f8139520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f80c8180 0x7fa5f8139520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 -- 172.21.15.26:0/1017383503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f8161500 con 0x7fa5f8152a90 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fc83d640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f8152a90 0x7fa5f813b6a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cbf0 tx=0x7fa5f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f57fa640 1 -- 172.21.15.26:0/1017383503 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0017070 con 0x7fa5f8152a90 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f57fa640 1 -- 172.21.15.26:0/1017383503 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f000ad40 con 0x7fa5f8152a90 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f80c43a0 con 0x7fa5f8152a90 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f57fa640 1 -- 172.21.15.26:0/1017383503 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0012600 con 0x7fa5f8152a90 2024-04-21T09:17:02.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f80c4960 con 0x7fa5f8152a90 2024-04-21T09:17:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f8075ef0 con 0x7fa5f8152a90 2024-04-21T09:17:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f57fa640 1 -- 172.21.15.26:0/1017383503 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa5f001a070 con 0x7fa5f8152a90 2024-04-21T09:17:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f57fa640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa5d8068380 0x7fa5d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f57fa640 1 -- 172.21.15.26:0/1017383503 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fa5f0086650 con 0x7fa5f8152a90 2024-04-21T09:17:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.136+0000 7fa5f7fff640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa5d8068380 0x7fa5d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.140+0000 7fa5f7fff640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa5d8068380 0x7fa5d806a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009ac0 tx=0x7fa5e8009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.144+0000 7fa5f57fa640 1 -- 172.21.15.26:0/1017383503 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa5f0056580 con 0x7fa5f8152a90 2024-04-21T09:17:02.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.392+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5f8148640 con 0x7fa5f8152a90 2024-04-21T09:17:02.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.392+0000 7fa5f57fa640 1 -- 172.21.15.26:0/1017383503 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fa5f005a880 con 0x7fa5f8152a90 2024-04-21T09:17:02.390 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:17:02.390 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:17:02.390 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:17:02.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa5d8068380 msgr2=0x7fa5d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa5d8068380 0x7fa5d806a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009ac0 tx=0x7fa5e8009190 comp rx=0 tx=0).stop 2024-04-21T09:17:02.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f8152a90 msgr2=0x7fa5f813b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f8152a90 0x7fa5f813b6a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cbf0 tx=0x7fa5f000a430 comp rx=0 tx=0).stop 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 shutdown_connections 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa5d8068380 0x7fa5d806a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa5f8152a90 0x7fa5f813b6a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa5f80c8180 0x7fa5f8139520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 --2- 172.21.15.26:0/1017383503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa5f806d4a0 0x7fa5f80c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 >> 172.21.15.26:0/1017383503 conn(0x7fa5f80702c0 msgr2=0x7fa5f8150090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 shutdown_connections 2024-04-21T09:17:02.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.396+0000 7fa5fe2a0640 1 -- 172.21.15.26:0/1017383503 wait complete. 2024-04-21T09:17:02.411 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 91.6 --await' 2024-04-21T09:17:02.411 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 91.6 --await 2024-04-21T09:17:02.427 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 38% (95/244) Updating files: 39% (96/244) Updating files: 40% (98/244) Updating files: 41% (101/244) Updating files: 42% (103/244) Updating files: 43% (105/244) Updating files: 44% (108/244) Updating files: 45% (110/244) Updating files: 46% (113/244) Updating files: 47% (115/244) Updating files: 48% (118/244) Updating files: 49% (120/244) Updating files: 50% (122/244) Updating files: 51% (125/244) Updating files: 52% (127/244) Updating files: 53% (130/244) Updating files: 54% (132/244) Updating files: 55% (135/244) Updating files: 56% (137/244) Updating files: 57% (140/244) Updating files: 58% (142/244) Updating files: 59% (144/244) Updating files: 60% (147/244) Updating files: 61% (149/244) Updating files: 62% (152/244) Updating files: 63% (154/244) Updating files: 64% (157/244) Updating files: 65% (159/244) Updating files: 66% (162/244) Updating files: 67% (164/244) Updating files: 68% (166/244) Updating files: 69% (169/244) Updating files: 70% (171/244) Updating files: 71% (174/244) Updating files: 72% (176/244) Updating files: 73% (179/244) Updating files: 74% (181/244) Updating files: 75% (183/244) Updating files: 75% (184/244) Updating files: 76% (186/244) Updating files: 77% (188/244) Updating files: 78% (191/244) Updating files: 79% (193/244) Updating files: 80% (196/244) Updating files: 81% (198/244) Updating files: 82% (201/244) Updating files: 83% (203/244) Updating files: 84% (205/244) Updating files: 85% (208/244) Updating files: 86% (210/244) Updating files: 87% (213/244) Updating files: 88% (215/244) Updating files: 89% (218/244) Updating files: 90% (220/244) Updating files: 91% (223/244) Updating files: 92% (225/244) Updating files: 93% (227/244) Updating files: 94% (230/244) Updating files: 95% (232/244) Updating files: 96% (235/244) Updating files: 97% (237/244) Updating files: 98% (240/244) Updating files: 99% (242/244) Updating files: 100% (244/244) Updating files: 100% (244/244), done. 2024-04-21T09:17:02.519 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 877cacbbdbb v0.36 2024-04-21T09:17:02.520 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.36 2024-04-21T09:17:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.552+0000 7fc9f67b4640 1 Processor -- start 2024-04-21T09:17:02.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.552+0000 7fc9f67b4640 1 -- start start 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.552+0000 7fc9f67b4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9f0152910 0x7fc9f006eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.552+0000 7fc9f67b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152cf0 0x7fc9f015c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc9f00c79a0 0x7fc9f0072e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f015bdd0 con 0x7fc9f0152910 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc9f0073880 con 0x7fc9f00c79a0 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f0073b40 con 0x7fc9f0152cf0 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9f0152910 0x7fc9f006eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc9f0152910 0x7fc9f006eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54854/0 (socket says 172.21.15.26:54854) 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 -- 172.21.15.26:0/374503841 learned_addr learned my addr 172.21.15.26:0/374503841 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/374503841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152cf0 0x7fc9f015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/374503841 >> v2:172.21.15.169:3300/0 conn(0x7fc9f00c79a0 0x7fc9f0072e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 -- 172.21.15.26:0/374503841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152cf0 msgr2=0x7fc9f015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 --2- 172.21.15.26:0/374503841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152cf0 0x7fc9f015c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 -- 172.21.15.26:0/374503841 >> v2:172.21.15.169:3300/0 conn(0x7fc9f00c79a0 msgr2=0x7fc9f0072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 --2- 172.21.15.26:0/374503841 >> v2:172.21.15.169:3300/0 conn(0x7fc9f00c79a0 0x7fc9f0072e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 -- 172.21.15.26:0/374503841 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f015c040 con 0x7fc9f0152910 2024-04-21T09:17:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/374503841 >> v2:172.21.15.169:3300/0 conn(0x7fc9f00c79a0 0x7fc9f0072e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:17:02.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9effff640 1 --2- 172.21.15.26:0/374503841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152910 0x7fc9f006eab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00b26f0 tx=0x7fc9e001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b805019bc5584 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9eeffd640 1 -- 172.21.15.26:0/374503841 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00b5070 con 0x7fc9f0152910 2024-04-21T09:17:02.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9eeffd640 1 -- 172.21.15.26:0/374503841 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e00a89d0 con 0x7fc9f0152910 2024-04-21T09:17:02.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9eeffd640 1 -- 172.21.15.26:0/374503841 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00a8da0 con 0x7fc9f0152910 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- 172.21.15.26:0/374503841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152910 msgr2=0x7fc9f006eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/374503841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152910 0x7fc9f006eab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00b26f0 tx=0x7fc9e001ed10 comp rx=0 tx=0).stop 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- 172.21.15.26:0/374503841 shutdown_connections 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/374503841 >> v2:172.21.15.169:3300/0 conn(0x7fc9f00c79a0 0x7fc9f0072e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/374503841 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152cf0 0x7fc9f015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/374503841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152910 0x7fc9f006eab0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- 172.21.15.26:0/374503841 >> 172.21.15.26:0/374503841 conn(0x7fc9f0070190 msgr2=0x7fc9f00705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- 172.21.15.26:0/374503841 shutdown_connections 2024-04-21T09:17:02.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.556+0000 7fc9f67b4640 1 -- 172.21.15.26:0/374503841 wait complete. 2024-04-21T09:17:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 Processor -- start 2024-04-21T09:17:02.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 -- start start 2024-04-21T09:17:02.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f00c79a0 0x7fc9f0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152910 0x7fc9f01e40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152cf0 0x7fc9f00ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0073350 con 0x7fc9f0152cf0 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f0073e20 con 0x7fc9f00c79a0 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f00734d0 con 0x7fc9f0152910 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152cf0 0x7fc9f00ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152cf0 0x7fc9f00ccf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54870/0 (socket says 172.21.15.26:54870) 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1902733388 learned_addr learned my addr 172.21.15.26:0/1902733388 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152910 0x7fc9f01e40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9effff640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f00c79a0 0x7fc9f0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152910 msgr2=0x7fc9f01e40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152910 0x7fc9f01e40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f00c79a0 msgr2=0x7fc9f0151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f00c79a0 0x7fc9f0151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1902733388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f01f4580 con 0x7fc9f0152cf0 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152cf0 0x7fc9f00ccf70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009fa0 tx=0x7fc9e800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9ecff9640 1 -- 172.21.15.26:0/1902733388 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e801a070 con 0x7fc9f0152cf0 2024-04-21T09:17:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9ecff9640 1 -- 172.21.15.26:0/1902733388 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e8003bc0 con 0x7fc9f0152cf0 2024-04-21T09:17:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9f00b0590 con 0x7fc9f0152cf0 2024-04-21T09:17:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9ecff9640 1 -- 172.21.15.26:0/1902733388 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8004030 con 0x7fc9f0152cf0 2024-04-21T09:17:02.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.560+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9f01e4c10 con 0x7fc9f0152cf0 2024-04-21T09:17:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9ecff9640 1 -- 172.21.15.26:0/1902733388 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc9e801d070 con 0x7fc9f0152cf0 2024-04-21T09:17:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9ecff9640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9dc0683b0 0x7fc9dc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9ecff9640 1 -- 172.21.15.26:0/1902733388 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fc9e8086b70 con 0x7fc9f0152cf0 2024-04-21T09:17:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9effff640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9dc0683b0 0x7fc9dc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9effff640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9dc0683b0 0x7fc9dc06a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00b2000 tx=0x7fc9e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 Processor -- start 2024-04-21T09:17:02.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 -- start start 2024-04-21T09:17:02.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a981f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a981f5500 0x559a98230450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a98230990 0x559a98230d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a980d6650 con 0x559a98230990 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559a9803ebf0 con 0x559a9822b5a0 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559a97fe40c0 con 0x559a981f5500 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a98230990 0x559a98230d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a98230990 0x559a98230d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54874/0 (socket says 172.21.15.26:54874) 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1771740985 learned_addr learned my addr 172.21.15.26:0/1771740985 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9effff640 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a981f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a981f5500 0x559a98230450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a981f5500 msgr2=0x559a98230450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a981f5500 0x559a98230450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 msgr2=0x559a981f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a981f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 -- 172.21.15.26:0/1771740985 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a98000fe0 con 0x559a98230990 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a98230990 0x559a98230d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8007fd0 tx=0x7fc9e8056bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d1d1ec4d1422e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9d5ffb640 1 -- 172.21.15.26:0/1771740985 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8054e30 con 0x559a98230990 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9d5ffb640 1 -- 172.21.15.26:0/1771740985 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e80531a0 con 0x559a98230990 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.564+0000 7fc9d5ffb640 1 -- 172.21.15.26:0/1771740985 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e8056fb0 con 0x559a98230990 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1771740985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a98230990 msgr2=0x559a98230d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a98230990 0x559a98230d70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8007fd0 tx=0x7fc9e8056bf0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1771740985 shutdown_connections 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a98230990 0x559a98230d70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a981f5500 0x559a98230450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1771740985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a981f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1771740985 >> 172.21.15.26:0/1771740985 conn(0x559a9822c200 msgr2=0x559a9822e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1771740985 shutdown_connections 2024-04-21T09:17:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1771740985 wait complete. 2024-04-21T09:17:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- start start 2024-04-21T09:17:02.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 Processor -- start 2024-04-21T09:17:02.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a981f5500 0x559a981ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a9822b5a0 0x559a981ed190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981ed6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a97ffa540 con 0x559a9822b5a0 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559a9803df00 con 0x559a981f5500 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559a98043220 con 0x559a98230990 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 10 client.0 _ll_register_callbacks cb 0x559a981da9a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a9822b5a0 0x559a981ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a9822b5a0 0x559a981ed190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54886/0 (socket says 172.21.15.26:54886) 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 -- 172.21.15.26:0/1085363990 learned_addr learned my addr 172.21.15.26:0/1085363990 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9effff640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a981f5500 0x559a981ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981ed6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 -- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 msgr2=0x559a981ed6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981ed6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 -- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a981f5500 msgr2=0x559a981ecc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a981f5500 0x559a981ecc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 -- 172.21.15.26:0/1085363990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a9804b570 con 0x559a9822b5a0 2024-04-21T09:17:02.570 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a9822b5a0 0x559a981ed190 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4014700 tx=0x7fc9e4014bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8319c4e8953836ba server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ceffd640 1 -- 172.21.15.26:0/1085363990 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e4022060 con 0x559a9822b5a0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ceffd640 1 -- 172.21.15.26:0/1085363990 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fc9e40128b0 con 0x559a9822b5a0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e80531a0 con 0x559a9822b5a0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ceffd640 1 -- 172.21.15.26:0/1085363990 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc9e4028050 con 0x559a9822b5a0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 10 client.5076 fetch_fsmap learned FSMap version 8 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559a97fe4310 con 0x559a9822b5a0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ceffd640 1 -- 172.21.15.26:0/1085363990 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e80531a0 con 0x559a9822b5a0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9ceffd640 1 -- 172.21.15.26:0/1085363990 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fc9e4012ab0 con 0x559a9822b5a0 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 10 client.5076 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 10 client.5076 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 20 client.5076 populate_metadata read hostname 'smithi026' 2024-04-21T09:17:02.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a98244150 0x559a98246540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 4 client.5076 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:17:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a97fd8880 con 0x559a98244150 2024-04-21T09:17:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.568+0000 7fc9effff640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a98244150 0x559a98246540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9ceffd640 10 client.5076 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:02.572 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9effff640 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a98244150 0x559a98246540 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5210109af1257894 server_cookie=2a2fb0fd195b4eb4 in_seq=0 out_seq=0 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9ceffd640 1 -- 172.21.15.26:0/1085363990 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x559a97fd8880 con 0x559a98244150 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9ceffd640 10 client.5076 handle_command_reply: tid=0 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 client.5076 shutdown 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a9822b5a0 msgr2=0x559a981ed190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a9822b5a0 0x559a981ed190 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4014700 tx=0x7fc9e4014bc0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 shutdown_connections 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a98244150 0x559a98246540 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981ed6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a9822b5a0 0x559a981ed190 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9ceffd640 0 client.5076 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 --2- 172.21.15.26:0/1085363990 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a981f5500 0x559a981ecc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 >> 172.21.15.26:0/1085363990 conn(0x559a9822c200 msgr2=0x559a9822abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 shutdown_connections 2024-04-21T09:17:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 1 -- 172.21.15.26:0/1085363990 wait complete. 2024-04-21T09:17:02.574 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.572+0000 7fc9f9936000 20 client.5076 trim_cache size 0 max 16384 2024-04-21T09:17:02.592 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 37 -eq 48 ] 2024-04-21T09:17:02.592 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.37 2024-04-21T09:17:02.592 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.37 2024-04-21T09:17:02.592 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.37 2024-04-21T09:17:02.592 INFO:tasks.workunit.client.0.smithi026.stdout:v0.37 2024-04-21T09:17:02.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 Processor -- start 2024-04-21T09:17:02.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 -- start start 2024-04-21T09:17:02.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a98225fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a98226510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981f0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01fc630 con 0x559a981f5500 2024-04-21T09:17:02.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f01e2850 con 0x559a9822b5a0 2024-04-21T09:17:02.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f01fbf90 con 0x559a98230990 2024-04-21T09:17:02.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a98225fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a98225fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54896/0 (socket says 172.21.15.26:54896) 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 -- 172.21.15.26:0/2257388176 learned_addr learned my addr 172.21.15.26:0/2257388176 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981f0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a98226510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 -- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 msgr2=0x559a981f0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981f0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 -- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 msgr2=0x559a98226510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a98226510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 -- 172.21.15.26:0/2257388176 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a9800aab0 con 0x559a981f5500 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9effff640 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a98225fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00b3040 tx=0x7fc9e0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaca30f155b33d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9d57fa640 1 -- 172.21.15.26:0/2257388176 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00b5040 con 0x559a981f5500 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9d57fa640 1 -- 172.21.15.26:0/2257388176 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e00a8d50 con 0x559a981f5500 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.596+0000 7fc9d57fa640 1 -- 172.21.15.26:0/2257388176 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00cc370 con 0x559a981f5500 2024-04-21T09:17:02.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/2257388176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 msgr2=0x559a98225fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a98225fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00b3040 tx=0x7fc9e0004740 comp rx=0 tx=0).stop 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/2257388176 shutdown_connections 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a981f0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a98226510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- 172.21.15.26:0/2257388176 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a98225fd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/2257388176 >> 172.21.15.26:0/2257388176 conn(0x559a9822c200 msgr2=0x559a9824b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/2257388176 shutdown_connections 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/2257388176 wait complete. 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- start start 2024-04-21T09:17:02.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 Processor -- start 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a981f3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a982a36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a982a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x559a97fd5470 con 0x559a981f5500 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x559a9804be00 con 0x559a9822b5a0 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x559a98002b70 con 0x559a98230990 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 10 client.0 _ll_register_callbacks cb 0x7fc9e4009400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:17:02.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a981f3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a981f3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54904/0 (socket says 172.21.15.26:54904) 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 -- 172.21.15.26:0/650488005 learned_addr learned my addr 172.21.15.26:0/650488005 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a982a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f4d51640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a982a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 -- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 msgr2=0x559a982a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a982a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 -- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 msgr2=0x559a982a36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a982a36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 -- 172.21.15.26:0/650488005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a980bf660 con 0x559a981f5500 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a982a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9effff640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a981f3640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc9e001ed50 tx=0x7fc9e001d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697744a2049a7141 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ceffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ceffd640 1 -- 172.21.15.26:0/650488005 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9e00b5040 con 0x559a981f5500 2024-04-21T09:17:02.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ceffd640 1 -- 172.21.15.26:0/650488005 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fc9e00cc170 con 0x559a981f5500 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9e00a8d50 con 0x559a981f5500 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ceffd640 1 -- 172.21.15.26:0/650488005 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fc9e00e5050 con 0x559a981f5500 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 10 client.5082 fetch_fsmap learned FSMap version 8 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x559a97fd46a0 con 0x559a981f5500 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ceffd640 1 -- 172.21.15.26:0/650488005 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9e00a8d50 con 0x559a981f5500 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ceffd640 1 -- 172.21.15.26:0/650488005 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fc9e00e8020 con 0x559a981f5500 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 10 client.5082 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 10 client.5082 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:17:02.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 20 client.5082 populate_metadata read hostname 'smithi026' 2024-04-21T09:17:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a982a24c0 0x559a982a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 4 client.5082 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 91.6, "await": true}] 2024-04-21T09:17:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 91.6, "await": true}) -- 0x559a9804c610 con 0x559a982a24c0 2024-04-21T09:17:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a982a24c0 0x559a982a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ceffd640 10 client.5082 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:02.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:02.600+0000 7fc9ef7fe640 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a982a24c0 0x559a982a28d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a80f78b87f420869 server_cookie=b2c9fd2e0af47de1 in_seq=0 out_seq=0 2024-04-21T09:17:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.708+0000 7fc9ceffd640 1 -- 172.21.15.26:0/650488005 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x559a9804c610 con 0x559a982a24c0 2024-04-21T09:17:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.708+0000 7fc9ceffd640 10 client.5082 handle_command_reply: tid=0 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.708+0000 7fc9f9936000 1 client.5082 shutdown 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 msgr2=0x559a981f3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a981f3640 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc9e001ed50 tx=0x7fc9e001d550 comp rx=0 tx=0).stop 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 shutdown_connections 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x559a982a24c0 0x559a982a28d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x559a98230990 0x559a982a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x559a9822b5a0 0x559a982a36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 --2- 172.21.15.26:0/650488005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x559a981f5500 0x559a981f3640 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9ceffd640 0 client.5082 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 >> 172.21.15.26:0/650488005 conn(0x559a9822c200 msgr2=0x559a9824b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 shutdown_connections 2024-04-21T09:17:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 1 -- 172.21.15.26:0/650488005 wait complete. 2024-04-21T09:17:03.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f9936000 20 client.5082 trim_cache size 0 max 16384 2024-04-21T09:17:03.710 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:17:03.710 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:17:03.710 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 22, 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "a233287": { 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 22, 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 91.6, 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:17:03.711 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:03.712 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:17:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9dc0683b0 msgr2=0x7fc9dc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9dc0683b0 0x7fc9dc06a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc9e00b2000 tx=0x7fc9e0009040 comp rx=0 tx=0).stop 2024-04-21T09:17:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152cf0 msgr2=0x7fc9f00ccf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152cf0 0x7fc9f00ccf70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8009fa0 tx=0x7fc9e800d560 comp rx=0 tx=0).stop 2024-04-21T09:17:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 shutdown_connections 2024-04-21T09:17:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc9dc0683b0 0x7fc9dc06a870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9f0152cf0 0x7fc9f00ccf70 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc9f0152910 0x7fc9f01e40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 --2- 172.21.15.26:0/1902733388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc9f00c79a0 0x7fc9f0151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 >> 172.21.15.26:0/1902733388 conn(0x7fc9f0070190 msgr2=0x7fc9f00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 shutdown_connections 2024-04-21T09:17:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:03.712+0000 7fc9f67b4640 1 -- 172.21.15.26:0/1902733388 wait complete. 2024-04-21T09:17:03.733 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: a233287, quiesce duration: 31.6 2024-04-21T09:17:35.334 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:17:35.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.467+0000 7f2519c9f640 1 Processor -- start 2024-04-21T09:17:35.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2519c9f640 1 -- start start 2024-04-21T09:17:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2519c9f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 0x7f251415b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2519c9f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f251415bc40 0x7f25141590c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2519c9f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25140c4c20 con 0x7f25140c5e30 2024-04-21T09:17:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2519c9f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f25140c4f00 con 0x7f251415bc40 2024-04-21T09:17:35.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2519c9f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f25140c51e0 con 0x7f251415b320 2024-04-21T09:17:35.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2513fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f25140c5e30 0x7f2514151460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58768/0 (socket says 172.21.15.26:58768) 2024-04-21T09:17:35.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2513fff640 1 -- 172.21.15.26:0/3941460953 learned_addr learned my addr 172.21.15.26:0/3941460953 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2512ffd640 1 --2- 172.21.15.26:0/3941460953 >> v2:172.21.15.169:3300/0 conn(0x7f251415bc40 0x7f25141590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25137fe640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 0x7f251415b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072250988 0 0) 0x7f25140c4c20 con 0x7f25140c5e30 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2500003530 con 0x7f25140c5e30 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1204167206 0 0) 0x7f2500003530 con 0x7f25140c5e30 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 msgr2=0x7f251415b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 0x7f251415b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 >> v2:172.21.15.169:3300/0 conn(0x7f251415bc40 msgr2=0x7f25141590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 --2- 172.21.15.26:0/3941460953 >> v2:172.21.15.169:3300/0 conn(0x7f251415bc40 0x7f25141590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25140c54c0 con 0x7f25140c5e30 2024-04-21T09:17:35.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f250c001a00 con 0x7f25140c5e30 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 >> v1:172.21.15.26:6789/0 conn(0x7f25140c5e30 legacy=0x7f2514151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 0x7f25000039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2500003f40 0x7f2500004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500004d50 0x7f25000051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f25140c4f00 con 0x7f2500003f40 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25140c51e0 con 0x7f2500004d50 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f250000ba00 con 0x7f251415b320 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2512ffd640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2500003f40 0x7f2500004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2513fff640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500004d50 0x7f25000051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f25137fe640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 0x7f25000039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2512ffd640 1 -- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 msgr2=0x7f25000039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2512ffd640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415b320 0x7f25000039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2512ffd640 1 -- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500004d50 msgr2=0x7f25000051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2512ffd640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500004d50 0x7f25000051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2512ffd640 1 -- 172.21.15.26:0/3941460953 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2500003530 con 0x7f2500003f40 2024-04-21T09:17:35.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.471+0000 7f2513fff640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500004d50 0x7f25000051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2512ffd640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2500003f40 0x7f2500004810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009ae0 tx=0x7f24fc01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154147700c6d4dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0b2070 con 0x7f2500003f40 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24fc0a56a0 con 0x7f2500003f40 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f25127fc640 1 -- 172.21.15.26:0/3941460953 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24fc0096b0 con 0x7f2500003f40 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- 172.21.15.26:0/3941460953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2500003f40 msgr2=0x7f2500004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 --2- 172.21.15.26:0/3941460953 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2500003f40 0x7f2500004810 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f24fc009ae0 tx=0x7f24fc01cab0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2513fff640 1 -- 172.21.15.26:0/3941460953 reap_dead start 2024-04-21T09:17:35.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- 172.21.15.26:0/3941460953 shutdown_connections 2024-04-21T09:17:35.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- 172.21.15.26:0/3941460953 >> 172.21.15.26:0/3941460953 conn(0x7f25140c8960 msgr2=0x7f25140c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- 172.21.15.26:0/3941460953 shutdown_connections 2024-04-21T09:17:35.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- 172.21.15.26:0/3941460953 wait complete. 2024-04-21T09:17:35.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 Processor -- start 2024-04-21T09:17:35.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- start start 2024-04-21T09:17:35.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500003f40 0x7f25140714b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415aa90 0x7f25140c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25140719f0 0x7f25140c7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f25140c9710 con 0x7f25140719f0 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f25140bfa30 con 0x7f2500003f40 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.475+0000 7f2519c9f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f25140c9890 con 0x7f251415aa90 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25140719f0 0x7f25140c7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25140719f0 0x7f25140c7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59150/0 (socket says 172.21.15.26:59150) 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 -- 172.21.15.26:0/2670275342 learned_addr learned my addr 172.21.15.26:0/2670275342 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2512ffd640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415aa90 0x7f25140c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f25137fe640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500003f40 0x7f25140714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 -- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415aa90 msgr2=0x7f25140c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415aa90 0x7f25140c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 -- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500003f40 msgr2=0x7f25140714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500003f40 0x7f25140714b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 -- 172.21.15.26:0/2670275342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25141f2890 con 0x7f25140719f0 2024-04-21T09:17:35.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2513fff640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25140719f0 0x7f25140c7fb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f250c002240 tx=0x7f250c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f250bfff640 1 -- 172.21.15.26:0/2670275342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c007ae0 con 0x7f25140719f0 2024-04-21T09:17:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f250bfff640 1 -- 172.21.15.26:0/2670275342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250c00eda0 con 0x7f25140719f0 2024-04-21T09:17:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25141f2b30 con 0x7f25140719f0 2024-04-21T09:17:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f250bfff640 1 -- 172.21.15.26:0/2670275342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f250c014650 con 0x7f25140719f0 2024-04-21T09:17:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25141eead0 con 0x7f25140719f0 2024-04-21T09:17:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2514075ef0 con 0x7f25140719f0 2024-04-21T09:17:35.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f250bfff640 1 -- 172.21.15.26:0/2670275342 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f250c0147f0 con 0x7f25140719f0 2024-04-21T09:17:35.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f250bfff640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f24f4068380 0x7f24f406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f250bfff640 1 -- 172.21.15.26:0/2670275342 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f250c086910 con 0x7f25140719f0 2024-04-21T09:17:35.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f25137fe640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f24f4068380 0x7f24f406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.479+0000 7f25137fe640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f24f4068380 0x7f24f406a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2504009950 tx=0x7f2504008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.483+0000 7f250bfff640 1 -- 172.21.15.26:0/2670275342 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f250c056e00 con 0x7f25140719f0 2024-04-21T09:17:35.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.683+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25141511b0 con 0x7f25140719f0 2024-04-21T09:17:35.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f250bfff640 1 -- 172.21.15.26:0/2670275342 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f250c056700 con 0x7f25140719f0 2024-04-21T09:17:35.684 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:17:35.685 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:17:35.685 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:17:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f24f4068380 msgr2=0x7f24f406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f24f4068380 0x7f24f406a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2504009950 tx=0x7f2504008040 comp rx=0 tx=0).stop 2024-04-21T09:17:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25140719f0 msgr2=0x7f25140c7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25140719f0 0x7f25140c7fb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f250c002240 tx=0x7f250c00e530 comp rx=0 tx=0).stop 2024-04-21T09:17:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 shutdown_connections 2024-04-21T09:17:35.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f24f4068380 0x7f24f406a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f25140719f0 0x7f25140c7fb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f251415aa90 0x7f25140c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 --2- 172.21.15.26:0/2670275342 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2500003f40 0x7f25140714b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 >> 172.21.15.26:0/2670275342 conn(0x7f25140c8960 msgr2=0x7f25140c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 shutdown_connections 2024-04-21T09:17:35.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.687+0000 7f2519c9f640 1 -- 172.21.15.26:0/2670275342 wait complete. 2024-04-21T09:17:35.704 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id a233287 --release --await' 2024-04-21T09:17:35.704 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id a233287 --release --await 2024-04-21T09:17:35.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 Processor -- start 2024-04-21T09:17:35.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 -- start start 2024-04-21T09:17:35.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb48151bc0 0x7fcb48072d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcb48151fa0 0x7fcb480732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb480c5e30 0x7fcb48157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4806d1b0 con 0x7fcb480c5e30 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480bfbb0 con 0x7fcb48151fa0 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4e800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4806ced0 con 0x7fcb48151bc0 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb480c5e30 0x7fcb48157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcb480c5e30 0x7fcb48157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59152/0 (socket says 172.21.15.26:59152) 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/3355940762 learned_addr learned my addr 172.21.15.26:0/3355940762 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb47fff640 1 --2- 172.21.15.26:0/3355940762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb48151bc0 0x7fcb48072d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb477fe640 1 --2- 172.21.15.26:0/3355940762 >> v2:172.21.15.169:3300/0 conn(0x7fcb48151fa0 0x7fcb480732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/3355940762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb48151bc0 msgr2=0x7fcb48072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/3355940762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb48151bc0 0x7fcb48072d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/3355940762 >> v2:172.21.15.169:3300/0 conn(0x7fcb48151fa0 msgr2=0x7fcb480732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/3355940762 >> v2:172.21.15.169:3300/0 conn(0x7fcb48151fa0 0x7fcb480732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/3355940762 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48071fd0 con 0x7fcb480c5e30 2024-04-21T09:17:35.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb477fe640 1 --2- 172.21.15.26:0/3355940762 >> v2:172.21.15.169:3300/0 conn(0x7fcb48151fa0 0x7fcb480732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:17:35.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.843+0000 7fcb47fff640 1 --2- 172.21.15.26:0/3355940762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb48151bc0 0x7fcb48072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:17:35.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/3355940762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480c5e30 0x7fcb48157a10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcb480c8910 tx=0x7fcb4001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cf73e3b648fa2f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb46ffd640 1 -- 172.21.15.26:0/3355940762 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000b2d0 con 0x7fcb480c5e30 2024-04-21T09:17:35.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb46ffd640 1 -- 172.21.15.26:0/3355940762 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4000b470 con 0x7fcb480c5e30 2024-04-21T09:17:35.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb46ffd640 1 -- 172.21.15.26:0/3355940762 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb400a7ca0 con 0x7fcb480c5e30 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 -- 172.21.15.26:0/3355940762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480c5e30 msgr2=0x7fcb48157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 --2- 172.21.15.26:0/3355940762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480c5e30 0x7fcb48157a10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcb480c8910 tx=0x7fcb4001ebf0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 -- 172.21.15.26:0/3355940762 shutdown_connections 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 --2- 172.21.15.26:0/3355940762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb480c5e30 0x7fcb48157a10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 --2- 172.21.15.26:0/3355940762 >> v2:172.21.15.169:3300/0 conn(0x7fcb48151fa0 0x7fcb480732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 --2- 172.21.15.26:0/3355940762 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb48151bc0 0x7fcb48072d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 -- 172.21.15.26:0/3355940762 >> 172.21.15.26:0/3355940762 conn(0x7fcb480cbef0 msgr2=0x7fcb480cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 -- 172.21.15.26:0/3355940762 shutdown_connections 2024-04-21T09:17:35.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 -- 172.21.15.26:0/3355940762 wait complete. 2024-04-21T09:17:35.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 Processor -- start 2024-04-21T09:17:35.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.847+0000 7fcb4e800640 1 -- start start 2024-04-21T09:17:35.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb480c5e30 0x7fcb480caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb48151bc0 0x7fcb481f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48151fa0 0x7fcb4814a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4806cc80 con 0x7fcb48151fa0 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4806cb00 con 0x7fcb48151bc0 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4815af30 con 0x7fcb480c5e30 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48151fa0 0x7fcb4814a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48151fa0 0x7fcb4814a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59160/0 (socket says 172.21.15.26:59160) 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/964688464 learned_addr learned my addr 172.21.15.26:0/964688464 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb47fff640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb480c5e30 0x7fcb480caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb477fe640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb48151bc0 0x7fcb481f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb480c5e30 msgr2=0x7fcb480caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb480c5e30 0x7fcb480caf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb48151bc0 msgr2=0x7fcb481f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb48151bc0 0x7fcb481f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/964688464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4815fa30 con 0x7fcb48151fa0 2024-04-21T09:17:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48151fa0 0x7fcb4814a1e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcb4001ea20 tx=0x7fcb4001b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb44ff9640 1 -- 172.21.15.26:0/964688464 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40009600 con 0x7fcb48151fa0 2024-04-21T09:17:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb44ff9640 1 -- 172.21.15.26:0/964688464 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb400097c0 con 0x7fcb48151fa0 2024-04-21T09:17:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4815fd10 con 0x7fcb48151fa0 2024-04-21T09:17:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb44ff9640 1 -- 172.21.15.26:0/964688464 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40009bb0 con 0x7fcb48151fa0 2024-04-21T09:17:35.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb481f71f0 con 0x7fcb48151fa0 2024-04-21T09:17:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb44ff9640 1 -- 172.21.15.26:0/964688464 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcb400c0020 con 0x7fcb48151fa0 2024-04-21T09:17:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb44ff9640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb34068380 0x7fcb3406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb44ff9640 1 -- 172.21.15.26:0/964688464 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fcb40121870 con 0x7fcb48151fa0 2024-04-21T09:17:35.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.851+0000 7fcb47fff640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb34068380 0x7fcb3406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 Processor -- start 2024-04-21T09:17:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- start start 2024-04-21T09:17:35.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb34068380 0x7fcb3406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c880 tx=0x7fcb3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabed79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabed82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf13500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558eabd1f660 con 0x558eabf0e8a0 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558eabcc45d0 con 0x558eabed7f00 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558eabd1b620 con 0x558eabf13120 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabed79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabed79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59172/0 (socket says 172.21.15.26:59172) 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 -- 172.21.15.26:0/729628754 learned_addr learned my addr 172.21.15.26:0/729628754 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf13500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb477fe640 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabed82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 -- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 msgr2=0x558eabf13500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf13500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 -- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 msgr2=0x558eabed82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabed82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 -- 172.21.15.26:0/729628754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eabcf8bd0 con 0x558eabf0e8a0 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf13500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb477fe640 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabed82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb47fff640 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabed79c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c010950 tx=0x7fcb3c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8c1f4f128b58c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb2dffb640 1 -- 172.21.15.26:0/729628754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c01c050 con 0x558eabf0e8a0 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb2dffb640 1 -- 172.21.15.26:0/729628754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c026070 con 0x558eabf0e8a0 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb2dffb640 1 -- 172.21.15.26:0/729628754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00f040 con 0x558eabf0e8a0 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- 172.21.15.26:0/729628754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 msgr2=0x558eabed79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabed79c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c010950 tx=0x7fcb3c013000 comp rx=0 tx=0).stop 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- 172.21.15.26:0/729628754 shutdown_connections 2024-04-21T09:17:35.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf13500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabed82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 --2- 172.21.15.26:0/729628754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabed79c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- 172.21.15.26:0/729628754 >> 172.21.15.26:0/729628754 conn(0x558eabdb9b00 msgr2=0x558eabf10ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- 172.21.15.26:0/729628754 shutdown_connections 2024-04-21T09:17:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- 172.21.15.26:0/729628754 wait complete. 2024-04-21T09:17:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 -- start start 2024-04-21T09:17:35.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.855+0000 7fcb51982000 1 Processor -- start 2024-04-21T09:17:35.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabed7f00 0x558eabf0d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf0db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabf13120 0x558eabed2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558eabddcd40 con 0x558eabf0e8a0 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558eabcd9eb0 con 0x558eabf13120 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558eabd1a2a0 con 0x558eabed7f00 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 10 client.0 _ll_register_callbacks cb 0x558eabebda90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf0db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf0db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59174/0 (socket says 172.21.15.26:59174) 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 -- 172.21.15.26:0/510499809 learned_addr learned my addr 172.21.15.26:0/510499809 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabf13120 0x558eabed2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb47fff640 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabed7f00 0x558eabf0d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 -- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabed7f00 msgr2=0x558eabf0d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabed7f00 0x558eabf0d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 -- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabf13120 msgr2=0x558eabed2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabf13120 0x558eabed2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 -- 172.21.15.26:0/510499809 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eabd65b30 con 0x558eabf0e8a0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb477fe640 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf0db90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb38010520 tx=0x7fcb380109e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f0cc863845553c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 1 -- 172.21.15.26:0/510499809 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3800f040 con 0x558eabf0e8a0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 1 -- 172.21.15.26:0/510499809 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fcb38004220 con 0x558eabf0e8a0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558eabcb9060 con 0x558eabf0e8a0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 1 -- 172.21.15.26:0/510499809 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fcb38023050 con 0x558eabf0e8a0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 10 client.5100 fetch_fsmap learned FSMap version 8 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558eabcbeb70 con 0x558eabf0e8a0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 1 -- 172.21.15.26:0/510499809 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x558eabcb9060 con 0x558eabf0e8a0 2024-04-21T09:17:35.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 1 -- 172.21.15.26:0/510499809 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fcb38026020 con 0x558eabf0e8a0 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 10 client.5100 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 10 client.5100 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 20 client.5100 populate_metadata read hostname 'smithi026' 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabed36a0 0x558eabed3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 4 client.5100 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558eabcf7e30 con 0x558eabed36a0 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb47fff640 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabed36a0 0x558eabed3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb47fff640 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabed36a0 0x558eabed3ab0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79ac1f903fe9d652 server_cookie=c92b4378ca0b892b in_seq=0 out_seq=0 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 10 client.5100 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 1 -- 172.21.15.26:0/510499809 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558eabcf7e30 con 0x558eabed36a0 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.859+0000 7fcb26ffd640 10 client.5100 handle_command_reply: tid=0 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 client.5100 shutdown 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 msgr2=0x558eabf0db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf0db90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fcb38010520 tx=0x7fcb380109e0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 shutdown_connections 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabed36a0 0x558eabed3ab0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabf13120 0x558eabed2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf0db90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 --2- 172.21.15.26:0/510499809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabed7f00 0x558eabf0d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 >> 172.21.15.26:0/510499809 conn(0x558eabdb9b00 msgr2=0x558eabf129a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb26ffd640 0 client.5100 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 shutdown_connections 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 1 -- 172.21.15.26:0/510499809 wait complete. 2024-04-21T09:17:35.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.863+0000 7fcb51982000 20 client.5100 trim_cache size 0 max 16384 2024-04-21T09:17:35.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 Processor -- start 2024-04-21T09:17:35.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- start start 2024-04-21T09:17:35.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf7caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf0e8a0 0x558eabf7d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf13120 0x558eabf7d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcb481ff680 con 0x558eabf13120 2024-04-21T09:17:35.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcb481f45a0 con 0x558eabed7f00 2024-04-21T09:17:35.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4814b290 con 0x558eabf0e8a0 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf13120 0x558eabf7d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf13120 0x558eabf7d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59176/0 (socket says 172.21.15.26:59176) 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/1845762260 learned_addr learned my addr 172.21.15.26:0/1845762260 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb47fff640 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf7caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb477fe640 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf0e8a0 0x558eabf7d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf0e8a0 msgr2=0x558eabf7d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf0e8a0 0x558eabf7d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 msgr2=0x558eabf7caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf7caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 -- 172.21.15.26:0/1845762260 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558eabda15e0 con 0x558eabf13120 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf13120 0x558eabf7d570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb400251a0 tx=0x7fcb400f8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d545b112526f75 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb2d7fa640 1 -- 172.21.15.26:0/1845762260 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb400f1660 con 0x558eabf13120 2024-04-21T09:17:35.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb2d7fa640 1 -- 172.21.15.26:0/1845762260 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb400f5a10 con 0x558eabf13120 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb2d7fa640 1 -- 172.21.15.26:0/1845762260 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb400fa240 con 0x558eabf13120 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- 172.21.15.26:0/1845762260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf13120 msgr2=0x558eabf7d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf13120 0x558eabf7d570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fcb400251a0 tx=0x7fcb400f8040 comp rx=0 tx=0).stop 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- 172.21.15.26:0/1845762260 shutdown_connections 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf13120 0x558eabf7d570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf0e8a0 0x558eabf7d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 --2- 172.21.15.26:0/1845762260 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf7caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- 172.21.15.26:0/1845762260 >> 172.21.15.26:0/1845762260 conn(0x558eabdb9b00 msgr2=0x558eabed5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- 172.21.15.26:0/1845762260 shutdown_connections 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.879+0000 7fcb51982000 1 -- 172.21.15.26:0/1845762260 wait complete. 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 -- start start 2024-04-21T09:17:35.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 Processor -- start 2024-04-21T09:17:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf2c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf2c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf2cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558eabd1e970 con 0x558eabf0e8a0 2024-04-21T09:17:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558eabcd48f0 con 0x558eabed7f00 2024-04-21T09:17:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558eabd23c90 con 0x558eabf13120 2024-04-21T09:17:35.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 10 client.0 _ll_register_callbacks cb 0x7fcb3800e1b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf2c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf2c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59178/0 (socket says 172.21.15.26:59178) 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 -- 172.21.15.26:0/3927002118 learned_addr learned my addr 172.21.15.26:0/3927002118 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb47fff640 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf2c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb4cd9d640 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf2cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 -- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 msgr2=0x558eabf2cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf2cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 -- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 msgr2=0x558eabf2c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf2c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 -- 172.21.15.26:0/3927002118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558eabcb1ae0 con 0x558eabf0e8a0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb477fe640 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf2c880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb380143c0 tx=0x7fcb38013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df30855f5849e188 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb26ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb26ffd640 1 -- 172.21.15.26:0/3927002118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3802b070 con 0x558eabf0e8a0 2024-04-21T09:17:35.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb26ffd640 1 -- 172.21.15.26:0/3927002118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fcb38014c50 con 0x558eabf0e8a0 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb400f5a10 con 0x558eabf0e8a0 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb26ffd640 1 -- 172.21.15.26:0/3927002118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fcb38035050 con 0x558eabf0e8a0 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 10 client.5106 fetch_fsmap learned FSMap version 8 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558eabcb4d80 con 0x558eabf0e8a0 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb26ffd640 1 -- 172.21.15.26:0/3927002118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb400f5a10 con 0x558eabf0e8a0 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb26ffd640 1 -- 172.21.15.26:0/3927002118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fcb38038020 con 0x558eabf0e8a0 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 10 client.5106 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 10 client.5106 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 20 client.5106 populate_metadata read hostname 'smithi026' 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabf8d5a0 0x558eabf8f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 4 client.5106 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a233287", "release": true, "await": true}] 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a233287", "release": true, "await": true}) -- 0x558eabcbd0d0 con 0x558eabf8d5a0 2024-04-21T09:17:35.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb47fff640 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabf8d5a0 0x558eabf8f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb26ffd640 10 client.5106 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.883+0000 7fcb47fff640 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabf8d5a0 0x558eabf8f990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62237a5e861741f server_cookie=3dbc25809f949cea in_seq=0 out_seq=0 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb26ffd640 1 -- 172.21.15.26:0/3927002118 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x558eabcbd0d0 con 0x558eabf8d5a0 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb26ffd640 10 client.5106 handle_command_reply: tid=0 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 client.5106 shutdown 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 msgr2=0x558eabf2c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf2c880 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb380143c0 tx=0x7fcb38013000 comp rx=0 tx=0).stop 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 shutdown_connections 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558eabf8d5a0 0x558eabf8f990 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558eabf13120 0x558eabf2cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558eabf0e8a0 0x558eabf2c880 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb26ffd640 0 client.5106 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:17:35.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 --2- 172.21.15.26:0/3927002118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558eabed7f00 0x558eabf2c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 >> 172.21.15.26:0/3927002118 conn(0x558eabdb9b00 msgr2=0x558eabed2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 shutdown_connections 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 1 -- 172.21.15.26:0/3927002118 wait complete. 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb51982000 20 client.5106 trim_cache size 0 max 16384 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 24, 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stdout: "a233287": { 2024-04-21T09:17:35.890 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 24, 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 91.6, 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:17:35.891 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:35.892 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:35.892 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:35.892 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:35.892 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:17:35.892 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb34068380 msgr2=0x7fcb3406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb34068380 0x7fcb3406a840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00c880 tx=0x7fcb3c008040 comp rx=0 tx=0).stop 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48151fa0 msgr2=0x7fcb4814a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48151fa0 0x7fcb4814a1e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcb4001ea20 tx=0x7fcb4001b990 comp rx=0 tx=0).stop 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 shutdown_connections 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcb34068380 0x7fcb3406a840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcb48151fa0 0x7fcb4814a1e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb48151bc0 0x7fcb481f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 --2- 172.21.15.26:0/964688464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb480c5e30 0x7fcb480caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 >> 172.21.15.26:0/964688464 conn(0x7fcb480cbef0 msgr2=0x7fcb4814c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:17:35.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 shutdown_connections 2024-04-21T09:17:35.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:17:35.887+0000 7fcb4e800640 1 -- 172.21.15.26:0/964688464 wait complete. 2024-04-21T09:17:35.902 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: a233287, seconds elapsed: 33.9 2024-04-21T09:17:42.568 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 36% (66/181) Updating files: 37% (67/181) Updating files: 38% (69/181) Updating files: 39% (71/181) Updating files: 40% (73/181) Updating files: 41% (75/181) Updating files: 42% (77/181) Updating files: 43% (78/181) Updating files: 44% (80/181) Updating files: 45% (82/181) Updating files: 46% (84/181) Updating files: 47% (86/181) Updating files: 48% (87/181) Updating files: 49% (89/181) Updating files: 50% (91/181) Updating files: 51% (93/181) Updating files: 52% (95/181) Updating files: 53% (96/181) Updating files: 54% (98/181) Updating files: 55% (100/181) Updating files: 56% (102/181) Updating files: 57% (104/181) Updating files: 58% (105/181) Updating files: 59% (107/181) Updating files: 60% (109/181) Updating files: 61% (111/181) Updating files: 62% (113/181) Updating files: 63% (115/181) Updating files: 64% (116/181) Updating files: 65% (118/181) Updating files: 66% (120/181) Updating files: 67% (122/181) Updating files: 68% (124/181) Updating files: 69% (125/181) Updating files: 70% (127/181) Updating files: 71% (129/181) Updating files: 72% (131/181) Updating files: 73% (133/181) Updating files: 74% (134/181) Updating files: 75% (136/181) Updating files: 76% (138/181) Updating files: 77% (140/181) Updating files: 78% (142/181) Updating files: 79% (143/181) Updating files: 80% (145/181) Updating files: 81% (147/181) Updating files: 82% (149/181) Updating files: 83% (151/181) Updating files: 84% (153/181) Updating files: 85% (154/181) Updating files: 86% (156/181) Updating files: 87% (158/181) Updating files: 88% (160/181) Updating files: 89% (162/181) Updating files: 90% (163/181) Updating files: 91% (165/181) Updating files: 92% (167/181) Updating files: 93% (169/181) Updating files: 94% (171/181) Updating files: 95% (172/181) Updating files: 96% (174/181) Updating files: 97% (176/181) Updating files: 98% (178/181) Updating files: 99% (180/181) Updating files: 100% (181/181) Updating files: 100% (181/181), done. 2024-04-21T09:17:42.968 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at a6f3bbb744a v0.37 2024-04-21T09:17:42.973 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.37 2024-04-21T09:17:43.103 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 38 -eq 48 ] 2024-04-21T09:17:43.103 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.38 2024-04-21T09:17:43.103 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.38 2024-04-21T09:17:43.104 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.38 2024-04-21T09:17:43.104 INFO:tasks.workunit.client.0.smithi026.stdout:v0.38 2024-04-21T09:17:47.453 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 44% (76/171) Updating files: 45% (77/171) Updating files: 46% (79/171) Updating files: 47% (81/171) Updating files: 48% (83/171) Updating files: 49% (84/171) Updating files: 50% (86/171) Updating files: 51% (88/171) Updating files: 52% (89/171) Updating files: 53% (91/171) Updating files: 54% (93/171) Updating files: 55% (95/171) Updating files: 56% (96/171) Updating files: 57% (98/171) Updating files: 58% (100/171) Updating files: 59% (101/171) Updating files: 60% (103/171) Updating files: 61% (105/171) Updating files: 62% (107/171) Updating files: 63% (108/171) Updating files: 64% (110/171) Updating files: 65% (112/171) Updating files: 66% (113/171) Updating files: 67% (115/171) Updating files: 68% (117/171) Updating files: 69% (118/171) Updating files: 70% (120/171) Updating files: 71% (122/171) Updating files: 72% (124/171) Updating files: 73% (125/171) Updating files: 74% (127/171) Updating files: 75% (129/171) Updating files: 76% (130/171) Updating files: 77% (132/171) Updating files: 78% (134/171) Updating files: 78% (135/171) Updating files: 79% (136/171) Updating files: 80% (137/171) Updating files: 81% (139/171) Updating files: 82% (141/171) Updating files: 83% (142/171) Updating files: 84% (144/171) Updating files: 85% (146/171) Updating files: 86% (148/171) Updating files: 87% (149/171) Updating files: 88% (151/171) Updating files: 89% (153/171) Updating files: 90% (154/171) Updating files: 91% (156/171) Updating files: 92% (158/171) Updating files: 93% (160/171) Updating files: 94% (161/171) Updating files: 95% (163/171) Updating files: 96% (165/171) Updating files: 97% (166/171) Updating files: 98% (168/171) Updating files: 99% (170/171) Updating files: 100% (171/171) Updating files: 100% (171/171), done. 2024-04-21T09:17:47.730 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at b600ec2ac7c v0.38 2024-04-21T09:17:47.734 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.38 2024-04-21T09:17:47.845 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 39 -eq 48 ] 2024-04-21T09:17:47.845 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.39 2024-04-21T09:17:47.845 INFO:tasks.workunit.client.0.smithi026.stdout:v0.39 2024-04-21T09:17:47.845 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.39 2024-04-21T09:17:47.846 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.39 2024-04-21T09:17:53.170 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 28% (73/258) Updating files: 29% (75/258) Updating files: 30% (78/258) Updating files: 31% (80/258) Updating files: 32% (83/258) Updating files: 33% (86/258) Updating files: 34% (88/258) Updating files: 35% (91/258) Updating files: 36% (93/258) Updating files: 37% (96/258) Updating files: 38% (99/258) Updating files: 39% (101/258) Updating files: 40% (104/258) Updating files: 41% (106/258) Updating files: 42% (109/258) Updating files: 43% (111/258) Updating files: 44% (114/258) Updating files: 45% (117/258) Updating files: 46% (119/258) Updating files: 47% (122/258) Updating files: 48% (124/258) Updating files: 49% (127/258) Updating files: 50% (129/258) Updating files: 51% (132/258) Updating files: 52% (135/258) Updating files: 53% (137/258) Updating files: 53% (139/258) Updating files: 54% (140/258) Updating files: 55% (142/258) Updating files: 56% (145/258) Updating files: 57% (148/258) Updating files: 58% (150/258) Updating files: 59% (153/258) Updating files: 60% (155/258) Updating files: 61% (158/258) Updating files: 62% (160/258) Updating files: 63% (163/258) Updating files: 64% (166/258) Updating files: 65% (168/258) Updating files: 66% (171/258) Updating files: 67% (173/258) Updating files: 68% (176/258) Updating files: 69% (179/258) Updating files: 70% (181/258) Updating files: 71% (184/258) Updating files: 72% (186/258) Updating files: 73% (189/258) Updating files: 74% (191/258) Updating files: 75% (194/258) Updating files: 76% (197/258) Updating files: 77% (199/258) Updating files: 78% (202/258) Updating files: 79% (204/258) Updating files: 79% (205/258) Updating files: 80% (207/258) Updating files: 81% (209/258) Updating files: 82% (212/258) Updating files: 83% (215/258) Updating files: 84% (217/258) Updating files: 85% (220/258) Updating files: 86% (222/258) Updating files: 87% (225/258) Updating files: 88% (228/258) Updating files: 89% (230/258) Updating files: 90% (233/258) Updating files: 91% (235/258) Updating files: 92% (238/258) Updating files: 93% (240/258) Updating files: 94% (243/258) Updating files: 95% (246/258) Updating files: 96% (248/258) Updating files: 97% (251/258) Updating files: 98% (253/258) Updating files: 99% (256/258) Updating files: 100% (258/258) Updating files: 100% (258/258), done. 2024-04-21T09:17:53.335 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 321ecdaba2c v0.39 2024-04-21T09:17:53.338 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.39 2024-04-21T09:17:53.520 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 40 -eq 48 ] 2024-04-21T09:17:53.520 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.40 2024-04-21T09:17:53.520 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.40 2024-04-21T09:17:53.520 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.40 2024-04-21T09:17:53.520 INFO:tasks.workunit.client.0.smithi026.stdout:v0.40 2024-04-21T09:17:58.569 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 36% (82/226) Updating files: 37% (84/226) Updating files: 38% (86/226) Updating files: 39% (89/226) Updating files: 40% (91/226) Updating files: 41% (93/226) Updating files: 42% (95/226) Updating files: 43% (98/226) Updating files: 44% (100/226) Updating files: 45% (102/226) Updating files: 46% (104/226) Updating files: 47% (107/226) Updating files: 48% (109/226) Updating files: 49% (111/226) Updating files: 50% (113/226) Updating files: 51% (116/226) Updating files: 52% (118/226) Updating files: 53% (120/226) Updating files: 54% (123/226) Updating files: 55% (125/226) Updating files: 56% (127/226) Updating files: 57% (129/226) Updating files: 58% (132/226) Updating files: 59% (134/226) Updating files: 60% (136/226) Updating files: 61% (138/226) Updating files: 62% (141/226) Updating files: 62% (142/226) Updating files: 63% (143/226) Updating files: 64% (145/226) Updating files: 65% (147/226) Updating files: 66% (150/226) Updating files: 67% (152/226) Updating files: 68% (154/226) Updating files: 69% (156/226) Updating files: 70% (159/226) Updating files: 71% (161/226) Updating files: 72% (163/226) Updating files: 73% (165/226) Updating files: 74% (168/226) Updating files: 75% (170/226) Updating files: 76% (172/226) Updating files: 77% (175/226) Updating files: 78% (177/226) Updating files: 79% (179/226) Updating files: 80% (181/226) Updating files: 81% (184/226) Updating files: 82% (186/226) Updating files: 83% (188/226) Updating files: 84% (190/226) Updating files: 85% (193/226) Updating files: 86% (195/226) Updating files: 87% (197/226) Updating files: 88% (199/226) Updating files: 89% (202/226) Updating files: 90% (204/226) Updating files: 90% (205/226) Updating files: 91% (206/226) Updating files: 92% (208/226) Updating files: 93% (211/226) Updating files: 94% (213/226) Updating files: 95% (215/226) Updating files: 96% (217/226) Updating files: 97% (220/226) Updating files: 98% (222/226) Updating files: 99% (224/226) Updating files: 100% (226/226) Updating files: 100% (226/226), done. 2024-04-21T09:17:58.804 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 7eea40ea37f v0.40 2024-04-21T09:17:58.807 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.40 2024-04-21T09:17:58.997 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 41 -eq 48 ] 2024-04-21T09:17:58.997 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.41 2024-04-21T09:17:58.997 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.41 2024-04-21T09:17:58.997 INFO:tasks.workunit.client.0.smithi026.stdout:v0.41 2024-04-21T09:17:58.997 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.41 2024-04-21T09:18:02.032 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 77% (67/87) Updating files: 78% (68/87) Updating files: 79% (69/87) Updating files: 80% (70/87) Updating files: 81% (71/87) Updating files: 82% (72/87) Updating files: 83% (73/87) Updating files: 85% (74/87) Updating files: 86% (75/87) Updating files: 87% (76/87) Updating files: 88% (77/87) Updating files: 89% (78/87) Updating files: 90% (79/87) Updating files: 91% (80/87) Updating files: 93% (81/87) Updating files: 94% (82/87) Updating files: 95% (83/87) Updating files: 96% (84/87) Updating files: 97% (85/87) Updating files: 98% (86/87) Updating files: 100% (87/87) Updating files: 100% (87/87), done. 2024-04-21T09:18:02.299 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at c1345f7136a v0.41 2024-04-21T09:18:02.302 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.41 2024-04-21T09:18:02.361 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 42 -eq 48 ] 2024-04-21T09:18:02.362 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.42 2024-04-21T09:18:02.362 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.42 2024-04-21T09:18:02.362 INFO:tasks.workunit.client.0.smithi026.stdout:v0.42 2024-04-21T09:18:02.363 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.42 2024-04-21T09:18:07.131 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 32% (81/250) Updating files: 33% (83/250) Updating files: 34% (85/250) Updating files: 35% (88/250) Updating files: 36% (90/250) Updating files: 37% (93/250) Updating files: 38% (95/250) Updating files: 39% (98/250) Updating files: 40% (100/250) Updating files: 41% (103/250) Updating files: 42% (105/250) Updating files: 43% (108/250) Updating files: 44% (110/250) Updating files: 45% (113/250) Updating files: 46% (115/250) Updating files: 47% (118/250) Updating files: 48% (120/250) Updating files: 49% (123/250) Updating files: 50% (125/250) Updating files: 51% (128/250) Updating files: 52% (130/250) Updating files: 53% (133/250) Updating files: 54% (135/250) Updating files: 55% (138/250) Updating files: 56% (140/250) Updating files: 57% (143/250) Updating files: 58% (145/250) Updating files: 59% (148/250) Updating files: 60% (150/250) Updating files: 61% (153/250) Updating files: 62% (155/250) Updating files: 63% (158/250) Updating files: 64% (160/250) Updating files: 65% (163/250) Updating files: 66% (165/250) Updating files: 67% (168/250) Updating files: 67% (169/250) Updating files: 68% (170/250) Updating files: 69% (173/250) Updating files: 70% (175/250) Updating files: 71% (178/250) Updating files: 72% (180/250) Updating files: 73% (183/250) Updating files: 74% (185/250) Updating files: 75% (188/250) Updating files: 76% (190/250) Updating files: 77% (193/250) Updating files: 78% (195/250) Updating files: 79% (198/250) Updating files: 80% (200/250) Updating files: 81% (203/250) Updating files: 82% (205/250) Updating files: 83% (208/250) Updating files: 84% (210/250) Updating files: 85% (213/250) Updating files: 86% (215/250) Updating files: 87% (218/250) Updating files: 88% (220/250) Updating files: 89% (223/250) Updating files: 90% (225/250) Updating files: 91% (228/250) Updating files: 92% (230/250) Updating files: 93% (233/250) Updating files: 94% (235/250) Updating files: 95% (238/250) Updating files: 96% (240/250) Updating files: 97% (243/250) Updating files: 98% (245/250) Updating files: 99% (248/250) Updating files: 99% (249/250) Updating files: 100% (250/250) Updating files: 100% (250/250), done. 2024-04-21T09:18:07.329 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at b205c64c687 v0.42 2024-04-21T09:18:07.333 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.42 2024-04-21T09:18:07.424 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 43 -eq 48 ] 2024-04-21T09:18:07.425 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.43 2024-04-21T09:18:07.425 INFO:tasks.workunit.client.0.smithi026.stdout:v0.43 2024-04-21T09:18:07.425 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.43 2024-04-21T09:18:07.425 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.43 2024-04-21T09:18:09.963 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 96% (107/111) Updating files: 97% (108/111) Updating files: 98% (109/111) Updating files: 99% (110/111) Updating files: 100% (111/111) Updating files: 100% (111/111), done. 2024-04-21T09:18:10.113 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 9fa8781c014 v0.43 2024-04-21T09:18:10.116 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.43 2024-04-21T09:18:10.269 INFO:tasks.workunit.client.0.smithi026.stdout:v0.44 2024-04-21T09:18:10.269 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 44 -eq 48 ] 2024-04-21T09:18:10.269 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.44 2024-04-21T09:18:10.270 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.44 2024-04-21T09:18:10.270 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.44 2024-04-21T09:18:14.589 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 41% (78/186) Updating files: 42% (79/186) Updating files: 43% (80/186) Updating files: 44% (82/186) Updating files: 45% (84/186) Updating files: 46% (86/186) Updating files: 47% (88/186) Updating files: 48% (90/186) Updating files: 49% (92/186) Updating files: 50% (93/186) Updating files: 51% (95/186) Updating files: 52% (97/186) Updating files: 53% (99/186) Updating files: 54% (101/186) Updating files: 55% (103/186) Updating files: 56% (105/186) Updating files: 57% (107/186) Updating files: 58% (108/186) Updating files: 59% (110/186) Updating files: 60% (112/186) Updating files: 61% (114/186) Updating files: 62% (116/186) Updating files: 63% (118/186) Updating files: 64% (120/186) Updating files: 65% (121/186) Updating files: 66% (123/186) Updating files: 67% (125/186) Updating files: 68% (127/186) Updating files: 69% (129/186) Updating files: 70% (131/186) Updating files: 71% (133/186) Updating files: 72% (134/186) Updating files: 73% (136/186) Updating files: 74% (138/186) Updating files: 75% (140/186) Updating files: 76% (142/186) Updating files: 77% (144/186) Updating files: 78% (146/186) Updating files: 79% (147/186) Updating files: 80% (149/186) Updating files: 81% (151/186) Updating files: 82% (153/186) Updating files: 83% (155/186) Updating files: 84% (157/186) Updating files: 85% (159/186) Updating files: 86% (160/186) Updating files: 87% (162/186) Updating files: 88% (164/186) Updating files: 89% (166/186) Updating files: 90% (168/186) Updating files: 91% (170/186) Updating files: 92% (172/186) Updating files: 93% (173/186) Updating files: 94% (175/186) Updating files: 95% (177/186) Updating files: 96% (179/186) Updating files: 97% (181/186) Updating files: 98% (183/186) Updating files: 99% (185/186) Updating files: 100% (186/186) Updating files: 100% (186/186), done. 2024-04-21T09:18:15.057 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at cdd5298d276 v0.44 2024-04-21T09:18:15.061 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.44 2024-04-21T09:18:15.296 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 45 -eq 48 ] 2024-04-21T09:18:15.296 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.45 2024-04-21T09:18:15.296 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.45 2024-04-21T09:18:15.297 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.45 2024-04-21T09:18:15.297 INFO:tasks.workunit.client.0.smithi026.stdout:v0.45 2024-04-21T09:18:19.327 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 44% (69/154) Updating files: 45% (70/154) Updating files: 46% (71/154) Updating files: 47% (73/154) Updating files: 48% (74/154) Updating files: 49% (76/154) Updating files: 50% (77/154) Updating files: 51% (79/154) Updating files: 52% (81/154) Updating files: 53% (82/154) Updating files: 54% (84/154) Updating files: 55% (85/154) Updating files: 56% (87/154) Updating files: 57% (88/154) Updating files: 58% (90/154) Updating files: 59% (91/154) Updating files: 60% (93/154) Updating files: 61% (94/154) Updating files: 62% (96/154) Updating files: 63% (98/154) Updating files: 64% (99/154) Updating files: 65% (101/154) Updating files: 66% (102/154) Updating files: 67% (104/154) Updating files: 68% (105/154) Updating files: 69% (107/154) Updating files: 70% (108/154) Updating files: 71% (110/154) Updating files: 72% (111/154) Updating files: 73% (113/154) Updating files: 74% (114/154) Updating files: 75% (116/154) Updating files: 76% (118/154) Updating files: 77% (119/154) Updating files: 78% (121/154) Updating files: 79% (122/154) Updating files: 79% (123/154) Updating files: 80% (124/154) Updating files: 81% (125/154) Updating files: 82% (127/154) Updating files: 83% (128/154) Updating files: 84% (130/154) Updating files: 85% (131/154) Updating files: 86% (133/154) Updating files: 87% (134/154) Updating files: 88% (136/154) Updating files: 89% (138/154) Updating files: 90% (139/154) Updating files: 91% (141/154) Updating files: 92% (142/154) Updating files: 93% (144/154) Updating files: 94% (145/154) Updating files: 95% (147/154) Updating files: 96% (148/154) Updating files: 97% (150/154) Updating files: 98% (151/154) Updating files: 99% (153/154) Updating files: 100% (154/154) Updating files: 100% (154/154), done. 2024-04-21T09:18:19.637 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 0aea1cb1df5 v0.45 2024-04-21T09:18:19.641 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.45 2024-04-21T09:18:19.788 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 46 -eq 48 ] 2024-04-21T09:18:19.788 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.46 2024-04-21T09:18:19.788 INFO:tasks.workunit.client.0.smithi026.stdout:v0.46 2024-04-21T09:18:19.788 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.46 2024-04-21T09:18:19.789 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.46 2024-04-21T09:18:26.404 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 23% (73/309) Updating files: 24% (75/309) Updating files: 25% (78/309) Updating files: 26% (81/309) Updating files: 27% (84/309) Updating files: 28% (87/309) Updating files: 29% (90/309) Updating files: 30% (93/309) Updating files: 31% (96/309) Updating files: 32% (99/309) Updating files: 33% (102/309) Updating files: 34% (106/309) Updating files: 35% (109/309) Updating files: 36% (112/309) Updating files: 37% (115/309) Updating files: 38% (118/309) Updating files: 39% (121/309) Updating files: 40% (124/309) Updating files: 41% (127/309) Updating files: 41% (129/309) Updating files: 42% (130/309) Updating files: 43% (133/309) Updating files: 44% (136/309) Updating files: 45% (140/309) Updating files: 46% (143/309) Updating files: 47% (146/309) Updating files: 48% (149/309) Updating files: 49% (152/309) Updating files: 50% (155/309) Updating files: 51% (158/309) Updating files: 52% (161/309) Updating files: 53% (164/309) Updating files: 54% (167/309) Updating files: 55% (170/309) Updating files: 56% (174/309) Updating files: 57% (177/309) Updating files: 58% (180/309) Updating files: 59% (183/309) Updating files: 59% (185/309) Updating files: 60% (186/309) Updating files: 61% (189/309) Updating files: 62% (192/309) Updating files: 63% (195/309) Updating files: 64% (198/309) Updating files: 65% (201/309) Updating files: 66% (204/309) Updating files: 67% (208/309) Updating files: 68% (211/309) Updating files: 69% (214/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 96% (297/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2024-04-21T09:18:26.698 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at cb7f1c9c752 v0.46 2024-04-21T09:18:26.702 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.46 2024-04-21T09:18:26.807 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 47 -eq 48 ] 2024-04-21T09:18:26.807 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.47 2024-04-21T09:18:26.807 INFO:tasks.workunit.client.0.smithi026.stdout:v0.47 2024-04-21T09:18:26.807 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.47 2024-04-21T09:18:26.807 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.47 2024-04-21T09:18:32.116 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 34% (75/219) Updating files: 35% (77/219) Updating files: 36% (79/219) Updating files: 37% (82/219) Updating files: 38% (84/219) Updating files: 39% (86/219) Updating files: 40% (88/219) Updating files: 41% (90/219) Updating files: 42% (92/219) Updating files: 43% (95/219) Updating files: 44% (97/219) Updating files: 45% (99/219) Updating files: 46% (101/219) Updating files: 47% (103/219) Updating files: 48% (106/219) Updating files: 49% (108/219) Updating files: 50% (110/219) Updating files: 51% (112/219) Updating files: 52% (114/219) Updating files: 53% (117/219) Updating files: 54% (119/219) Updating files: 55% (121/219) Updating files: 56% (123/219) Updating files: 57% (125/219) Updating files: 58% (128/219) Updating files: 59% (130/219) Updating files: 60% (132/219) Updating files: 61% (134/219) Updating files: 62% (136/219) Updating files: 63% (138/219) Updating files: 64% (141/219) Updating files: 64% (142/219) Updating files: 65% (143/219) Updating files: 66% (145/219) Updating files: 67% (147/219) Updating files: 68% (149/219) Updating files: 69% (152/219) Updating files: 70% (154/219) Updating files: 71% (156/219) Updating files: 72% (158/219) Updating files: 73% (160/219) Updating files: 74% (163/219) Updating files: 75% (165/219) Updating files: 76% (167/219) Updating files: 77% (169/219) Updating files: 78% (171/219) Updating files: 79% (174/219) Updating files: 80% (176/219) Updating files: 81% (178/219) Updating files: 82% (180/219) Updating files: 83% (182/219) Updating files: 84% (184/219) Updating files: 85% (187/219) Updating files: 86% (189/219) Updating files: 87% (191/219) Updating files: 88% (193/219) Updating files: 89% (195/219) Updating files: 89% (196/219) Updating files: 90% (198/219) Updating files: 91% (200/219) Updating files: 92% (202/219) Updating files: 93% (204/219) Updating files: 94% (206/219) Updating files: 95% (209/219) Updating files: 96% (211/219) Updating files: 97% (213/219) Updating files: 98% (215/219) Updating files: 99% (217/219) Updating files: 100% (219/219) Updating files: 100% (219/219), done. 2024-04-21T09:18:32.448 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at ad663d58c89 v0.47 2024-04-21T09:18:32.453 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.47 2024-04-21T09:18:32.542 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 48 -eq 48 ] 2024-04-21T09:18:32.543 INFO:tasks.workunit.client.0.smithi026.stderr:+ continue 2024-04-21T09:18:32.543 INFO:tasks.workunit.client.0.smithi026.stdout:v0.49 2024-04-21T09:18:32.543 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 49 -eq 48 ] 2024-04-21T09:18:32.543 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.49 2024-04-21T09:18:32.543 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.49 2024-04-21T09:18:32.543 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.49 2024-04-21T09:18:40.908 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 19% (94/481) Updating files: 20% (97/481) Updating files: 21% (102/481) Updating files: 22% (106/481) Updating files: 23% (111/481) Updating files: 24% (116/481) Updating files: 25% (121/481) Updating files: 26% (126/481) Updating files: 27% (130/481) Updating files: 28% (135/481) Updating files: 29% (140/481) Updating files: 30% (145/481) Updating files: 31% (150/481) Updating files: 32% (154/481) Updating files: 33% (159/481) Updating files: 34% (164/481) Updating files: 35% (169/481) Updating files: 36% (174/481) Updating files: 37% (178/481) Updating files: 38% (183/481) Updating files: 39% (188/481) Updating files: 40% (193/481) Updating files: 41% (198/481) Updating files: 42% (203/481) Updating files: 43% (207/481) Updating files: 44% (212/481) Updating files: 45% (217/481) Updating files: 46% (222/481) Updating files: 47% (227/481) Updating files: 48% (231/481) Updating files: 48% (233/481) Updating files: 49% (236/481) Updating files: 50% (241/481) Updating files: 51% (246/481) Updating files: 52% (251/481) Updating files: 53% (255/481) Updating files: 54% (260/481) Updating files: 55% (265/481) Updating files: 56% (270/481) Updating files: 57% (275/481) Updating files: 58% (279/481) Updating files: 59% (284/481) Updating files: 59% (287/481) Updating files: 60% (289/481) Updating files: 61% (294/481) Updating files: 62% (299/481) Updating files: 63% (304/481) Updating files: 64% (308/481) Updating files: 65% (313/481) Updating files: 66% (318/481) Updating files: 67% (323/481) Updating files: 68% (328/481) Updating files: 69% (332/481) Updating files: 70% (337/481) Updating files: 71% (342/481) Updating files: 72% (347/481) Updating files: 72% (351/481) Updating files: 73% (352/481) Updating files: 74% (356/481) Updating files: 75% (361/481) Updating files: 76% (366/481) Updating files: 77% (371/481) Updating files: 78% (376/481) Updating files: 79% (380/481) Updating files: 80% (385/481) Updating files: 81% (390/481) Updating files: 82% (395/481) Updating files: 83% (400/481) Updating files: 84% (405/481) Updating files: 85% (409/481) Updating files: 86% (414/481) Updating files: 86% (415/481) Updating files: 87% (419/481) Updating files: 88% (424/481) Updating files: 89% (429/481) Updating files: 90% (433/481) Updating files: 91% (438/481) Updating files: 92% (443/481) Updating files: 93% (448/481) Updating files: 94% (453/481) Updating files: 95% (457/481) Updating files: 96% (462/481) Updating files: 97% (467/481) Updating files: 98% (472/481) Updating files: 99% (477/481) Updating files: 99% (479/481) Updating files: 100% (481/481) Updating files: 100% (481/481), done. 2024-04-21T09:18:41.167 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at ca6265d0f4d v0.49 2024-04-21T09:18:41.171 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.49 2024-04-21T09:18:41.421 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 50 -eq 48 ] 2024-04-21T09:18:41.422 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.50 2024-04-21T09:18:41.422 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.50 2024-04-21T09:18:41.422 INFO:tasks.workunit.client.0.smithi026.stdout:v0.50 2024-04-21T09:18:41.422 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.50 2024-04-21T09:18:45.694 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 47% (65/137) Updating files: 48% (66/137) Updating files: 49% (68/137) Updating files: 50% (69/137) Updating files: 51% (70/137) Updating files: 52% (72/137) Updating files: 53% (73/137) Updating files: 54% (74/137) Updating files: 55% (76/137) Updating files: 56% (77/137) Updating files: 57% (79/137) Updating files: 58% (80/137) Updating files: 59% (81/137) Updating files: 60% (83/137) Updating files: 61% (84/137) Updating files: 62% (85/137) Updating files: 63% (87/137) Updating files: 64% (88/137) Updating files: 65% (90/137) Updating files: 66% (91/137) Updating files: 67% (92/137) Updating files: 68% (94/137) Updating files: 69% (95/137) Updating files: 70% (96/137) Updating files: 71% (98/137) Updating files: 72% (99/137) Updating files: 73% (101/137) Updating files: 74% (102/137) Updating files: 75% (103/137) Updating files: 76% (105/137) Updating files: 77% (106/137) Updating files: 78% (107/137) Updating files: 79% (109/137) Updating files: 80% (110/137) Updating files: 81% (111/137) Updating files: 82% (113/137) Updating files: 83% (114/137) Updating files: 84% (116/137) Updating files: 85% (117/137) Updating files: 86% (118/137) Updating files: 87% (120/137) Updating files: 88% (121/137) Updating files: 89% (122/137) Updating files: 89% (123/137) Updating files: 90% (124/137) Updating files: 91% (125/137) Updating files: 92% (127/137) Updating files: 93% (128/137) Updating files: 94% (129/137) Updating files: 95% (131/137) Updating files: 96% (132/137) Updating files: 97% (133/137) Updating files: 98% (135/137) Updating files: 99% (136/137) Updating files: 100% (137/137) Updating files: 100% (137/137), done. 2024-04-21T09:18:46.100 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at a4428bd0e19 v0.50 2024-04-21T09:18:46.104 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.50 2024-04-21T09:18:46.330 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 51 -eq 48 ] 2024-04-21T09:18:46.330 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.51 2024-04-21T09:18:46.330 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.51 2024-04-21T09:18:46.330 INFO:tasks.workunit.client.0.smithi026.stdout:v0.51 2024-04-21T09:18:46.331 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.51 2024-04-21T09:18:49.887 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:18:49.890 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:18:50.105 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 56% (59/105) Updating files: 57% (60/105) Updating files: 58% (61/105) Updating files: 59% (62/105) Updating files: 60% (63/105) Updating files: 61% (65/105) Updating files: 62% (66/105) Updating files: 63% (67/105) Updating files: 64% (68/105) Updating files: 65% (69/105) Updating files: 66% (70/105) Updating files: 67% (71/105) Updating files: 68% (72/105) Updating files: 69% (73/105) Updating files: 70% (74/105) Updating files: 71% (75/105) Updating files: 72% (76/105) Updating files: 73% (77/105) Updating files: 74% (78/105) Updating files: 75% (79/105) Updating files: 76% (80/105) Updating files: 77% (81/105) Updating files: 78% (82/105) Updating files: 79% (83/105) Updating files: 80% (84/105) Updating files: 81% (86/105) Updating files: 82% (87/105) Updating files: 83% (88/105) Updating files: 84% (89/105) Updating files: 85% (90/105) Updating files: 86% (91/105) Updating files: 87% (92/105) Updating files: 88% (93/105) Updating files: 89% (94/105) Updating files: 90% (95/105) Updating files: 91% (96/105) Updating files: 92% (97/105) Updating files: 93% (98/105) Updating files: 94% (99/105) Updating files: 95% (100/105) Updating files: 96% (101/105) Updating files: 97% (102/105) Updating files: 98% (103/105) Updating files: 99% (104/105) Updating files: 100% (105/105) Updating files: 100% (105/105), done. 2024-04-21T09:18:50.522 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at c03ca95d235 v0.51 2024-04-21T09:18:50.526 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.51 2024-04-21T09:18:50.632 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 52 -eq 48 ] 2024-04-21T09:18:50.632 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.52 2024-04-21T09:18:50.632 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.52 2024-04-21T09:18:50.632 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.52 2024-04-21T09:18:50.632 INFO:tasks.workunit.client.0.smithi026.stdout:v0.52 2024-04-21T09:18:55.800 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (65/183) Updating files: 36% (66/183) Updating files: 37% (68/183) Updating files: 38% (70/183) Updating files: 39% (72/183) Updating files: 40% (74/183) Updating files: 41% (76/183) Updating files: 42% (77/183) Updating files: 43% (79/183) Updating files: 44% (81/183) Updating files: 45% (83/183) Updating files: 46% (85/183) Updating files: 47% (87/183) Updating files: 48% (88/183) Updating files: 49% (90/183) Updating files: 50% (92/183) Updating files: 51% (94/183) Updating files: 52% (96/183) Updating files: 53% (97/183) Updating files: 54% (99/183) Updating files: 55% (101/183) Updating files: 56% (103/183) Updating files: 57% (105/183) Updating files: 58% (107/183) Updating files: 59% (108/183) Updating files: 60% (110/183) Updating files: 61% (112/183) Updating files: 62% (114/183) Updating files: 63% (116/183) Updating files: 64% (118/183) Updating files: 65% (119/183) Updating files: 66% (121/183) Updating files: 67% (123/183) Updating files: 67% (124/183) Updating files: 68% (125/183) Updating files: 69% (127/183) Updating files: 70% (129/183) Updating files: 71% (130/183) Updating files: 72% (132/183) Updating files: 73% (134/183) Updating files: 74% (136/183) Updating files: 75% (138/183) Updating files: 76% (140/183) Updating files: 77% (141/183) Updating files: 78% (143/183) Updating files: 79% (145/183) Updating files: 80% (147/183) Updating files: 81% (149/183) Updating files: 82% (151/183) Updating files: 83% (152/183) Updating files: 84% (154/183) Updating files: 85% (156/183) Updating files: 86% (158/183) Updating files: 87% (160/183) Updating files: 88% (162/183) Updating files: 89% (163/183) Updating files: 90% (165/183) Updating files: 91% (167/183) Updating files: 92% (169/183) Updating files: 93% (171/183) Updating files: 94% (173/183) Updating files: 95% (174/183) Updating files: 95% (175/183) Updating files: 96% (176/183) Updating files: 97% (178/183) Updating files: 98% (180/183) Updating files: 99% (182/183) Updating files: 100% (183/183) Updating files: 100% (183/183), done. 2024-04-21T09:18:56.048 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at e48859474c4 v0.52 2024-04-21T09:18:56.051 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.52 2024-04-21T09:18:56.207 INFO:tasks.workunit.client.0.smithi026.stdout:v0.53 2024-04-21T09:18:56.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 53 -eq 48 ] 2024-04-21T09:18:56.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.53 2024-04-21T09:18:56.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.53 2024-04-21T09:18:56.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.53 2024-04-21T09:19:03.749 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 18% (72/386) Updating files: 19% (74/386) Updating files: 20% (78/386) Updating files: 21% (82/386) Updating files: 22% (85/386) Updating files: 23% (89/386) Updating files: 24% (93/386) Updating files: 25% (97/386) Updating files: 26% (101/386) Updating files: 27% (105/386) Updating files: 28% (109/386) Updating files: 29% (112/386) Updating files: 30% (116/386) Updating files: 31% (120/386) Updating files: 32% (124/386) Updating files: 33% (128/386) Updating files: 34% (132/386) Updating files: 35% (136/386) Updating files: 36% (139/386) Updating files: 36% (140/386) Updating files: 37% (143/386) Updating files: 38% (147/386) Updating files: 39% (151/386) Updating files: 40% (155/386) Updating files: 41% (159/386) Updating files: 42% (163/386) Updating files: 43% (166/386) Updating files: 44% (170/386) Updating files: 45% (174/386) Updating files: 46% (178/386) Updating files: 47% (182/386) Updating files: 48% (186/386) Updating files: 49% (190/386) Updating files: 50% (193/386) Updating files: 51% (197/386) Updating files: 52% (201/386) Updating files: 53% (205/386) Updating files: 53% (206/386) Updating files: 54% (209/386) Updating files: 55% (213/386) Updating files: 56% (217/386) Updating files: 57% (221/386) Updating files: 58% (224/386) Updating files: 59% (228/386) Updating files: 60% (232/386) Updating files: 61% (236/386) Updating files: 62% (240/386) Updating files: 63% (244/386) Updating files: 64% (248/386) Updating files: 65% (251/386) Updating files: 66% (255/386) Updating files: 67% (259/386) Updating files: 68% (263/386) Updating files: 69% (267/386) Updating files: 69% (269/386) Updating files: 70% (271/386) Updating files: 71% (275/386) Updating files: 72% (278/386) Updating files: 73% (282/386) Updating files: 74% (286/386) Updating files: 75% (290/386) Updating files: 76% (294/386) Updating files: 77% (298/386) Updating files: 78% (302/386) Updating files: 79% (305/386) Updating files: 80% (309/386) Updating files: 81% (313/386) Updating files: 82% (317/386) Updating files: 83% (321/386) Updating files: 84% (325/386) Updating files: 85% (329/386) Updating files: 86% (332/386) Updating files: 87% (336/386) Updating files: 88% (340/386) Updating files: 89% (344/386) Updating files: 90% (348/386) Updating files: 91% (352/386) Updating files: 92% (356/386) Updating files: 93% (359/386) Updating files: 94% (363/386) Updating files: 95% (367/386) Updating files: 96% (371/386) Updating files: 97% (375/386) Updating files: 98% (379/386) Updating files: 99% (383/386) Updating files: 100% (386/386) Updating files: 100% (386/386), done. 2024-04-21T09:19:04.222 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 2528b5ee105 v0.43 2024-04-21T09:19:04.223 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.53 2024-04-21T09:19:04.315 INFO:tasks.workunit.client.0.smithi026.stdout:v0.54 2024-04-21T09:19:04.315 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 54 -eq 48 ] 2024-04-21T09:19:04.316 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.54 2024-04-21T09:19:04.316 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.54 2024-04-21T09:19:04.316 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.54 2024-04-21T09:19:10.548 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 26% (57/212) Updating files: 27% (58/212) Updating files: 28% (60/212) Updating files: 29% (62/212) Updating files: 30% (64/212) Updating files: 31% (66/212) Updating files: 32% (68/212) Updating files: 33% (70/212) Updating files: 34% (73/212) Updating files: 35% (75/212) Updating files: 36% (77/212) Updating files: 37% (79/212) Updating files: 38% (81/212) Updating files: 39% (83/212) Updating files: 40% (85/212) Updating files: 41% (87/212) Updating files: 42% (90/212) Updating files: 43% (92/212) Updating files: 44% (94/212) Updating files: 45% (96/212) Updating files: 46% (98/212) Updating files: 47% (100/212) Updating files: 48% (102/212) Updating files: 49% (104/212) Updating files: 50% (106/212) Updating files: 51% (109/212) Updating files: 52% (111/212) Updating files: 53% (113/212) Updating files: 54% (115/212) Updating files: 55% (117/212) Updating files: 56% (119/212) Updating files: 57% (121/212) Updating files: 58% (123/212) Updating files: 59% (126/212) Updating files: 60% (128/212) Updating files: 61% (130/212) Updating files: 62% (132/212) Updating files: 63% (134/212) Updating files: 64% (136/212) Updating files: 65% (138/212) Updating files: 66% (140/212) Updating files: 67% (143/212) Updating files: 68% (145/212) Updating files: 69% (147/212) Updating files: 70% (149/212) Updating files: 71% (151/212) Updating files: 72% (153/212) Updating files: 73% (155/212) Updating files: 74% (157/212) Updating files: 75% (159/212) Updating files: 76% (162/212) Updating files: 77% (164/212) Updating files: 78% (166/212) Updating files: 79% (168/212) Updating files: 80% (170/212) Updating files: 81% (172/212) Updating files: 82% (174/212) Updating files: 83% (176/212) Updating files: 84% (179/212) Updating files: 85% (181/212) Updating files: 86% (183/212) Updating files: 87% (185/212) Updating files: 88% (187/212) Updating files: 89% (189/212) Updating files: 90% (191/212) Updating files: 91% (193/212) Updating files: 92% (196/212) Updating files: 93% (198/212) Updating files: 94% (200/212) Updating files: 95% (202/212) Updating files: 96% (204/212) Updating files: 97% (206/212) Updating files: 98% (208/212) Updating files: 99% (210/212) Updating files: 100% (212/212) Updating files: 100% (212/212), done. 2024-04-21T09:19:11.000 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 60b84b095b1 v0.54 2024-04-21T09:19:11.007 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.54 2024-04-21T09:19:11.101 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 55 -eq 48 ] 2024-04-21T09:19:11.101 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.55 2024-04-21T09:19:11.101 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.55 2024-04-21T09:19:11.101 INFO:tasks.workunit.client.0.smithi026.stdout:v0.55 2024-04-21T09:19:11.102 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.55 2024-04-21T09:19:19.938 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:19:19.942 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:19:20.613 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 15% (85/540) Updating files: 16% (87/540) Updating files: 17% (92/540) Updating files: 18% (98/540) Updating files: 19% (103/540) Updating files: 20% (108/540) Updating files: 21% (114/540) Updating files: 22% (119/540) Updating files: 23% (125/540) Updating files: 24% (130/540) Updating files: 25% (135/540) Updating files: 26% (141/540) Updating files: 27% (146/540) Updating files: 28% (152/540) Updating files: 29% (157/540) Updating files: 30% (162/540) Updating files: 31% (168/540) Updating files: 31% (172/540) Updating files: 32% (173/540) Updating files: 33% (179/540) Updating files: 34% (184/540) Updating files: 35% (189/540) Updating files: 36% (195/540) Updating files: 37% (200/540) Updating files: 38% (206/540) Updating files: 39% (211/540) Updating files: 40% (216/540) Updating files: 41% (222/540) Updating files: 42% (227/540) Updating files: 43% (233/540) Updating files: 44% (238/540) Updating files: 45% (243/540) Updating files: 46% (249/540) Updating files: 47% (254/540) Updating files: 48% (260/540) Updating files: 49% (265/540) Updating files: 50% (270/540) Updating files: 51% (276/540) Updating files: 52% (281/540) Updating files: 53% (287/540) Updating files: 54% (292/540) Updating files: 55% (297/540) Updating files: 55% (300/540) Updating files: 56% (303/540) Updating files: 57% (308/540) Updating files: 58% (314/540) Updating files: 59% (319/540) Updating files: 60% (324/540) Updating files: 61% (330/540) Updating files: 62% (335/540) Updating files: 63% (341/540) Updating files: 64% (346/540) Updating files: 65% (351/540) Updating files: 66% (357/540) Updating files: 66% (360/540) Updating files: 67% (362/540) Updating files: 68% (368/540) Updating files: 69% (373/540) Updating files: 70% (378/540) Updating files: 71% (384/540) Updating files: 72% (389/540) Updating files: 73% (395/540) Updating files: 74% (400/540) Updating files: 75% (405/540) Updating files: 76% (411/540) Updating files: 77% (416/540) Updating files: 78% (422/540) Updating files: 79% (427/540) Updating files: 80% (432/540) Updating files: 81% (438/540) Updating files: 82% (443/540) Updating files: 83% (449/540) Updating files: 84% (454/540) Updating files: 85% (459/540) Updating files: 86% (465/540) Updating files: 87% (470/540) Updating files: 88% (476/540) Updating files: 89% (481/540) Updating files: 90% (486/540) Updating files: 91% (492/540) Updating files: 91% (493/540) Updating files: 92% (497/540) Updating files: 93% (503/540) Updating files: 94% (508/540) Updating files: 95% (513/540) Updating files: 96% (519/540) Updating files: 97% (524/540) Updating files: 98% (530/540) Updating files: 99% (535/540) Updating files: 100% (540/540) Updating files: 100% (540/540), done. 2024-04-21T09:19:21.136 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 690f8175606 v0.55 2024-04-21T09:19:21.145 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.55 2024-04-21T09:19:21.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 56 -eq 48 ] 2024-04-21T09:19:21.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.56 2024-04-21T09:19:21.263 INFO:tasks.workunit.client.0.smithi026.stdout:v0.56 2024-04-21T09:19:21.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.56 2024-04-21T09:19:21.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.56 2024-04-21T09:19:28.103 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 27% (67/246) Updating files: 28% (69/246) Updating files: 29% (72/246) Updating files: 30% (74/246) Updating files: 31% (77/246) Updating files: 32% (79/246) Updating files: 33% (82/246) Updating files: 34% (84/246) Updating files: 35% (87/246) Updating files: 36% (89/246) Updating files: 37% (92/246) Updating files: 38% (94/246) Updating files: 39% (96/246) Updating files: 40% (99/246) Updating files: 41% (101/246) Updating files: 42% (104/246) Updating files: 43% (106/246) Updating files: 44% (109/246) Updating files: 45% (111/246) Updating files: 46% (114/246) Updating files: 47% (116/246) Updating files: 48% (119/246) Updating files: 49% (121/246) Updating files: 50% (123/246) Updating files: 51% (126/246) Updating files: 52% (128/246) Updating files: 53% (131/246) Updating files: 54% (133/246) Updating files: 55% (136/246) Updating files: 56% (138/246) Updating files: 57% (141/246) Updating files: 58% (143/246) Updating files: 59% (146/246) Updating files: 60% (148/246) Updating files: 61% (151/246) Updating files: 62% (153/246) Updating files: 63% (155/246) Updating files: 64% (158/246) Updating files: 65% (160/246) Updating files: 66% (163/246) Updating files: 67% (165/246) Updating files: 68% (168/246) Updating files: 69% (170/246) Updating files: 70% (173/246) Updating files: 71% (175/246) Updating files: 72% (178/246) Updating files: 73% (180/246) Updating files: 74% (183/246) Updating files: 75% (185/246) Updating files: 76% (187/246) Updating files: 77% (190/246) Updating files: 78% (192/246) Updating files: 79% (195/246) Updating files: 80% (197/246) Updating files: 81% (200/246) Updating files: 82% (202/246) Updating files: 83% (205/246) Updating files: 84% (207/246) Updating files: 85% (210/246) Updating files: 86% (212/246) Updating files: 87% (215/246) Updating files: 88% (217/246) Updating files: 89% (219/246) Updating files: 89% (220/246) Updating files: 90% (222/246) Updating files: 91% (224/246) Updating files: 92% (227/246) Updating files: 93% (229/246) Updating files: 94% (232/246) Updating files: 95% (234/246) Updating files: 96% (237/246) Updating files: 97% (239/246) Updating files: 98% (242/246) Updating files: 99% (244/246) Updating files: 100% (246/246) Updating files: 100% (246/246), done. 2024-04-21T09:19:28.553 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 1a32f0a0b42 v0.56 2024-04-21T09:19:28.561 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.56 2024-04-21T09:19:28.707 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 57 -eq 48 ] 2024-04-21T09:19:28.707 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.57 2024-04-21T09:19:28.707 INFO:tasks.workunit.client.0.smithi026.stdout:v0.57 2024-04-21T09:19:28.708 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.57 2024-04-21T09:19:28.708 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.57 2024-04-21T09:19:35.135 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 23% (72/304) Updating files: 24% (73/304) Updating files: 25% (76/304) Updating files: 26% (80/304) Updating files: 27% (83/304) Updating files: 28% (86/304) Updating files: 29% (89/304) Updating files: 30% (92/304) Updating files: 31% (95/304) Updating files: 32% (98/304) Updating files: 33% (101/304) Updating files: 34% (104/304) Updating files: 35% (107/304) Updating files: 36% (110/304) Updating files: 37% (113/304) Updating files: 38% (116/304) Updating files: 39% (119/304) Updating files: 40% (122/304) Updating files: 41% (125/304) Updating files: 42% (128/304) Updating files: 43% (131/304) Updating files: 44% (134/304) Updating files: 45% (137/304) Updating files: 46% (140/304) Updating files: 47% (143/304) Updating files: 48% (146/304) Updating files: 49% (149/304) Updating files: 50% (152/304) Updating files: 51% (156/304) Updating files: 52% (159/304) Updating files: 53% (162/304) Updating files: 54% (165/304) Updating files: 55% (168/304) Updating files: 56% (171/304) Updating files: 57% (174/304) Updating files: 58% (177/304) Updating files: 59% (180/304) Updating files: 60% (183/304) Updating files: 60% (184/304) Updating files: 61% (186/304) Updating files: 62% (189/304) Updating files: 63% (192/304) Updating files: 64% (195/304) Updating files: 65% (198/304) Updating files: 66% (201/304) Updating files: 67% (204/304) Updating files: 68% (207/304) Updating files: 69% (210/304) Updating files: 70% (213/304) Updating files: 71% (216/304) Updating files: 72% (219/304) Updating files: 73% (222/304) Updating files: 74% (225/304) Updating files: 75% (228/304) Updating files: 76% (232/304) Updating files: 77% (235/304) Updating files: 78% (238/304) Updating files: 78% (240/304) Updating files: 79% (241/304) Updating files: 80% (244/304) Updating files: 81% (247/304) Updating files: 82% (250/304) Updating files: 83% (253/304) Updating files: 84% (256/304) Updating files: 85% (259/304) Updating files: 86% (262/304) Updating files: 87% (265/304) Updating files: 88% (268/304) Updating files: 89% (271/304) Updating files: 90% (274/304) Updating files: 91% (277/304) Updating files: 92% (280/304) Updating files: 93% (283/304) Updating files: 94% (286/304) Updating files: 95% (289/304) Updating files: 96% (292/304) Updating files: 97% (295/304) Updating files: 97% (296/304) Updating files: 98% (298/304) Updating files: 99% (301/304) Updating files: 100% (304/304) Updating files: 100% (304/304), done. 2024-04-21T09:19:35.400 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 9a7a9d06c06 v0.57 2024-04-21T09:19:35.408 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.57 2024-04-21T09:19:35.511 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 58 -eq 48 ] 2024-04-21T09:19:35.511 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.58 2024-04-21T09:19:35.511 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.58 2024-04-21T09:19:35.511 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.58 2024-04-21T09:19:35.511 INFO:tasks.workunit.client.0.smithi026.stdout:v0.58 2024-04-21T09:19:42.155 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 25% (68/268) Updating files: 26% (70/268) Updating files: 27% (73/268) Updating files: 28% (76/268) Updating files: 29% (78/268) Updating files: 30% (81/268) Updating files: 31% (84/268) Updating files: 32% (86/268) Updating files: 33% (89/268) Updating files: 34% (92/268) Updating files: 35% (94/268) Updating files: 36% (97/268) Updating files: 37% (100/268) Updating files: 38% (102/268) Updating files: 39% (105/268) Updating files: 40% (108/268) Updating files: 41% (110/268) Updating files: 42% (113/268) Updating files: 43% (116/268) Updating files: 44% (118/268) Updating files: 45% (121/268) Updating files: 46% (124/268) Updating files: 47% (126/268) Updating files: 48% (129/268) Updating files: 49% (132/268) Updating files: 50% (134/268) Updating files: 51% (137/268) Updating files: 52% (140/268) Updating files: 53% (143/268) Updating files: 54% (145/268) Updating files: 55% (148/268) Updating files: 56% (151/268) Updating files: 57% (153/268) Updating files: 58% (156/268) Updating files: 59% (159/268) Updating files: 60% (161/268) Updating files: 61% (164/268) Updating files: 62% (167/268) Updating files: 63% (169/268) Updating files: 64% (172/268) Updating files: 65% (175/268) Updating files: 66% (177/268) Updating files: 66% (179/268) Updating files: 67% (180/268) Updating files: 68% (183/268) Updating files: 69% (185/268) Updating files: 70% (188/268) Updating files: 71% (191/268) Updating files: 72% (193/268) Updating files: 73% (196/268) Updating files: 74% (199/268) Updating files: 75% (201/268) Updating files: 76% (204/268) Updating files: 77% (207/268) Updating files: 78% (210/268) Updating files: 79% (212/268) Updating files: 80% (215/268) Updating files: 81% (218/268) Updating files: 82% (220/268) Updating files: 83% (223/268) Updating files: 84% (226/268) Updating files: 85% (228/268) Updating files: 86% (231/268) Updating files: 87% (234/268) Updating files: 87% (235/268) Updating files: 88% (236/268) Updating files: 89% (239/268) Updating files: 90% (242/268) Updating files: 91% (244/268) Updating files: 92% (247/268) Updating files: 93% (250/268) Updating files: 94% (252/268) Updating files: 95% (255/268) Updating files: 96% (258/268) Updating files: 97% (260/268) Updating files: 98% (263/268) Updating files: 99% (266/268) Updating files: 100% (268/268) Updating files: 100% (268/268), done. 2024-04-21T09:19:42.425 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at ba3f91e7504 v0.58 2024-04-21T09:19:42.434 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.58 2024-04-21T09:19:42.504 INFO:tasks.workunit.client.0.smithi026.stdout:v0.59 2024-04-21T09:19:42.504 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 59 -eq 48 ] 2024-04-21T09:19:42.504 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.59 2024-04-21T09:19:42.504 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.59 2024-04-21T09:19:42.504 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.59 2024-04-21T09:19:48.944 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 28% (61/211) Updating files: 29% (62/211) Updating files: 30% (64/211) Updating files: 31% (66/211) Updating files: 32% (68/211) Updating files: 33% (70/211) Updating files: 34% (72/211) Updating files: 35% (74/211) Updating files: 36% (76/211) Updating files: 37% (79/211) Updating files: 38% (81/211) Updating files: 39% (83/211) Updating files: 40% (85/211) Updating files: 41% (87/211) Updating files: 42% (89/211) Updating files: 43% (91/211) Updating files: 44% (93/211) Updating files: 45% (95/211) Updating files: 46% (98/211) Updating files: 47% (100/211) Updating files: 48% (102/211) Updating files: 49% (104/211) Updating files: 50% (106/211) Updating files: 51% (108/211) Updating files: 52% (110/211) Updating files: 53% (112/211) Updating files: 54% (114/211) Updating files: 55% (117/211) Updating files: 56% (119/211) Updating files: 57% (121/211) Updating files: 58% (123/211) Updating files: 59% (125/211) Updating files: 60% (127/211) Updating files: 61% (129/211) Updating files: 62% (131/211) Updating files: 63% (133/211) Updating files: 64% (136/211) Updating files: 65% (138/211) Updating files: 66% (140/211) Updating files: 67% (142/211) Updating files: 68% (144/211) Updating files: 69% (146/211) Updating files: 70% (148/211) Updating files: 71% (150/211) Updating files: 72% (152/211) Updating files: 73% (155/211) Updating files: 74% (157/211) Updating files: 75% (159/211) Updating files: 76% (161/211) Updating files: 77% (163/211) Updating files: 78% (165/211) Updating files: 79% (167/211) Updating files: 80% (169/211) Updating files: 81% (171/211) Updating files: 82% (174/211) Updating files: 83% (176/211) Updating files: 84% (178/211) Updating files: 85% (180/211) Updating files: 86% (182/211) Updating files: 87% (184/211) Updating files: 88% (186/211) Updating files: 89% (188/211) Updating files: 90% (190/211) Updating files: 91% (193/211) Updating files: 92% (195/211) Updating files: 93% (197/211) Updating files: 94% (199/211) Updating files: 95% (201/211) Updating files: 95% (202/211) Updating files: 96% (203/211) Updating files: 97% (205/211) Updating files: 98% (207/211) Updating files: 99% (209/211) Updating files: 100% (211/211) Updating files: 100% (211/211), done. 2024-04-21T09:19:49.196 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at cbae6a435c6 v0.59 2024-04-21T09:19:49.204 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.59 2024-04-21T09:19:49.307 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 60 -eq 48 ] 2024-04-21T09:19:49.308 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.60 2024-04-21T09:19:49.308 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.60 2024-04-21T09:19:49.308 INFO:tasks.workunit.client.0.smithi026.stdout:v0.60 2024-04-21T09:19:49.308 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.60 2024-04-21T09:19:50.107 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:19:50.111 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:19:56.042 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 20% (53/256) Updating files: 21% (54/256) Updating files: 22% (57/256) Updating files: 23% (59/256) Updating files: 24% (62/256) Updating files: 25% (64/256) Updating files: 26% (67/256) Updating files: 27% (70/256) Updating files: 28% (72/256) Updating files: 29% (75/256) Updating files: 30% (77/256) Updating files: 31% (80/256) Updating files: 32% (82/256) Updating files: 33% (85/256) Updating files: 34% (88/256) Updating files: 35% (90/256) Updating files: 36% (93/256) Updating files: 37% (95/256) Updating files: 38% (98/256) Updating files: 39% (100/256) Updating files: 40% (103/256) Updating files: 41% (105/256) Updating files: 42% (108/256) Updating files: 42% (110/256) Updating files: 43% (111/256) Updating files: 44% (113/256) Updating files: 45% (116/256) Updating files: 46% (118/256) Updating files: 47% (121/256) Updating files: 48% (123/256) Updating files: 49% (126/256) Updating files: 50% (128/256) Updating files: 51% (131/256) Updating files: 52% (134/256) Updating files: 53% (136/256) Updating files: 54% (139/256) Updating files: 55% (141/256) Updating files: 56% (144/256) Updating files: 57% (146/256) Updating files: 58% (149/256) Updating files: 59% (152/256) Updating files: 60% (154/256) Updating files: 61% (157/256) Updating files: 62% (159/256) Updating files: 63% (162/256) Updating files: 64% (164/256) Updating files: 64% (165/256) Updating files: 65% (167/256) Updating files: 66% (169/256) Updating files: 67% (172/256) Updating files: 68% (175/256) Updating files: 69% (177/256) Updating files: 70% (180/256) Updating files: 71% (182/256) Updating files: 72% (185/256) Updating files: 73% (187/256) Updating files: 74% (190/256) Updating files: 75% (192/256) Updating files: 76% (195/256) Updating files: 77% (198/256) Updating files: 78% (200/256) Updating files: 79% (203/256) Updating files: 80% (205/256) Updating files: 81% (208/256) Updating files: 82% (210/256) Updating files: 83% (213/256) Updating files: 84% (216/256) Updating files: 85% (218/256) Updating files: 85% (220/256) Updating files: 86% (221/256) Updating files: 87% (223/256) Updating files: 88% (226/256) Updating files: 89% (228/256) Updating files: 90% (231/256) Updating files: 91% (233/256) Updating files: 92% (236/256) Updating files: 93% (239/256) Updating files: 94% (241/256) Updating files: 95% (244/256) Updating files: 96% (246/256) Updating files: 97% (249/256) Updating files: 98% (251/256) Updating files: 99% (254/256) Updating files: 100% (256/256) Updating files: 100% (256/256), done. 2024-04-21T09:19:56.362 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at f26f7a39021 v0.60 2024-04-21T09:19:56.371 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.60 2024-04-21T09:19:56.460 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 61 -eq 48 ] 2024-04-21T09:19:56.460 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.61 2024-04-21T09:19:56.460 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.61 2024-04-21T09:19:56.460 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.61 2024-04-21T09:19:56.461 INFO:tasks.workunit.client.0.smithi026.stdout:v0.61 2024-04-21T09:20:04.918 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 16% (62/376) Updating files: 17% (64/376) Updating files: 18% (68/376) Updating files: 19% (72/376) Updating files: 20% (76/376) Updating files: 21% (79/376) Updating files: 22% (83/376) Updating files: 23% (87/376) Updating files: 24% (91/376) Updating files: 25% (94/376) Updating files: 26% (98/376) Updating files: 27% (102/376) Updating files: 28% (106/376) Updating files: 29% (110/376) Updating files: 30% (113/376) Updating files: 31% (117/376) Updating files: 32% (121/376) Updating files: 33% (125/376) Updating files: 34% (128/376) Updating files: 35% (132/376) Updating files: 36% (136/376) Updating files: 37% (140/376) Updating files: 38% (143/376) Updating files: 39% (147/376) Updating files: 40% (151/376) Updating files: 41% (155/376) Updating files: 42% (158/376) Updating files: 43% (162/376) Updating files: 44% (166/376) Updating files: 45% (170/376) Updating files: 46% (173/376) Updating files: 47% (177/376) Updating files: 48% (181/376) Updating files: 49% (185/376) Updating files: 50% (188/376) Updating files: 51% (192/376) Updating files: 52% (196/376) Updating files: 53% (200/376) Updating files: 54% (204/376) Updating files: 55% (207/376) Updating files: 56% (211/376) Updating files: 57% (215/376) Updating files: 58% (219/376) Updating files: 59% (222/376) Updating files: 60% (226/376) Updating files: 60% (229/376) Updating files: 61% (230/376) Updating files: 62% (234/376) Updating files: 63% (237/376) Updating files: 64% (241/376) Updating files: 65% (245/376) Updating files: 66% (249/376) Updating files: 67% (252/376) Updating files: 68% (256/376) Updating files: 69% (260/376) Updating files: 70% (264/376) Updating files: 71% (267/376) Updating files: 72% (271/376) Updating files: 73% (275/376) Updating files: 74% (279/376) Updating files: 75% (282/376) Updating files: 76% (286/376) Updating files: 77% (290/376) Updating files: 78% (294/376) Updating files: 79% (298/376) Updating files: 80% (301/376) Updating files: 81% (305/376) Updating files: 82% (309/376) Updating files: 83% (313/376) Updating files: 84% (316/376) Updating files: 85% (320/376) Updating files: 86% (324/376) Updating files: 87% (328/376) Updating files: 88% (331/376) Updating files: 89% (335/376) Updating files: 90% (339/376) Updating files: 91% (343/376) Updating files: 91% (345/376) Updating files: 92% (346/376) Updating files: 93% (350/376) Updating files: 94% (354/376) Updating files: 95% (358/376) Updating files: 96% (361/376) Updating files: 97% (365/376) Updating files: 98% (369/376) Updating files: 99% (373/376) Updating files: 100% (376/376) Updating files: 100% (376/376), done. 2024-04-21T09:20:05.237 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 237f3f1e8d8 v0.61 2024-04-21T09:20:05.248 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.61 2024-04-21T09:20:05.378 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 62 -eq 48 ] 2024-04-21T09:20:05.378 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.62 2024-04-21T09:20:05.378 INFO:tasks.workunit.client.0.smithi026.stdout:v0.62 2024-04-21T09:20:05.379 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.62 2024-04-21T09:20:05.379 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.62 2024-04-21T09:20:09.138 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-04-21T09:20:09.708 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 9382379cc6b v0.62 2024-04-21T09:20:09.713 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.62 2024-04-21T09:20:09.851 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 63 -eq 48 ] 2024-04-21T09:20:09.851 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.63 2024-04-21T09:20:09.851 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.63 2024-04-21T09:20:09.851 INFO:tasks.workunit.client.0.smithi026.stdout:v0.63 2024-04-21T09:20:09.851 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.63 2024-04-21T09:20:15.031 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 41% (60/146) Updating files: 42% (62/146) Updating files: 43% (63/146) Updating files: 44% (65/146) Updating files: 45% (66/146) Updating files: 46% (68/146) Updating files: 47% (69/146) Updating files: 48% (71/146) Updating files: 49% (72/146) Updating files: 50% (73/146) Updating files: 51% (75/146) Updating files: 52% (76/146) Updating files: 53% (78/146) Updating files: 54% (79/146) Updating files: 55% (81/146) Updating files: 56% (82/146) Updating files: 57% (84/146) Updating files: 58% (85/146) Updating files: 59% (87/146) Updating files: 60% (88/146) Updating files: 61% (90/146) Updating files: 62% (91/146) Updating files: 63% (92/146) Updating files: 64% (94/146) Updating files: 65% (95/146) Updating files: 66% (97/146) Updating files: 67% (98/146) Updating files: 68% (100/146) Updating files: 69% (101/146) Updating files: 70% (103/146) Updating files: 71% (104/146) Updating files: 72% (106/146) Updating files: 73% (107/146) Updating files: 74% (109/146) Updating files: 75% (110/146) Updating files: 76% (111/146) Updating files: 77% (113/146) Updating files: 78% (114/146) Updating files: 79% (116/146) Updating files: 80% (117/146) Updating files: 81% (119/146) Updating files: 82% (120/146) Updating files: 83% (122/146) Updating files: 84% (123/146) Updating files: 85% (125/146) Updating files: 86% (126/146) Updating files: 87% (128/146) Updating files: 88% (129/146) Updating files: 89% (130/146) Updating files: 90% (132/146) Updating files: 91% (133/146) Updating files: 92% (135/146) Updating files: 93% (136/146) Updating files: 94% (138/146) Updating files: 95% (139/146) Updating files: 96% (141/146) Updating files: 97% (142/146) Updating files: 98% (144/146) Updating files: 99% (145/146) Updating files: 100% (146/146) Updating files: 100% (146/146), done. 2024-04-21T09:20:15.293 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 054e96cf79e v0.63 2024-04-21T09:20:15.302 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.63 2024-04-21T09:20:15.444 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 64 -eq 48 ] 2024-04-21T09:20:15.444 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.64 2024-04-21T09:20:15.444 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.64 2024-04-21T09:20:15.444 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.64 2024-04-21T09:20:15.445 INFO:tasks.workunit.client.0.smithi026.stdout:v0.64 2024-04-21T09:20:20.181 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:20:20.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:20:20.299 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (51/143) Updating files: 36% (52/143) Updating files: 37% (53/143) Updating files: 38% (55/143) Updating files: 39% (56/143) Updating files: 40% (58/143) Updating files: 41% (59/143) Updating files: 42% (61/143) Updating files: 43% (62/143) Updating files: 44% (63/143) Updating files: 45% (65/143) Updating files: 46% (66/143) Updating files: 47% (68/143) Updating files: 48% (69/143) Updating files: 49% (71/143) Updating files: 50% (72/143) Updating files: 51% (73/143) Updating files: 52% (75/143) Updating files: 53% (76/143) Updating files: 54% (78/143) Updating files: 55% (79/143) Updating files: 56% (81/143) Updating files: 57% (82/143) Updating files: 58% (83/143) Updating files: 59% (85/143) Updating files: 60% (86/143) Updating files: 61% (88/143) Updating files: 62% (89/143) Updating files: 63% (91/143) Updating files: 64% (92/143) Updating files: 65% (93/143) Updating files: 66% (95/143) Updating files: 67% (96/143) Updating files: 68% (98/143) Updating files: 69% (99/143) Updating files: 70% (101/143) Updating files: 71% (102/143) Updating files: 72% (103/143) Updating files: 73% (105/143) Updating files: 74% (106/143) Updating files: 75% (108/143) Updating files: 76% (109/143) Updating files: 77% (111/143) Updating files: 78% (112/143) Updating files: 79% (113/143) Updating files: 80% (115/143) Updating files: 81% (116/143) Updating files: 82% (118/143) Updating files: 83% (119/143) Updating files: 84% (121/143) Updating files: 85% (122/143) Updating files: 86% (123/143) Updating files: 87% (125/143) Updating files: 88% (126/143) Updating files: 89% (128/143) Updating files: 90% (129/143) Updating files: 91% (131/143) Updating files: 92% (132/143) Updating files: 93% (133/143) Updating files: 94% (135/143) Updating files: 95% (136/143) Updating files: 96% (138/143) Updating files: 97% (139/143) Updating files: 98% (141/143) Updating files: 99% (142/143) Updating files: 100% (143/143) Updating files: 100% (143/143), done. 2024-04-21T09:20:20.582 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 42e06c12db6 v0.64 2024-04-21T09:20:20.590 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.64 2024-04-21T09:20:20.691 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 65 -eq 48 ] 2024-04-21T09:20:20.691 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.65 2024-04-21T09:20:20.692 INFO:tasks.workunit.client.0.smithi026.stdout:v0.65 2024-04-21T09:20:20.692 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.65 2024-04-21T09:20:20.692 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.65 2024-04-21T09:20:26.486 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 28% (58/203) Updating files: 29% (59/203) Updating files: 30% (61/203) Updating files: 31% (63/203) Updating files: 32% (65/203) Updating files: 33% (67/203) Updating files: 34% (70/203) Updating files: 35% (72/203) Updating files: 36% (74/203) Updating files: 37% (76/203) Updating files: 38% (78/203) Updating files: 39% (80/203) Updating files: 40% (82/203) Updating files: 41% (84/203) Updating files: 42% (86/203) Updating files: 43% (88/203) Updating files: 44% (90/203) Updating files: 45% (92/203) Updating files: 46% (94/203) Updating files: 47% (96/203) Updating files: 48% (98/203) Updating files: 49% (100/203) Updating files: 50% (102/203) Updating files: 51% (104/203) Updating files: 52% (106/203) Updating files: 53% (108/203) Updating files: 54% (110/203) Updating files: 55% (112/203) Updating files: 56% (114/203) Updating files: 57% (116/203) Updating files: 58% (118/203) Updating files: 59% (120/203) Updating files: 60% (122/203) Updating files: 61% (124/203) Updating files: 62% (126/203) Updating files: 63% (128/203) Updating files: 64% (130/203) Updating files: 65% (132/203) Updating files: 66% (134/203) Updating files: 67% (137/203) Updating files: 68% (139/203) Updating files: 69% (141/203) Updating files: 70% (143/203) Updating files: 71% (145/203) Updating files: 72% (147/203) Updating files: 73% (149/203) Updating files: 74% (151/203) Updating files: 75% (153/203) Updating files: 76% (155/203) Updating files: 77% (157/203) Updating files: 78% (159/203) Updating files: 79% (161/203) Updating files: 79% (162/203) Updating files: 80% (163/203) Updating files: 81% (165/203) Updating files: 82% (167/203) Updating files: 83% (169/203) Updating files: 84% (171/203) Updating files: 85% (173/203) Updating files: 86% (175/203) Updating files: 87% (177/203) Updating files: 88% (179/203) Updating files: 89% (181/203) Updating files: 90% (183/203) Updating files: 91% (185/203) Updating files: 92% (187/203) Updating files: 93% (189/203) Updating files: 94% (191/203) Updating files: 95% (193/203) Updating files: 96% (195/203) Updating files: 97% (197/203) Updating files: 98% (199/203) Updating files: 99% (201/203) Updating files: 100% (203/203) Updating files: 100% (203/203), done. 2024-04-21T09:20:26.768 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at c2d517ef966 v0.65 2024-04-21T09:20:26.776 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.65 2024-04-21T09:20:26.917 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 66 -eq 48 ] 2024-04-21T09:20:26.918 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.66 2024-04-21T09:20:26.918 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.66 2024-04-21T09:20:26.918 INFO:tasks.workunit.client.0.smithi026.stdout:v0.66 2024-04-21T09:20:26.918 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.66 2024-04-21T09:20:32.647 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 35% (54/152) Updating files: 36% (55/152) Updating files: 37% (57/152) Updating files: 38% (58/152) Updating files: 39% (60/152) Updating files: 40% (61/152) Updating files: 41% (63/152) Updating files: 42% (64/152) Updating files: 43% (66/152) Updating files: 44% (67/152) Updating files: 45% (69/152) Updating files: 46% (70/152) Updating files: 47% (72/152) Updating files: 48% (73/152) Updating files: 49% (75/152) Updating files: 50% (76/152) Updating files: 51% (78/152) Updating files: 52% (80/152) Updating files: 53% (81/152) Updating files: 54% (83/152) Updating files: 55% (84/152) Updating files: 56% (86/152) Updating files: 57% (87/152) Updating files: 58% (89/152) Updating files: 59% (90/152) Updating files: 60% (92/152) Updating files: 61% (93/152) Updating files: 62% (95/152) Updating files: 63% (96/152) Updating files: 64% (98/152) Updating files: 65% (99/152) Updating files: 66% (101/152) Updating files: 67% (102/152) Updating files: 68% (104/152) Updating files: 69% (105/152) Updating files: 70% (107/152) Updating files: 71% (108/152) Updating files: 72% (110/152) Updating files: 73% (111/152) Updating files: 74% (113/152) Updating files: 75% (114/152) Updating files: 76% (116/152) Updating files: 77% (118/152) Updating files: 78% (119/152) Updating files: 79% (121/152) Updating files: 80% (122/152) Updating files: 81% (124/152) Updating files: 82% (125/152) Updating files: 83% (127/152) Updating files: 84% (128/152) Updating files: 85% (130/152) Updating files: 86% (131/152) Updating files: 87% (133/152) Updating files: 88% (134/152) Updating files: 89% (136/152) Updating files: 90% (137/152) Updating files: 91% (139/152) Updating files: 92% (140/152) Updating files: 93% (142/152) Updating files: 94% (143/152) Updating files: 95% (145/152) Updating files: 96% (146/152) Updating files: 97% (148/152) Updating files: 98% (149/152) Updating files: 99% (151/152) Updating files: 100% (152/152) Updating files: 100% (152/152), done. 2024-04-21T09:20:32.986 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at b6b48dbefad v0.66 2024-04-21T09:20:32.993 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.66 2024-04-21T09:20:33.140 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 67 -eq 48 ] 2024-04-21T09:20:33.141 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.67 2024-04-21T09:20:33.141 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.67 2024-04-21T09:20:33.141 INFO:tasks.workunit.client.0.smithi026.stdout:v0.67 2024-04-21T09:20:33.141 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.67 2024-04-21T09:20:41.881 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 18% (64/355) Updating files: 19% (68/355) Updating files: 20% (71/355) Updating files: 21% (75/355) Updating files: 22% (79/355) Updating files: 23% (82/355) Updating files: 24% (86/355) Updating files: 25% (89/355) Updating files: 26% (93/355) Updating files: 27% (96/355) Updating files: 28% (100/355) Updating files: 29% (103/355) Updating files: 30% (107/355) Updating files: 31% (111/355) Updating files: 32% (114/355) Updating files: 33% (118/355) Updating files: 33% (119/355) Updating files: 34% (121/355) Updating files: 35% (125/355) Updating files: 36% (128/355) Updating files: 37% (132/355) Updating files: 38% (135/355) Updating files: 39% (139/355) Updating files: 40% (142/355) Updating files: 41% (146/355) Updating files: 42% (150/355) Updating files: 43% (153/355) Updating files: 44% (157/355) Updating files: 45% (160/355) Updating files: 46% (164/355) Updating files: 47% (167/355) Updating files: 48% (171/355) Updating files: 49% (174/355) Updating files: 49% (175/355) Updating files: 50% (178/355) Updating files: 51% (182/355) Updating files: 52% (185/355) Updating files: 53% (189/355) Updating files: 54% (192/355) Updating files: 55% (196/355) Updating files: 56% (199/355) Updating files: 57% (203/355) Updating files: 58% (206/355) Updating files: 59% (210/355) Updating files: 60% (213/355) Updating files: 61% (217/355) Updating files: 62% (221/355) Updating files: 63% (224/355) Updating files: 64% (228/355) Updating files: 65% (231/355) Updating files: 66% (235/355) Updating files: 67% (238/355) Updating files: 68% (242/355) Updating files: 69% (245/355) Updating files: 70% (249/355) Updating files: 71% (253/355) Updating files: 72% (256/355) Updating files: 73% (260/355) Updating files: 74% (263/355) Updating files: 75% (267/355) Updating files: 76% (270/355) Updating files: 77% (274/355) Updating files: 78% (277/355) Updating files: 79% (281/355) Updating files: 80% (284/355) Updating files: 81% (288/355) Updating files: 82% (292/355) Updating files: 83% (295/355) Updating files: 84% (299/355) Updating files: 85% (302/355) Updating files: 86% (306/355) Updating files: 87% (309/355) Updating files: 88% (313/355) Updating files: 89% (316/355) Updating files: 90% (320/355) Updating files: 91% (324/355) Updating files: 92% (327/355) Updating files: 93% (331/355) Updating files: 94% (334/355) Updating files: 95% (338/355) Updating files: 95% (339/355) Updating files: 96% (341/355) Updating files: 97% (345/355) Updating files: 98% (348/355) Updating files: 99% (352/355) Updating files: 100% (355/355) Updating files: 100% (355/355), done. 2024-04-21T09:20:42.284 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at e3b7bc5bce8 v0.67 2024-04-21T09:20:42.295 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.67 2024-04-21T09:20:42.382 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 68 -eq 48 ] 2024-04-21T09:20:42.382 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.68 2024-04-21T09:20:42.382 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.68 2024-04-21T09:20:42.383 INFO:tasks.workunit.client.0.smithi026.stdout:v0.68 2024-04-21T09:20:42.383 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.68 2024-04-21T09:20:49.307 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 28% (68/241) Updating files: 29% (70/241) Updating files: 30% (73/241) Updating files: 31% (75/241) Updating files: 32% (78/241) Updating files: 33% (80/241) Updating files: 34% (82/241) Updating files: 35% (85/241) Updating files: 36% (87/241) Updating files: 37% (90/241) Updating files: 38% (92/241) Updating files: 39% (94/241) Updating files: 40% (97/241) Updating files: 41% (99/241) Updating files: 42% (102/241) Updating files: 43% (104/241) Updating files: 44% (107/241) Updating files: 45% (109/241) Updating files: 46% (111/241) Updating files: 47% (114/241) Updating files: 48% (116/241) Updating files: 48% (117/241) Updating files: 49% (119/241) Updating files: 50% (121/241) Updating files: 51% (123/241) Updating files: 52% (126/241) Updating files: 53% (128/241) Updating files: 54% (131/241) Updating files: 55% (133/241) Updating files: 56% (135/241) Updating files: 57% (138/241) Updating files: 58% (140/241) Updating files: 59% (143/241) Updating files: 60% (145/241) Updating files: 61% (148/241) Updating files: 62% (150/241) Updating files: 63% (152/241) Updating files: 64% (155/241) Updating files: 65% (157/241) Updating files: 66% (160/241) Updating files: 67% (162/241) Updating files: 67% (163/241) Updating files: 68% (164/241) Updating files: 69% (167/241) Updating files: 70% (169/241) Updating files: 71% (172/241) Updating files: 72% (174/241) Updating files: 73% (176/241) Updating files: 74% (179/241) Updating files: 75% (181/241) Updating files: 76% (184/241) Updating files: 77% (186/241) Updating files: 78% (188/241) Updating files: 79% (191/241) Updating files: 80% (193/241) Updating files: 81% (196/241) Updating files: 82% (198/241) Updating files: 83% (201/241) Updating files: 84% (203/241) Updating files: 85% (205/241) Updating files: 86% (208/241) Updating files: 87% (210/241) Updating files: 88% (213/241) Updating files: 89% (215/241) Updating files: 90% (217/241) Updating files: 91% (220/241) Updating files: 92% (222/241) Updating files: 93% (225/241) Updating files: 94% (227/241) Updating files: 95% (229/241) Updating files: 96% (232/241) Updating files: 97% (234/241) Updating files: 98% (237/241) Updating files: 99% (239/241) Updating files: 100% (241/241) Updating files: 100% (241/241), done. 2024-04-21T09:20:49.575 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at b4cf0f2574b v0.68 2024-04-21T09:20:49.582 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.68 2024-04-21T09:20:49.699 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 69 -eq 48 ] 2024-04-21T09:20:49.699 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.69 2024-04-21T09:20:49.699 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.69 2024-04-21T09:20:49.700 INFO:tasks.workunit.client.0.smithi026.stdout:v0.69 2024-04-21T09:20:49.700 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.69 2024-04-21T09:20:50.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:20:50.239 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:20:54.494 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 39% (61/155) Updating files: 40% (62/155) Updating files: 41% (64/155) Updating files: 42% (66/155) Updating files: 43% (67/155) Updating files: 44% (69/155) Updating files: 45% (70/155) Updating files: 46% (72/155) Updating files: 47% (73/155) Updating files: 48% (75/155) Updating files: 49% (76/155) Updating files: 50% (78/155) Updating files: 51% (80/155) Updating files: 52% (81/155) Updating files: 53% (83/155) Updating files: 54% (84/155) Updating files: 55% (86/155) Updating files: 56% (87/155) Updating files: 57% (89/155) Updating files: 58% (90/155) Updating files: 59% (92/155) Updating files: 60% (93/155) Updating files: 61% (95/155) Updating files: 62% (97/155) Updating files: 63% (98/155) Updating files: 64% (100/155) Updating files: 65% (101/155) Updating files: 66% (103/155) Updating files: 67% (104/155) Updating files: 68% (106/155) Updating files: 69% (107/155) Updating files: 70% (109/155) Updating files: 71% (111/155) Updating files: 72% (112/155) Updating files: 73% (114/155) Updating files: 74% (115/155) Updating files: 75% (117/155) Updating files: 76% (118/155) Updating files: 77% (120/155) Updating files: 78% (121/155) Updating files: 79% (123/155) Updating files: 80% (124/155) Updating files: 81% (126/155) Updating files: 82% (128/155) Updating files: 83% (129/155) Updating files: 84% (131/155) Updating files: 85% (132/155) Updating files: 86% (134/155) Updating files: 87% (135/155) Updating files: 88% (137/155) Updating files: 89% (138/155) Updating files: 90% (140/155) Updating files: 91% (142/155) Updating files: 92% (143/155) Updating files: 93% (145/155) Updating files: 94% (146/155) Updating files: 95% (148/155) Updating files: 96% (149/155) Updating files: 97% (151/155) Updating files: 98% (152/155) Updating files: 99% (154/155) Updating files: 100% (155/155) Updating files: 100% (155/155), done. 2024-04-21T09:20:54.802 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 6ca6f2f9f75 v0.69 2024-04-21T09:20:54.810 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.69 2024-04-21T09:20:54.936 INFO:tasks.workunit.client.0.smithi026.stdout:v0.70 2024-04-21T09:20:54.937 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 70 -eq 48 ] 2024-04-21T09:20:54.937 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.70 2024-04-21T09:20:54.937 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.70 2024-04-21T09:20:54.937 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.70 2024-04-21T09:20:59.063 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at e3bb0656d92 v0.70 2024-04-21T09:20:59.066 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.70 2024-04-21T09:20:59.261 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 71 -eq 48 ] 2024-04-21T09:20:59.262 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.71 2024-04-21T09:20:59.262 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.71 2024-04-21T09:20:59.262 INFO:tasks.workunit.client.0.smithi026.stdout:v0.71 2024-04-21T09:20:59.262 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.71 2024-04-21T09:21:07.937 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 19% (80/405) Updating files: 20% (81/405) Updating files: 21% (86/405) Updating files: 22% (90/405) Updating files: 23% (94/405) Updating files: 24% (98/405) Updating files: 25% (102/405) Updating files: 26% (106/405) Updating files: 27% (110/405) Updating files: 28% (114/405) Updating files: 29% (118/405) Updating files: 30% (122/405) Updating files: 31% (126/405) Updating files: 32% (130/405) Updating files: 33% (134/405) Updating files: 34% (138/405) Updating files: 34% (139/405) Updating files: 35% (142/405) Updating files: 36% (146/405) Updating files: 37% (150/405) Updating files: 38% (154/405) Updating files: 39% (158/405) Updating files: 40% (162/405) Updating files: 41% (167/405) Updating files: 42% (171/405) Updating files: 43% (175/405) Updating files: 44% (179/405) Updating files: 45% (183/405) Updating files: 46% (187/405) Updating files: 47% (191/405) Updating files: 48% (195/405) Updating files: 49% (199/405) Updating files: 49% (201/405) Updating files: 50% (203/405) Updating files: 51% (207/405) Updating files: 52% (211/405) Updating files: 53% (215/405) Updating files: 54% (219/405) Updating files: 55% (223/405) Updating files: 56% (227/405) Updating files: 57% (231/405) Updating files: 58% (235/405) Updating files: 59% (239/405) Updating files: 60% (243/405) Updating files: 61% (248/405) Updating files: 62% (252/405) Updating files: 63% (256/405) Updating files: 64% (260/405) Updating files: 64% (263/405) Updating files: 65% (264/405) Updating files: 66% (268/405) Updating files: 67% (272/405) Updating files: 68% (276/405) Updating files: 69% (280/405) Updating files: 70% (284/405) Updating files: 71% (288/405) Updating files: 72% (292/405) Updating files: 73% (296/405) Updating files: 74% (300/405) Updating files: 75% (304/405) Updating files: 76% (308/405) Updating files: 77% (312/405) Updating files: 78% (316/405) Updating files: 79% (320/405) Updating files: 80% (324/405) Updating files: 80% (326/405) Updating files: 81% (329/405) Updating files: 82% (333/405) Updating files: 83% (337/405) Updating files: 84% (341/405) Updating files: 85% (345/405) Updating files: 86% (349/405) Updating files: 87% (353/405) Updating files: 88% (357/405) Updating files: 89% (361/405) Updating files: 90% (365/405) Updating files: 91% (369/405) Updating files: 92% (373/405) Updating files: 93% (377/405) Updating files: 93% (380/405) Updating files: 94% (381/405) Updating files: 95% (385/405) Updating files: 96% (389/405) Updating files: 97% (393/405) Updating files: 98% (397/405) Updating files: 99% (401/405) Updating files: 100% (405/405) Updating files: 100% (405/405), done. 2024-04-21T09:21:08.326 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at e509cb1e69c v0.71 2024-04-21T09:21:08.336 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.71 2024-04-21T09:21:08.422 INFO:tasks.workunit.client.0.smithi026.stdout:v0.72 2024-04-21T09:21:08.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 72 -eq 48 ] 2024-04-21T09:21:08.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.72 2024-04-21T09:21:08.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.72 2024-04-21T09:21:08.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.72 2024-04-21T09:21:14.962 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 28% (55/191) Updating files: 29% (56/191) Updating files: 30% (58/191) Updating files: 31% (60/191) Updating files: 32% (62/191) Updating files: 33% (64/191) Updating files: 34% (65/191) Updating files: 35% (67/191) Updating files: 36% (69/191) Updating files: 37% (71/191) Updating files: 38% (73/191) Updating files: 39% (75/191) Updating files: 40% (77/191) Updating files: 41% (79/191) Updating files: 42% (81/191) Updating files: 43% (83/191) Updating files: 44% (85/191) Updating files: 45% (86/191) Updating files: 46% (88/191) Updating files: 47% (90/191) Updating files: 48% (92/191) Updating files: 49% (94/191) Updating files: 50% (96/191) Updating files: 51% (98/191) Updating files: 52% (100/191) Updating files: 53% (102/191) Updating files: 54% (104/191) Updating files: 55% (106/191) Updating files: 56% (107/191) Updating files: 57% (109/191) Updating files: 58% (111/191) Updating files: 59% (113/191) Updating files: 60% (115/191) Updating files: 61% (117/191) Updating files: 62% (119/191) Updating files: 63% (121/191) Updating files: 64% (123/191) Updating files: 65% (125/191) Updating files: 66% (127/191) Updating files: 67% (128/191) Updating files: 68% (130/191) Updating files: 69% (132/191) Updating files: 70% (134/191) Updating files: 71% (136/191) Updating files: 72% (138/191) Updating files: 73% (140/191) Updating files: 74% (142/191) Updating files: 75% (144/191) Updating files: 76% (146/191) Updating files: 77% (148/191) Updating files: 78% (149/191) Updating files: 79% (151/191) Updating files: 80% (153/191) Updating files: 81% (155/191) Updating files: 81% (156/191) Updating files: 82% (157/191) Updating files: 83% (159/191) Updating files: 84% (161/191) Updating files: 85% (163/191) Updating files: 86% (165/191) Updating files: 87% (167/191) Updating files: 88% (169/191) Updating files: 89% (170/191) Updating files: 90% (172/191) Updating files: 91% (174/191) Updating files: 92% (176/191) Updating files: 93% (178/191) Updating files: 94% (180/191) Updating files: 95% (182/191) Updating files: 96% (184/191) Updating files: 97% (186/191) Updating files: 98% (188/191) Updating files: 99% (190/191) Updating files: 100% (191/191) Updating files: 100% (191/191), done. 2024-04-21T09:21:15.288 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 5832e2603c7 v0.72 2024-04-21T09:21:15.296 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.72 2024-04-21T09:21:15.405 INFO:tasks.workunit.client.0.smithi026.stdout:v0.73 2024-04-21T09:21:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 73 -eq 48 ] 2024-04-21T09:21:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.73 2024-04-21T09:21:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.73 2024-04-21T09:21:15.406 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.73 2024-04-21T09:21:20.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:21:20.312 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:21:20.751 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 47% (71/148) Updating files: 48% (72/148) Updating files: 49% (73/148) Updating files: 50% (74/148) Updating files: 51% (76/148) Updating files: 52% (77/148) Updating files: 53% (79/148) Updating files: 54% (80/148) Updating files: 55% (82/148) Updating files: 56% (83/148) Updating files: 57% (85/148) Updating files: 58% (86/148) Updating files: 59% (88/148) Updating files: 60% (89/148) Updating files: 61% (91/148) Updating files: 62% (92/148) Updating files: 63% (94/148) Updating files: 64% (95/148) Updating files: 65% (97/148) Updating files: 66% (98/148) Updating files: 67% (100/148) Updating files: 68% (101/148) Updating files: 69% (103/148) Updating files: 70% (104/148) Updating files: 71% (106/148) Updating files: 72% (107/148) Updating files: 73% (109/148) Updating files: 74% (110/148) Updating files: 75% (111/148) Updating files: 76% (113/148) Updating files: 77% (114/148) Updating files: 78% (116/148) Updating files: 79% (117/148) Updating files: 80% (119/148) Updating files: 81% (120/148) Updating files: 81% (121/148) Updating files: 82% (122/148) Updating files: 83% (123/148) Updating files: 84% (125/148) Updating files: 85% (126/148) Updating files: 86% (128/148) Updating files: 87% (129/148) Updating files: 88% (131/148) Updating files: 89% (132/148) Updating files: 90% (134/148) Updating files: 91% (135/148) Updating files: 92% (137/148) Updating files: 93% (138/148) Updating files: 94% (140/148) Updating files: 95% (141/148) Updating files: 96% (143/148) Updating files: 97% (144/148) Updating files: 98% (146/148) Updating files: 99% (147/148) Updating files: 100% (148/148) Updating files: 100% (148/148), done. 2024-04-21T09:21:21.223 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at d8ad51ee8ab v0.73 2024-04-21T09:21:21.230 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.73 2024-04-21T09:21:21.365 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 74 -eq 48 ] 2024-04-21T09:21:21.365 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.74 2024-04-21T09:21:21.365 INFO:tasks.workunit.client.0.smithi026.stdout:v0.74 2024-04-21T09:21:21.365 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.74 2024-04-21T09:21:21.365 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.74 2024-04-21T09:21:27.661 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 32% (62/192) Updating files: 33% (64/192) Updating files: 34% (66/192) Updating files: 35% (68/192) Updating files: 36% (70/192) Updating files: 37% (72/192) Updating files: 38% (73/192) Updating files: 39% (75/192) Updating files: 40% (77/192) Updating files: 41% (79/192) Updating files: 42% (81/192) Updating files: 43% (83/192) Updating files: 44% (85/192) Updating files: 45% (87/192) Updating files: 46% (89/192) Updating files: 47% (91/192) Updating files: 48% (93/192) Updating files: 49% (95/192) Updating files: 50% (96/192) Updating files: 51% (98/192) Updating files: 52% (100/192) Updating files: 53% (102/192) Updating files: 54% (104/192) Updating files: 55% (106/192) Updating files: 56% (108/192) Updating files: 57% (110/192) Updating files: 58% (112/192) Updating files: 58% (113/192) Updating files: 59% (114/192) Updating files: 60% (116/192) Updating files: 61% (118/192) Updating files: 62% (120/192) Updating files: 63% (121/192) Updating files: 64% (123/192) Updating files: 65% (125/192) Updating files: 66% (127/192) Updating files: 67% (129/192) Updating files: 68% (131/192) Updating files: 69% (133/192) Updating files: 70% (135/192) Updating files: 71% (137/192) Updating files: 72% (139/192) Updating files: 73% (141/192) Updating files: 74% (143/192) Updating files: 75% (144/192) Updating files: 76% (146/192) Updating files: 77% (148/192) Updating files: 78% (150/192) Updating files: 79% (152/192) Updating files: 80% (154/192) Updating files: 81% (156/192) Updating files: 82% (158/192) Updating files: 83% (160/192) Updating files: 84% (162/192) Updating files: 84% (163/192) Updating files: 85% (164/192) Updating files: 86% (166/192) Updating files: 87% (168/192) Updating files: 88% (169/192) Updating files: 89% (171/192) Updating files: 90% (173/192) Updating files: 91% (175/192) Updating files: 92% (177/192) Updating files: 93% (179/192) Updating files: 94% (181/192) Updating files: 95% (183/192) Updating files: 96% (185/192) Updating files: 97% (187/192) Updating files: 98% (189/192) Updating files: 99% (191/192) Updating files: 100% (192/192) Updating files: 100% (192/192), done. 2024-04-21T09:21:28.030 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at c165483bc72 v0.74 2024-04-21T09:21:28.038 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.74 2024-04-21T09:21:28.158 INFO:tasks.workunit.client.0.smithi026.stdout:v0.75 2024-04-21T09:21:28.159 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 75 -eq 48 ] 2024-04-21T09:21:28.159 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.75 2024-04-21T09:21:28.159 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.75 2024-04-21T09:21:28.159 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.75 2024-04-21T09:21:35.651 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 20% (59/291) Updating files: 21% (62/291) Updating files: 22% (65/291) Updating files: 23% (67/291) Updating files: 24% (70/291) Updating files: 25% (73/291) Updating files: 26% (76/291) Updating files: 27% (79/291) Updating files: 28% (82/291) Updating files: 29% (85/291) Updating files: 30% (88/291) Updating files: 31% (91/291) Updating files: 32% (94/291) Updating files: 33% (97/291) Updating files: 34% (99/291) Updating files: 35% (102/291) Updating files: 36% (105/291) Updating files: 37% (108/291) Updating files: 37% (109/291) Updating files: 38% (111/291) Updating files: 39% (114/291) Updating files: 40% (117/291) Updating files: 41% (120/291) Updating files: 42% (123/291) Updating files: 43% (126/291) Updating files: 44% (129/291) Updating files: 45% (131/291) Updating files: 46% (134/291) Updating files: 47% (137/291) Updating files: 48% (140/291) Updating files: 49% (143/291) Updating files: 50% (146/291) Updating files: 51% (149/291) Updating files: 52% (152/291) Updating files: 53% (155/291) Updating files: 54% (158/291) Updating files: 55% (161/291) Updating files: 56% (163/291) Updating files: 56% (164/291) Updating files: 57% (166/291) Updating files: 58% (169/291) Updating files: 59% (172/291) Updating files: 60% (175/291) Updating files: 61% (178/291) Updating files: 62% (181/291) Updating files: 63% (184/291) Updating files: 64% (187/291) Updating files: 65% (190/291) Updating files: 66% (193/291) Updating files: 67% (195/291) Updating files: 68% (198/291) Updating files: 69% (201/291) Updating files: 70% (204/291) Updating files: 71% (207/291) Updating files: 72% (210/291) Updating files: 73% (213/291) Updating files: 74% (216/291) Updating files: 75% (219/291) Updating files: 75% (220/291) Updating files: 76% (222/291) Updating files: 77% (225/291) Updating files: 78% (227/291) Updating files: 79% (230/291) Updating files: 80% (233/291) Updating files: 81% (236/291) Updating files: 82% (239/291) Updating files: 83% (242/291) Updating files: 84% (245/291) Updating files: 85% (248/291) Updating files: 86% (251/291) Updating files: 87% (254/291) Updating files: 88% (257/291) Updating files: 89% (259/291) Updating files: 90% (262/291) Updating files: 91% (265/291) Updating files: 92% (268/291) Updating files: 93% (271/291) Updating files: 94% (274/291) Updating files: 95% (277/291) Updating files: 96% (280/291) Updating files: 96% (282/291) Updating files: 97% (283/291) Updating files: 98% (286/291) Updating files: 99% (289/291) Updating files: 100% (291/291) Updating files: 100% (291/291), done. 2024-04-21T09:21:36.068 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 946d6036958 v0.75 2024-04-21T09:21:36.076 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.75 2024-04-21T09:21:36.207 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 76 -eq 48 ] 2024-04-21T09:21:36.207 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.76 2024-04-21T09:21:36.207 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.76 2024-04-21T09:21:36.207 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.76 2024-04-21T09:21:36.207 INFO:tasks.workunit.client.0.smithi026.stdout:v0.76 2024-04-21T09:21:41.962 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 32% (54/168) Updating files: 33% (56/168) Updating files: 34% (58/168) Updating files: 35% (59/168) Updating files: 36% (61/168) Updating files: 37% (63/168) Updating files: 38% (64/168) Updating files: 39% (66/168) Updating files: 40% (68/168) Updating files: 41% (69/168) Updating files: 42% (71/168) Updating files: 43% (73/168) Updating files: 44% (74/168) Updating files: 45% (76/168) Updating files: 46% (78/168) Updating files: 47% (79/168) Updating files: 48% (81/168) Updating files: 49% (83/168) Updating files: 50% (84/168) Updating files: 51% (86/168) Updating files: 52% (88/168) Updating files: 53% (90/168) Updating files: 54% (91/168) Updating files: 55% (93/168) Updating files: 56% (95/168) Updating files: 57% (96/168) Updating files: 58% (98/168) Updating files: 59% (100/168) Updating files: 60% (101/168) Updating files: 61% (103/168) Updating files: 62% (105/168) Updating files: 63% (106/168) Updating files: 64% (108/168) Updating files: 65% (110/168) Updating files: 66% (111/168) Updating files: 67% (113/168) Updating files: 68% (115/168) Updating files: 69% (116/168) Updating files: 70% (118/168) Updating files: 71% (120/168) Updating files: 72% (121/168) Updating files: 73% (123/168) Updating files: 74% (125/168) Updating files: 75% (126/168) Updating files: 76% (128/168) Updating files: 77% (130/168) Updating files: 78% (132/168) Updating files: 79% (133/168) Updating files: 80% (135/168) Updating files: 81% (137/168) Updating files: 82% (138/168) Updating files: 83% (140/168) Updating files: 84% (142/168) Updating files: 85% (143/168) Updating files: 86% (145/168) Updating files: 87% (147/168) Updating files: 88% (148/168) Updating files: 89% (150/168) Updating files: 90% (152/168) Updating files: 91% (153/168) Updating files: 92% (155/168) Updating files: 93% (157/168) Updating files: 94% (158/168) Updating files: 95% (160/168) Updating files: 96% (162/168) Updating files: 97% (163/168) Updating files: 98% (165/168) Updating files: 99% (167/168) Updating files: 100% (168/168) Updating files: 100% (168/168), done. 2024-04-21T09:21:42.484 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 3b990136bfa v0.76 2024-04-21T09:21:42.491 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.76 2024-04-21T09:21:42.625 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 77 -eq 48 ] 2024-04-21T09:21:42.626 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.77 2024-04-21T09:21:42.626 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.77 2024-04-21T09:21:42.626 INFO:tasks.workunit.client.0.smithi026.stdout:v0.77 2024-04-21T09:21:42.626 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.77 2024-04-21T09:21:50.437 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 20% (61/298) Updating files: 21% (63/298) Updating files: 22% (66/298) Updating files: 23% (69/298) Updating files: 24% (72/298) Updating files: 25% (75/298) Updating files: 26% (78/298) Updating files: 27% (81/298) Updating files: 28% (84/298) Updating files: 29% (87/298) Updating files: 30% (90/298) Updating files: 31% (93/298) Updating files: 32% (96/298) Updating files: 33% (99/298) Updating files: 34% (102/298) Updating files: 35% (105/298) Updating files: 36% (108/298) Updating files: 37% (111/298) Updating files: 38% (114/298) Updating files: 39% (117/298) Updating files: 40% (120/298) Updating files: 41% (123/298) Updating files: 42% (126/298) Updating files: 43% (129/298) Updating files: 44% (132/298) Updating files: 45% (135/298) Updating files: 46% (138/298) Updating files: 47% (141/298) Updating files: 48% (144/298) Updating files: 49% (147/298) Updating files: 50% (149/298) Updating files: 51% (152/298) Updating files: 52% (155/298) Updating files: 53% (158/298) Updating files: 54% (161/298) Updating files: 55% (164/298) Updating files: 56% (167/298) Updating files: 57% (170/298) Updating files: 58% (173/298) Updating files: 59% (176/298) Updating files: 60% (179/298) Updating files: 61% (182/298) Updating files: 62% (185/298) Updating files: 63% (188/298) Updating files: 64% (191/298) Updating files: 65% (194/298) Updating files: 66% (197/298) Updating files: 67% (200/298) Updating files: 68% (203/298) Updating files: 69% (206/298) Updating files: 69% (207/298) Updating files: 70% (209/298) Updating files: 71% (212/298) Updating files: 72% (215/298) Updating files: 73% (218/298) Updating files: 74% (221/298) Updating files: 75% (224/298) Updating files: 76% (227/298) Updating files: 77% (230/298) Updating files: 78% (233/298) Updating files: 79% (236/298) Updating files: 80% (239/298) Updating files: 81% (242/298) Updating files: 82% (245/298) Updating files: 83% (248/298) Updating files: 84% (251/298) Updating files: 85% (254/298) Updating files: 86% (257/298) Updating files: 87% (260/298) Updating files: 88% (263/298) Updating files: 89% (266/298) Updating files: 90% (269/298) Updating files: 91% (272/298) Updating files: 92% (275/298) Updating files: 93% (278/298) Updating files: 94% (281/298) Updating files: 95% (284/298) Updating files: 96% (287/298) Updating files: 97% (290/298) Updating files: 98% (293/298) Updating files: 99% (296/298) Updating files: 100% (298/298) Updating files: 100% (298/298), done. 2024-04-21T09:21:50.674 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:21:50.678 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:21:50.681 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 1bca9c5c412 v0.77 2024-04-21T09:21:50.690 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.77 2024-04-21T09:21:50.768 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 78 -eq 48 ] 2024-04-21T09:21:50.768 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.78 2024-04-21T09:21:50.768 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.78 2024-04-21T09:21:50.768 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.78 2024-04-21T09:21:50.769 INFO:tasks.workunit.client.0.smithi026.stdout:v0.78 2024-04-21T09:22:01.253 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 16% (84/496) Updating files: 17% (85/496) Updating files: 18% (90/496) Updating files: 19% (95/496) Updating files: 20% (100/496) Updating files: 21% (105/496) Updating files: 22% (110/496) Updating files: 23% (115/496) Updating files: 24% (120/496) Updating files: 25% (124/496) Updating files: 26% (129/496) Updating files: 27% (134/496) Updating files: 27% (135/496) Updating files: 28% (139/496) Updating files: 29% (144/496) Updating files: 30% (149/496) Updating files: 31% (154/496) Updating files: 32% (159/496) Updating files: 33% (164/496) Updating files: 34% (169/496) Updating files: 35% (174/496) Updating files: 36% (179/496) Updating files: 37% (184/496) Updating files: 38% (189/496) Updating files: 39% (194/496) Updating files: 40% (199/496) Updating files: 41% (204/496) Updating files: 42% (209/496) Updating files: 43% (214/496) Updating files: 44% (219/496) Updating files: 45% (224/496) Updating files: 46% (229/496) Updating files: 47% (234/496) Updating files: 48% (239/496) Updating files: 49% (244/496) Updating files: 50% (248/496) Updating files: 50% (252/496) Updating files: 51% (253/496) Updating files: 52% (258/496) Updating files: 53% (263/496) Updating files: 54% (268/496) Updating files: 55% (273/496) Updating files: 56% (278/496) Updating files: 57% (283/496) Updating files: 58% (288/496) Updating files: 59% (293/496) Updating files: 60% (298/496) Updating files: 61% (303/496) Updating files: 62% (308/496) Updating files: 63% (313/496) Updating files: 64% (318/496) Updating files: 65% (323/496) Updating files: 66% (328/496) Updating files: 67% (333/496) Updating files: 68% (338/496) Updating files: 69% (343/496) Updating files: 70% (348/496) Updating files: 71% (353/496) Updating files: 72% (358/496) Updating files: 73% (363/496) Updating files: 73% (366/496) Updating files: 74% (368/496) Updating files: 75% (372/496) Updating files: 76% (377/496) Updating files: 77% (382/496) Updating files: 78% (387/496) Updating files: 79% (392/496) Updating files: 80% (397/496) Updating files: 81% (402/496) Updating files: 82% (407/496) Updating files: 83% (412/496) Updating files: 84% (417/496) Updating files: 85% (422/496) Updating files: 86% (427/496) Updating files: 87% (432/496) Updating files: 88% (437/496) Updating files: 89% (442/496) Updating files: 90% (447/496) Updating files: 91% (452/496) Updating files: 92% (457/496) Updating files: 93% (462/496) Updating files: 94% (467/496) Updating files: 95% (472/496) Updating files: 96% (477/496) Updating files: 97% (482/496) Updating files: 98% (487/496) Updating files: 99% (492/496) Updating files: 100% (496/496) Updating files: 100% (496/496), done. 2024-04-21T09:22:01.665 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at f6c746c314d 0.78 2024-04-21T09:22:01.675 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.78 2024-04-21T09:22:01.845 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 79 -eq 48 ] 2024-04-21T09:22:01.846 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.79 2024-04-21T09:22:01.846 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.79 2024-04-21T09:22:01.846 INFO:tasks.workunit.client.0.smithi026.stdout:v0.79 2024-04-21T09:22:01.847 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.79 2024-04-21T09:22:11.131 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 18% (62/329) Updating files: 19% (63/329) Updating files: 20% (66/329) Updating files: 21% (70/329) Updating files: 22% (73/329) Updating files: 23% (76/329) Updating files: 24% (79/329) Updating files: 25% (83/329) Updating files: 26% (86/329) Updating files: 27% (89/329) Updating files: 28% (93/329) Updating files: 29% (96/329) Updating files: 30% (99/329) Updating files: 31% (102/329) Updating files: 32% (106/329) Updating files: 33% (109/329) Updating files: 34% (112/329) Updating files: 34% (114/329) Updating files: 35% (116/329) Updating files: 36% (119/329) Updating files: 37% (122/329) Updating files: 38% (126/329) Updating files: 39% (129/329) Updating files: 40% (132/329) Updating files: 41% (135/329) Updating files: 42% (139/329) Updating files: 43% (142/329) Updating files: 44% (145/329) Updating files: 45% (149/329) Updating files: 46% (152/329) Updating files: 47% (155/329) Updating files: 47% (156/329) Updating files: 48% (158/329) Updating files: 49% (162/329) Updating files: 50% (165/329) Updating files: 51% (168/329) Updating files: 52% (172/329) Updating files: 53% (175/329) Updating files: 54% (178/329) Updating files: 55% (181/329) Updating files: 56% (185/329) Updating files: 57% (188/329) Updating files: 58% (191/329) Updating files: 59% (195/329) Updating files: 60% (198/329) Updating files: 61% (201/329) Updating files: 62% (204/329) Updating files: 62% (207/329) Updating files: 63% (208/329) Updating files: 64% (211/329) Updating files: 65% (214/329) Updating files: 66% (218/329) Updating files: 67% (221/329) Updating files: 68% (224/329) Updating files: 69% (228/329) Updating files: 70% (231/329) Updating files: 71% (234/329) Updating files: 72% (237/329) Updating files: 73% (241/329) Updating files: 74% (244/329) Updating files: 75% (247/329) Updating files: 76% (251/329) Updating files: 77% (254/329) Updating files: 78% (257/329) Updating files: 79% (260/329) Updating files: 80% (264/329) Updating files: 81% (267/329) Updating files: 82% (270/329) Updating files: 83% (274/329) Updating files: 84% (277/329) Updating files: 85% (280/329) Updating files: 86% (283/329) Updating files: 87% (287/329) Updating files: 88% (290/329) Updating files: 89% (293/329) Updating files: 90% (297/329) Updating files: 91% (300/329) Updating files: 92% (303/329) Updating files: 93% (306/329) Updating files: 94% (310/329) Updating files: 95% (313/329) Updating files: 95% (314/329) Updating files: 96% (316/329) Updating files: 97% (320/329) Updating files: 98% (323/329) Updating files: 99% (326/329) Updating files: 100% (329/329) Updating files: 100% (329/329), done. 2024-04-21T09:22:11.443 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 4c2d73a5095 0.79 2024-04-21T09:22:11.451 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.79 2024-04-21T09:22:11.583 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 80 -eq 48 ] 2024-04-21T09:22:11.583 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.80 2024-04-21T09:22:11.583 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.80 2024-04-21T09:22:11.583 INFO:tasks.workunit.client.0.smithi026.stdout:v0.80 2024-04-21T09:22:11.583 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.80 2024-04-21T09:22:18.205 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 30% (53/176) Updating files: 31% (55/176) Updating files: 32% (57/176) Updating files: 33% (59/176) Updating files: 34% (60/176) Updating files: 35% (62/176) Updating files: 36% (64/176) Updating files: 37% (66/176) Updating files: 38% (67/176) Updating files: 39% (69/176) Updating files: 40% (71/176) Updating files: 41% (73/176) Updating files: 42% (74/176) Updating files: 43% (76/176) Updating files: 44% (78/176) Updating files: 45% (80/176) Updating files: 46% (81/176) Updating files: 47% (83/176) Updating files: 48% (85/176) Updating files: 49% (87/176) Updating files: 50% (88/176) Updating files: 51% (90/176) Updating files: 52% (92/176) Updating files: 53% (94/176) Updating files: 54% (96/176) Updating files: 55% (97/176) Updating files: 56% (99/176) Updating files: 57% (101/176) Updating files: 58% (103/176) Updating files: 59% (104/176) Updating files: 60% (106/176) Updating files: 61% (108/176) Updating files: 62% (110/176) Updating files: 63% (111/176) Updating files: 64% (113/176) Updating files: 65% (115/176) Updating files: 66% (117/176) Updating files: 67% (118/176) Updating files: 68% (120/176) Updating files: 69% (122/176) Updating files: 70% (124/176) Updating files: 71% (125/176) Updating files: 72% (127/176) Updating files: 73% (129/176) Updating files: 74% (131/176) Updating files: 75% (132/176) Updating files: 76% (134/176) Updating files: 77% (136/176) Updating files: 78% (138/176) Updating files: 78% (139/176) Updating files: 79% (140/176) Updating files: 80% (141/176) Updating files: 81% (143/176) Updating files: 82% (145/176) Updating files: 83% (147/176) Updating files: 84% (148/176) Updating files: 85% (150/176) Updating files: 86% (152/176) Updating files: 87% (154/176) Updating files: 88% (155/176) Updating files: 89% (157/176) Updating files: 90% (159/176) Updating files: 91% (161/176) Updating files: 92% (162/176) Updating files: 93% (164/176) Updating files: 94% (166/176) Updating files: 95% (168/176) Updating files: 96% (169/176) Updating files: 97% (171/176) Updating files: 98% (173/176) Updating files: 99% (175/176) Updating files: 100% (176/176) Updating files: 100% (176/176), done. 2024-04-21T09:22:18.516 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at b78644e7dee 0.80 2024-04-21T09:22:18.524 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.80 2024-04-21T09:22:18.678 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 81 -eq 48 ] 2024-04-21T09:22:18.678 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.81 2024-04-21T09:22:18.678 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.81 2024-04-21T09:22:18.678 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.81 2024-04-21T09:22:18.678 INFO:tasks.workunit.client.0.smithi026.stdout:v0.81 2024-04-21T09:22:20.303 INFO:tasks.quiescer.fs.[cephfs]:Total duration (39.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-21T09:22:20.304 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.95 2024-04-21T09:22:20.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:22:20.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c23a9640 1 Processor -- start 2024-04-21T09:22:20.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c23a9640 1 -- start start 2024-04-21T09:22:20.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c23a9640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f30bc0c8590 0x7f30bc0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c23a9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 0x7f30bc0c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c23a9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30bc0c94f0 con 0x7f30bc153010 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c23a9640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0740c0 con 0x7f30bc0c8590 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c23a9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc1533f0 con 0x7f30bc0c8040 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bbfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f30bc153010 0x7f30bc15c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58916/0 (socket says 172.21.15.26:58916) 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bbfff640 1 -- 172.21.15.26:0/3399204073 learned_addr learned my addr 172.21.15.26:0/3399204073 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30c0946640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 0x7f30bc0c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30b3fff640 1 --2- 172.21.15.26:0/3399204073 >> v2:172.21.15.169:3300/0 conn(0x7f30bc0c8590 0x7f30bc0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189311365 0 0) 0x7f30bc0c94f0 con 0x7f30bc153010 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30a8003530 con 0x7f30bc153010 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1512684258 0 0) 0x7f30a8003530 con 0x7f30bc153010 2024-04-21T09:22:20.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 msgr2=0x7f30bc0c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 0x7f30bc0c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 >> v2:172.21.15.169:3300/0 conn(0x7f30bc0c8590 msgr2=0x7f30bc0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 --2- 172.21.15.26:0/3399204073 >> v2:172.21.15.169:3300/0 conn(0x7f30bc0c8590 0x7f30bc0c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0c9790 con 0x7f30bc153010 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f30ac001680 con 0x7f30bc153010 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 >> v1:172.21.15.26:6789/0 conn(0x7f30bc153010 legacy=0x7f30bc15c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30a80039c0 0x7f30a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a8004810 0x7f30a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 0x7f30a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc1533f0 con 0x7f30a8004810 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30a800b9d0 con 0x7f30a80039c0 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.459+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f30a800bb50 con 0x7f30bc0c8040 2024-04-21T09:22:20.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30b3fff640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a8004810 0x7f30a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30bbfff640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30a80039c0 0x7f30a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c0946640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 0x7f30a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30b3fff640 1 -- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 msgr2=0x7f30a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30b3fff640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30bc0c8040 0x7f30a80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30b3fff640 1 -- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30a80039c0 msgr2=0x7f30a8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30b3fff640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30a80039c0 0x7f30a8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30b3fff640 1 -- 172.21.15.26:0/3399204073 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30a8003530 con 0x7f30a8004810 2024-04-21T09:22:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30b3fff640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a8004810 0x7f30a8004c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009b10 tx=0x7f30a401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f43567adeb94875 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40096b0 con 0x7f30a8004810 2024-04-21T09:22:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a40a64c0 con 0x7f30a8004810 2024-04-21T09:22:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30bb7fe640 1 -- 172.21.15.26:0/3399204073 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40a68b0 con 0x7f30a8004810 2024-04-21T09:22:20.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c23a9640 1 -- 172.21.15.26:0/3399204073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a8004810 msgr2=0x7f30a8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c23a9640 1 --2- 172.21.15.26:0/3399204073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30a8004810 0x7f30a8004c90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009b10 tx=0x7f30a401cab0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c0946640 1 -- 172.21.15.26:0/3399204073 reap_dead start 2024-04-21T09:22:20.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c23a9640 1 -- 172.21.15.26:0/3399204073 shutdown_connections 2024-04-21T09:22:20.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c23a9640 1 -- 172.21.15.26:0/3399204073 >> 172.21.15.26:0/3399204073 conn(0x7f30bc0c9b50 msgr2=0x7f30bc0c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:20.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c23a9640 1 -- 172.21.15.26:0/3399204073 shutdown_connections 2024-04-21T09:22:20.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.463+0000 7f30c23a9640 1 -- 172.21.15.26:0/3399204073 wait complete. 2024-04-21T09:22:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 Processor -- start 2024-04-21T09:22:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 -- start start 2024-04-21T09:22:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30a8004810 0x7f30bc14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30bc0c66e0 0x7f30bc0c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30bc0c5e30 0x7f30bc1452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0c7bf0 con 0x7f30bc0c66e0 2024-04-21T09:22:20.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0ca950 con 0x7f30bc0c5e30 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc15c8c0 con 0x7f30a8004810 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30bc0c66e0 0x7f30bc0c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30bc0c66e0 0x7f30bc0c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56384/0 (socket says 172.21.15.26:56384) 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 -- 172.21.15.26:0/2689083996 learned_addr learned my addr 172.21.15.26:0/2689083996 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30bbfff640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30a8004810 0x7f30bc14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c0946640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30bc0c5e30 0x7f30bc1452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 -- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30a8004810 msgr2=0x7f30bc14af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30a8004810 0x7f30bc14af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 -- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30bc0c5e30 msgr2=0x7f30bc1452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30bc0c5e30 0x7f30bc1452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 -- 172.21.15.26:0/2689083996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0c4ce0 con 0x7f30bc0c66e0 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c0946640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30bc0c5e30 0x7f30bc1452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b3fff640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30bc0c66e0 0x7f30bc0c58f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009b10 tx=0x7f30a8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b97fa640 1 -- 172.21.15.26:0/2689083996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40be030 con 0x7f30bc0c66e0 2024-04-21T09:22:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b97fa640 1 -- 172.21.15.26:0/2689083996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4004020 con 0x7f30bc0c66e0 2024-04-21T09:22:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc1f7690 con 0x7f30bc0c66e0 2024-04-21T09:22:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30b97fa640 1 -- 172.21.15.26:0/2689083996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a40043f0 con 0x7f30bc0c66e0 2024-04-21T09:22:20.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.467+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc1f7930 con 0x7f30bc0c66e0 2024-04-21T09:22:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.471+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc075ef0 con 0x7f30bc0c66e0 2024-04-21T09:22:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.471+0000 7f30b97fa640 1 -- 172.21.15.26:0/2689083996 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f30a40c1070 con 0x7f30bc0c66e0 2024-04-21T09:22:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.471+0000 7f30b97fa640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f309c068380 0x7f309c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.471+0000 7f30b97fa640 1 -- 172.21.15.26:0/2689083996 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f30a4120aa0 con 0x7f30bc0c66e0 2024-04-21T09:22:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.471+0000 7f30bbfff640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f309c068380 0x7f309c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.471+0000 7f30bbfff640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f309c068380 0x7f309c06a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30ac001210 tx=0x7f30ac007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.475+0000 7f30b97fa640 1 -- 172.21.15.26:0/2689083996 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f30a4016800 con 0x7f30bc0c66e0 2024-04-21T09:22:20.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.723+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30bc0c3f40 con 0x7f30bc0c66e0 2024-04-21T09:22:20.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.723+0000 7f30b97fa640 1 -- 172.21.15.26:0/2689083996 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f30a40f0b80 con 0x7f30bc0c66e0 2024-04-21T09:22:20.722 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:22:20.722 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:22:20.722 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f309c068380 msgr2=0x7f309c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f309c068380 0x7f309c06a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30ac001210 tx=0x7f30ac007040 comp rx=0 tx=0).stop 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30bc0c66e0 msgr2=0x7f30bc0c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30bc0c66e0 0x7f30bc0c58f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f30a4009b10 tx=0x7f30a8005840 comp rx=0 tx=0).stop 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 shutdown_connections 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f30bc0c5e30 0x7f30bc1452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f309c068380 0x7f309c06a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f30bc0c66e0 0x7f30bc0c58f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 --2- 172.21.15.26:0/2689083996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f30a8004810 0x7f30bc14af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 >> 172.21.15.26:0/2689083996 conn(0x7f30bc0c9b50 msgr2=0x7f30bc151270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 shutdown_connections 2024-04-21T09:22:20.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.727+0000 7f30c23a9640 1 -- 172.21.15.26:0/2689083996 wait complete. 2024-04-21T09:22:20.741 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 79.95 --await' 2024-04-21T09:22:20.742 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 79.95 --await 2024-04-21T09:22:20.753 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:22:20.789 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:22:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.867+0000 7f011dd24640 1 Processor -- start 2024-04-21T09:22:20.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.867+0000 7f011dd24640 1 -- start start 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f011dd24640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 0x7f011806dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f011dd24640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180c9030 con 0x7f01180c2c20 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f011dd24640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01180c3180 con 0x7f01180c97f0 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f011dd24640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01180c3460 con 0x7f0118151b60 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0116ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f01180c2c20 0x7f011806ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58920/0 (socket says 172.21.15.26:58920) 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0116ffd640 1 -- 172.21.15.26:0/4159963748 learned_addr learned my addr 172.21.15.26:0/4159963748 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01177fe640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 0x7f011806dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846693755 0 0) 0x7f01180c9030 con 0x7f01180c2c20 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0104003530 con 0x7f01180c2c20 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4083332294 0 0) 0x7f0104003530 con 0x7f01180c2c20 2024-04-21T09:22:20.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 msgr2=0x7f011806dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 0x7f011806dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 >> v1:172.21.15.169:6789/0 conn(0x7f01180c97f0 legacy=0x7f01180c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01180c8550 con 0x7f01180c2c20 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f0100001680 con 0x7f01180c2c20 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 >> v1:172.21.15.26:6789/0 conn(0x7f01180c2c20 legacy=0x7f011806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 0x7f01040039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104003f70 0x7f0104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0104004d50 0x7f01040051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f01180c3460 con 0x7f0104004d50 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f010400bb40 con 0x7f0104003f70 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f010400bd40 con 0x7f0118151b60 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0117fff640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0104004d50 0x7f01040051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0116ffd640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104003f70 0x7f0104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f01177fe640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 0x7f01040039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0117fff640 1 -- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 msgr2=0x7f01040039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0117fff640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 0x7f01040039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0117fff640 1 -- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104003f70 msgr2=0x7f0104004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0117fff640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104003f70 0x7f0104004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.871+0000 7f0117fff640 1 -- 172.21.15.26:0/4159963748 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0104003530 con 0x7f0104004d50 2024-04-21T09:22:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f01177fe640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0118151b60 0x7f01040039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:22:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f0116ffd640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104003f70 0x7f0104004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:22:20.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f0117fff640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0104004d50 0x7f01040051d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0110001360 tx=0x7f011001e650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7be95c263bd3f83 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100013a0 con 0x7f0104004d50 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01100052a0 con 0x7f0104004d50 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f01167fc640 1 -- 172.21.15.26:0/4159963748 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110003600 con 0x7f0104004d50 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 -- 172.21.15.26:0/4159963748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0104004d50 msgr2=0x7f01040051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 --2- 172.21.15.26:0/4159963748 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0104004d50 0x7f01040051d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0110001360 tx=0x7f011001e650 comp rx=0 tx=0).stop 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f0117fff640 1 -- 172.21.15.26:0/4159963748 reap_dead start 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 -- 172.21.15.26:0/4159963748 shutdown_connections 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 -- 172.21.15.26:0/4159963748 >> 172.21.15.26:0/4159963748 conn(0x7f0118070190 msgr2=0x7f01180705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:20.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 -- 172.21.15.26:0/4159963748 shutdown_connections 2024-04-21T09:22:20.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 -- 172.21.15.26:0/4159963748 wait complete. 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 Processor -- start 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.875+0000 7f011dd24640 1 -- start start 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 0x7f01180cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c5200 0x7f0118154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01181f3990 0x7f01181f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f011806f340 con 0x7f01180c5200 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01180c8b10 con 0x7f0104004d50 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01180c7b30 con 0x7f01181f3990 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c5200 0x7f0118154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c5200 0x7f0118154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56398/0 (socket says 172.21.15.26:56398) 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 -- 172.21.15.26:0/3946990677 learned_addr learned my addr 172.21.15.26:0/3946990677 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:20.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f01177fe640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 0x7f01180cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0117fff640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01181f3990 0x7f01181f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 -- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01181f3990 msgr2=0x7f01181f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01181f3990 0x7f01181f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 -- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 msgr2=0x7f01180cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 0x7f01180cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 -- 172.21.15.26:0/3946990677 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01181f4350 con 0x7f01180c5200 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f0116ffd640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c5200 0x7f0118154430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f010000e810 tx=0x7f010000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f010ffff640 1 -- 172.21.15.26:0/3946990677 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010000c870 con 0x7f01180c5200 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f010ffff640 1 -- 172.21.15.26:0/3946990677 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0100018070 con 0x7f01180c5200 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01180cbe50 con 0x7f01180c5200 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f010ffff640 1 -- 172.21.15.26:0/3946990677 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010000cc10 con 0x7f01180c5200 2024-04-21T09:22:20.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01181f0cd0 con 0x7f01180c5200 2024-04-21T09:22:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f010ffff640 1 -- 172.21.15.26:0/3946990677 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f010001d460 con 0x7f01180c5200 2024-04-21T09:22:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.879+0000 7f010ffff640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00f8068380 0x7f00f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f010ffff640 1 -- 172.21.15.26:0/3946990677 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f0100086860 con 0x7f01180c5200 2024-04-21T09:22:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f01177fe640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00f8068380 0x7f00f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 Processor -- start 2024-04-21T09:22:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- start start 2024-04-21T09:22:20.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f01177fe640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00f8068380 0x7f00f806a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0108009fd0 tx=0x7f010800b040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9a5a0 0x560c5af63fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5af9f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9f990 0x560c5af9fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560c5ae45650 con 0x560c5af64500 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c5adadbf0 con 0x560c5af9a5a0 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x560c5ad530c0 con 0x560c5af9f990 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5af9f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5af9f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56414/0 (socket says 172.21.15.26:56414) 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 -- 172.21.15.26:0/3065824329 learned_addr learned my addr 172.21.15.26:0/3065824329 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f01177fe640 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9a5a0 0x560c5af63fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0117fff640 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9f990 0x560c5af9fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 -- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9f990 msgr2=0x560c5af9fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9f990 0x560c5af9fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 -- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9a5a0 msgr2=0x560c5af63fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9a5a0 0x560c5af63fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 -- 172.21.15.26:0/3065824329 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c5ad6ffe0 con 0x560c5af64500 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0116ffd640 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5af9f450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0100056350 tx=0x7f01000560e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9de0e333b77f5c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f010d7fa640 1 -- 172.21.15.26:0/3065824329 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100086040 con 0x560c5af64500 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f010d7fa640 1 -- 172.21.15.26:0/3065824329 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010005f2c0 con 0x560c5af64500 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f010d7fa640 1 -- 172.21.15.26:0/3065824329 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100054950 con 0x560c5af64500 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- 172.21.15.26:0/3065824329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 msgr2=0x560c5af9f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5af9f450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0100056350 tx=0x7f01000560e0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- 172.21.15.26:0/3065824329 shutdown_connections 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9f990 0x560c5af9fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5af9f450 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 --2- 172.21.15.26:0/3065824329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9a5a0 0x560c5af63fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- 172.21.15.26:0/3065824329 >> 172.21.15.26:0/3065824329 conn(0x560c5af9b200 msgr2=0x560c5af9d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- 172.21.15.26:0/3065824329 shutdown_connections 2024-04-21T09:22:20.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.883+0000 7f0120ea6000 1 -- 172.21.15.26:0/3065824329 wait complete. 2024-04-21T09:22:20.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 -- start start 2024-04-21T09:22:20.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 Processor -- start 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af5bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af5c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af5c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560c5ad69540 con 0x560c5af9a5a0 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c5adacf00 con 0x560c5af9f990 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x560c5adb2220 con 0x560c5af64500 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 10 client.0 _ll_register_callbacks cb 0x560c5af499a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af5c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af5c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56428/0 (socket says 172.21.15.26:56428) 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 -- 172.21.15.26:0/850845718 learned_addr learned my addr 172.21.15.26:0/850845718 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f01177fe640 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af5bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0117fff640 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af5c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 -- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 msgr2=0x560c5af5bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af5bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 -- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 msgr2=0x560c5af5c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af5c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 -- 172.21.15.26:0/850845718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c5adba570 con 0x560c5af9a5a0 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0116ffd640 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af5c190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f010000c4b0 tx=0x7f0100012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab20439ff9f128f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f00f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f00f67fc640 1 -- 172.21.15.26:0/850845718 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100072020 con 0x560c5af9a5a0 2024-04-21T09:22:20.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f00f67fc640 1 -- 172.21.15.26:0/850845718 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f010000cdb0 con 0x560c5af9a5a0 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f010005f2c0 con 0x560c5af9a5a0 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f00f67fc640 1 -- 172.21.15.26:0/850845718 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0100086040 con 0x560c5af9a5a0 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 10 client.5124 fetch_fsmap learned FSMap version 8 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560c5ad53310 con 0x560c5af9a5a0 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f00f67fc640 1 -- 172.21.15.26:0/850845718 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010005f2c0 con 0x560c5af9a5a0 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f00f67fc640 1 -- 172.21.15.26:0/850845718 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0100052cc0 con 0x560c5af9a5a0 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 10 client.5124 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 10 client.5124 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 20 client.5124 populate_metadata read hostname 'smithi026' 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5afb3150 0x560c5afb5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 4 client.5124 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560c5ad47880 con 0x560c5afb3150 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f01177fe640 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5afb3150 0x560c5afb5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f01177fe640 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5afb3150 0x560c5afb5540 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2792bd19875a351 server_cookie=3c42d5ad1eaa4dc4 in_seq=0 out_seq=0 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.887+0000 7f00f67fc640 10 client.5124 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f00f67fc640 1 -- 172.21.15.26:0/850845718 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560c5ad47880 con 0x560c5afb3150 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f00f67fc640 10 client.5124 handle_command_reply: tid=0 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 client.5124 shutdown 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 msgr2=0x560c5af5c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af5c190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f010000c4b0 tx=0x7f0100012000 comp rx=0 tx=0).stop 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 shutdown_connections 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5afb3150 0x560c5afb5540 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af5c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af5c190 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f00f67fc640 0 client.5124 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 --2- 172.21.15.26:0/850845718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af5bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 >> 172.21.15.26:0/850845718 conn(0x560c5af9b200 msgr2=0x560c5af99bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:20.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 shutdown_connections 2024-04-21T09:22:20.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 1 -- 172.21.15.26:0/850845718 wait complete. 2024-04-21T09:22:20.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.891+0000 7f0120ea6000 20 client.5124 trim_cache size 0 max 16384 2024-04-21T09:22:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 Processor -- start 2024-04-21T09:22:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 -- start start 2024-04-21T09:22:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af95860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af95da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5b00d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f01181fcaf0 con 0x560c5af9a5a0 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f01181fbeb0 con 0x560c5af9f990 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f01181fc440 con 0x560c5af64500 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.911+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af95da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af95da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56434/0 (socket says 172.21.15.26:56434) 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 -- 172.21.15.26:0/139125145 learned_addr learned my addr 172.21.15.26:0/139125145 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0117fff640 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5b00d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af95860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 -- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 msgr2=0x560c5af95860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af95860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 -- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 msgr2=0x560c5b00d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5b00d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 -- 172.21.15.26:0/139125145 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560c5ad79ab0 con 0x560c5af9a5a0 2024-04-21T09:22:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af95da0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f010005ed90 tx=0x7f0100084000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=561eb8eb1d8313dd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f010cff9640 1 -- 172.21.15.26:0/139125145 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100072070 con 0x560c5af9a5a0 2024-04-21T09:22:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f010cff9640 1 -- 172.21.15.26:0/139125145 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010005f2c0 con 0x560c5af9a5a0 2024-04-21T09:22:20.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f010cff9640 1 -- 172.21.15.26:0/139125145 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0100056650 con 0x560c5af9a5a0 2024-04-21T09:22:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- 172.21.15.26:0/139125145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 msgr2=0x560c5af95da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:20.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af95da0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f010005ed90 tx=0x7f0100084000 comp rx=0 tx=0).stop 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- 172.21.15.26:0/139125145 shutdown_connections 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5b00d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af9a5a0 0x560c5af95da0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 --2- 172.21.15.26:0/139125145 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af64500 0x560c5af95860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- 172.21.15.26:0/139125145 >> 172.21.15.26:0/139125145 conn(0x560c5af9b200 msgr2=0x560c5af9f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- 172.21.15.26:0/139125145 shutdown_connections 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- 172.21.15.26:0/139125145 wait complete. 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- start start 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 Processor -- start 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5b00d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9a5a0 0x560c5b00ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af62680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560c5ad44470 con 0x560c5af64500 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x560c5adbae00 con 0x560c5af9f990 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x560c5ad71b70 con 0x560c5af9a5a0 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0120ea6000 10 client.0 _ll_register_callbacks cb 0x7f0100055fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5b00d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5b00d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56436/0 (socket says 172.21.15.26:56436) 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 -- 172.21.15.26:0/553085269 learned_addr learned my addr 172.21.15.26:0/553085269 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0116ffd640 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9a5a0 0x560c5b00ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f0117fff640 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af62680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 -- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9a5a0 msgr2=0x560c5b00ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9a5a0 0x560c5b00ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 -- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 msgr2=0x560c5af62680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af62680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.915+0000 7f01177fe640 1 -- 172.21.15.26:0/553085269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560c5ae2e660 con 0x560c5af64500 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f01177fe640 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5b00d870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0108017540 tx=0x7f0108004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5043af20d62fdb78 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:20.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f00f67fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f00f67fc640 1 -- 172.21.15.26:0/553085269 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108017d00 con 0x560c5af64500 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f00f67fc640 1 -- 172.21.15.26:0/553085269 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f0108035b30 con 0x560c5af64500 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f010005f2c0 con 0x560c5af64500 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f00f67fc640 1 -- 172.21.15.26:0/553085269 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0108017ea0 con 0x560c5af64500 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 10 client.5130 fetch_fsmap learned FSMap version 8 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x560c5ad436a0 con 0x560c5af64500 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f00f67fc640 1 -- 172.21.15.26:0/553085269 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010005f2c0 con 0x560c5af64500 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f00f67fc640 1 -- 172.21.15.26:0/553085269 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f0108032020 con 0x560c5af64500 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 10 client.5130 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 10 client.5130 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 20 client.5130 populate_metadata read hostname 'smithi026' 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5af633c0 0x560c5af637d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 4 client.5130 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.95, "await": true}] 2024-04-21T09:22:20.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.95, "await": true}) -- 0x560c5adbb610 con 0x560c5af633c0 2024-04-21T09:22:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0116ffd640 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5af633c0 0x560c5af637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f00f67fc640 10 client.5130 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:20.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:20.919+0000 7f0116ffd640 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5af633c0 0x560c5af637d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f90a18caa79edd45 server_cookie=d97e78149604a302 in_seq=0 out_seq=0 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.343+0000 7f00f67fc640 1 -- 172.21.15.26:0/553085269 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x560c5adbb610 con 0x560c5af633c0 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.343+0000 7f00f67fc640 10 client.5130 handle_command_reply: tid=0 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 client.5130 shutdown 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 msgr2=0x560c5b00d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5b00d870 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0108017540 tx=0x7f0108004ac0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 shutdown_connections 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x560c5af633c0 0x560c5af637d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x560c5af9f990 0x560c5af62680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x560c5af9a5a0 0x560c5b00ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 --2- 172.21.15.26:0/553085269 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560c5af64500 0x560c5b00d870 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f00f67fc640 0 client.5130 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 >> 172.21.15.26:0/553085269 conn(0x560c5af9b200 msgr2=0x560c5afb9560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 shutdown_connections 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 1 -- 172.21.15.26:0/553085269 wait complete. 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f0120ea6000 20 client.5130 trim_cache size 0 max 16384 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:22:23.346 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 26, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "ac5da786": { 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 26, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 80.0, 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:22:23.347 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:23.348 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:22:23.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00f8068380 msgr2=0x7f00f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:23.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00f8068380 0x7f00f806a840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0108009fd0 tx=0x7f010800b040 comp rx=0 tx=0).stop 2024-04-21T09:22:23.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c5200 msgr2=0x7f0118154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:23.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c5200 0x7f0118154430 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f010000e810 tx=0x7f010000ecd0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 shutdown_connections 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01181f3990 0x7f01181f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f00f8068380 0x7f00f806a840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c5200 0x7f0118154430 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 --2- 172.21.15.26:0/3946990677 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0104004d50 0x7f01180cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 >> 172.21.15.26:0/3946990677 conn(0x7f0118070190 msgr2=0x7f0118073070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 shutdown_connections 2024-04-21T09:22:23.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:23.347+0000 7f011dd24640 1 -- 172.21.15.26:0/3946990677 wait complete. 2024-04-21T09:22:23.369 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: ac5da786, quiesce duration: 19.95 2024-04-21T09:22:43.319 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:22:43.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.454+0000 7f1ab48e1640 1 Processor -- start 2024-04-21T09:22:43.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.454+0000 7f1ab48e1640 1 -- start start 2024-04-21T09:22:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1ab48e1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ab0159150 0x7f1ab00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1ab48e1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab0159530 0x7f1ab0071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1ab48e1640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ab00c80d0 con 0x7f1ab015f030 2024-04-21T09:22:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1ab48e1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1ab00c8370 con 0x7f1ab0159150 2024-04-21T09:22:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1ab48e1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab00c8650 con 0x7f1ab0159530 2024-04-21T09:22:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aae59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ab0159150 0x7f1ab00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aae59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1ab0159150 0x7f1ab00c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54602/0 (socket says 172.21.15.26:54602) 2024-04-21T09:22:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aae59c640 1 -- 172.21.15.26:0/2097559851 learned_addr learned my addr 172.21.15.26:0/2097559851 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aadd9b640 1 --2- 172.21.15.26:0/2097559851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab0159530 0x7f1ab0071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aae59c640 1 -- 172.21.15.26:0/2097559851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab0159530 msgr2=0x7f1ab0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aae59c640 1 --2- 172.21.15.26:0/2097559851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab0159530 0x7f1ab0071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aae59c640 1 -- 172.21.15.26:0/2097559851 >> v1:172.21.15.169:6789/0 conn(0x7f1ab015f030 legacy=0x7f1ab015f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.458+0000 7f1aae59c640 1 -- 172.21.15.26:0/2097559851 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab00714b0 con 0x7f1ab0159150 2024-04-21T09:22:43.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1aae59c640 1 --2- 172.21.15.26:0/2097559851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c6740 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009e50 tx=0x7f1aa001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad443653fda8424 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1aad59a640 1 -- 172.21.15.26:0/2097559851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00a5670 con 0x7f1ab0159150 2024-04-21T09:22:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1aad59a640 1 -- 172.21.15.26:0/2097559851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa00a5810 con 0x7f1ab0159150 2024-04-21T09:22:43.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1aad59a640 1 -- 172.21.15.26:0/2097559851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00a5be0 con 0x7f1ab0159150 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 -- 172.21.15.26:0/2097559851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 msgr2=0x7f1ab00c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/2097559851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c6740 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f1aa0009e50 tx=0x7f1aa001c9f0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 -- 172.21.15.26:0/2097559851 shutdown_connections 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/2097559851 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab0159530 0x7f1ab0071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/2097559851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c6740 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 -- 172.21.15.26:0/2097559851 >> 172.21.15.26:0/2097559851 conn(0x7f1ab00c8960 msgr2=0x7f1ab00c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 -- 172.21.15.26:0/2097559851 shutdown_connections 2024-04-21T09:22:43.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 -- 172.21.15.26:0/2097559851 wait complete. 2024-04-21T09:22:43.465 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 Processor -- start 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.462+0000 7f1ab48e1640 1 -- start start 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab015f030 0x7f1ab015bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab015ad00 0x7f1ab015c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab006cb20 con 0x7f1ab0159150 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab00c97b0 con 0x7f1ab015ad00 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1ab006cca0 con 0x7f1ab015f030 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54608/0 (socket says 172.21.15.26:54608) 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 -- 172.21.15.26:0/4138948051 learned_addr learned my addr 172.21.15.26:0/4138948051 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aadd9b640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab015f030 0x7f1ab015bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aaed9d640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab015ad00 0x7f1ab015c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 -- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab015f030 msgr2=0x7f1ab015bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab015f030 0x7f1ab015bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 -- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab015ad00 msgr2=0x7f1ab015c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab015ad00 0x7f1ab015c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 -- 172.21.15.26:0/4138948051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab0159ac0 con 0x7f1ab0159150 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aae59c640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c5b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1aa001b0a0 tx=0x7f1aa0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aa6ffd640 1 -- 172.21.15.26:0/4138948051 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00bc020 con 0x7f1ab0159150 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aa6ffd640 1 -- 172.21.15.26:0/4138948051 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1aa00b8670 con 0x7f1ab0159150 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab0159da0 con 0x7f1ab0159150 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aa6ffd640 1 -- 172.21.15.26:0/4138948051 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0009510 con 0x7f1ab0159150 2024-04-21T09:22:43.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab015ba60 con 0x7f1ab0159150 2024-04-21T09:22:43.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab0075ef0 con 0x7f1ab0159150 2024-04-21T09:22:43.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aa6ffd640 1 -- 172.21.15.26:0/4138948051 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1aa00bf020 con 0x7f1ab0159150 2024-04-21T09:22:43.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aa6ffd640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a900683b0 0x7f1a9006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aa6ffd640 1 -- 172.21.15.26:0/4138948051 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f1aa0121bb0 con 0x7f1ab0159150 2024-04-21T09:22:43.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.466+0000 7f1aadd9b640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a900683b0 0x7f1a9006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.470+0000 7f1aadd9b640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a900683b0 0x7f1a9006a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00c3360 tx=0x7f1a98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.470+0000 7f1aa6ffd640 1 -- 172.21.15.26:0/4138948051 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1aa00165e0 con 0x7f1ab0159150 2024-04-21T09:22:43.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.670+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ab00c72e0 con 0x7f1ab0159150 2024-04-21T09:22:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.670+0000 7f1aa6ffd640 1 -- 172.21.15.26:0/4138948051 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f1aa00f22e0 con 0x7f1ab0159150 2024-04-21T09:22:43.671 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:22:43.671 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:22:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:22:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a900683b0 msgr2=0x7f1a9006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a900683b0 0x7f1a9006a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ab00c3360 tx=0x7f1a98008040 comp rx=0 tx=0).stop 2024-04-21T09:22:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 msgr2=0x7f1ab00c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c5b40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1aa001b0a0 tx=0x7f1aa0019790 comp rx=0 tx=0).stop 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 shutdown_connections 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1ab015ad00 0x7f1ab015c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1ab015f030 0x7f1ab015bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1a900683b0 0x7f1a9006a870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 --2- 172.21.15.26:0/4138948051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1ab0159150 0x7f1ab00c5b40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 >> 172.21.15.26:0/4138948051 conn(0x7f1ab00c8960 msgr2=0x7f1ab015f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 shutdown_connections 2024-04-21T09:22:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.674+0000 7f1ab48e1640 1 -- 172.21.15.26:0/4138948051 wait complete. 2024-04-21T09:22:43.689 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id ac5da786 --release --await' 2024-04-21T09:22:43.690 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id ac5da786 --release --await 2024-04-21T09:22:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10ec952640 1 Processor -- start 2024-04-21T09:22:43.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10ec952640 1 -- start start 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10ec952640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e80af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10ec952640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10e80cca10 0x7f10e80af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10ec952640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e80ae920 con 0x7f10e8155120 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10ec952640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f10e80c6850 con 0x7f10e80cca10 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10ec952640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f10e80c7540 con 0x7f10e8154d40 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e6d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10e80cca10 0x7f10e80af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e5d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f10e8155120 0x7f10e815e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42926/0 (socket says 172.21.15.26:42926) 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e5d9b640 1 -- 172.21.15.26:0/2878630947 learned_addr learned my addr 172.21.15.26:0/2878630947 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:22:43.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e659c640 1 --2- 172.21.15.26:0/2878630947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e80af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e6d9d640 1 -- 172.21.15.26:0/2878630947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 msgr2=0x7f10e80af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/2878630947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e80af0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e6d9d640 1 -- 172.21.15.26:0/2878630947 >> v1:172.21.15.26:6789/0 conn(0x7f10e8155120 legacy=0x7f10e815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e6d9d640 1 -- 172.21.15.26:0/2878630947 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e80c6af0 con 0x7f10e80cca10 2024-04-21T09:22:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/2878630947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e80af5f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd872adc14045ae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e559a640 1 -- 172.21.15.26:0/2878630947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b1070 con 0x7f10e80cca10 2024-04-21T09:22:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e559a640 1 -- 172.21.15.26:0/2878630947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00a8050 con 0x7f10e80cca10 2024-04-21T09:22:43.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.818+0000 7f10e559a640 1 -- 172.21.15.26:0/2878630947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00ac860 con 0x7f10e80cca10 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- 172.21.15.26:0/2878630947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 msgr2=0x7f10e80af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 --2- 172.21.15.26:0/2878630947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e80af5f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f10e00097c0 tx=0x7f10e001c4a0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- 172.21.15.26:0/2878630947 shutdown_connections 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 --2- 172.21.15.26:0/2878630947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e80af5f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 --2- 172.21.15.26:0/2878630947 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e80af0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- 172.21.15.26:0/2878630947 >> 172.21.15.26:0/2878630947 conn(0x7f10e80cbef0 msgr2=0x7f10e80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- 172.21.15.26:0/2878630947 shutdown_connections 2024-04-21T09:22:43.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- 172.21.15.26:0/2878630947 wait complete. 2024-04-21T09:22:43.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 Processor -- start 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- start start 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e8150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10e8155120 0x7f10e8071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f10e8167740 con 0x7f10e80cca10 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10e81675c0 con 0x7f10e8155120 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f10e81678c0 con 0x7f10e8154d40 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e8150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e8150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54630/0 (socket says 172.21.15.26:54630) 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 -- 172.21.15.26:0/356712781 learned_addr learned my addr 172.21.15.26:0/356712781 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10e8155120 0x7f10e8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 -- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 msgr2=0x7f10e814aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e814aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 -- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10e8155120 msgr2=0x7f10e8071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10e8155120 0x7f10e8071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 -- 172.21.15.26:0/356712781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e814c0d0 con 0x7f10e80cca10 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10e659c640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e8150ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007e70 tx=0x7f10d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10d6ffd640 1 -- 172.21.15.26:0/356712781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8014620 con 0x7f10e80cca10 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10d6ffd640 1 -- 172.21.15.26:0/356712781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d8019070 con 0x7f10e80cca10 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e814bdf0 con 0x7f10e80cca10 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10d6ffd640 1 -- 172.21.15.26:0/356712781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d8014a00 con 0x7f10e80cca10 2024-04-21T09:22:43.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.822+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e81f3e30 con 0x7f10e80cca10 2024-04-21T09:22:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10d6ffd640 1 -- 172.21.15.26:0/356712781 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10d8014ba0 con 0x7f10e80cca10 2024-04-21T09:22:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10d6ffd640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f10c80683b0 0x7f10c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10d6ffd640 1 -- 172.21.15.26:0/356712781 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f10d80873a0 con 0x7f10e80cca10 2024-04-21T09:22:43.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f10c80683b0 0x7f10c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 Processor -- start 2024-04-21T09:22:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 -- start start 2024-04-21T09:22:43.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f10c80683b0 0x7f10c806a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10e815bc30 tx=0x7f10dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 0x564ac5b3b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b76500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564ac5982660 con 0x564ac5b76120 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564ac59275d0 con 0x564ac5b3af00 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x564ac597e620 con 0x564ac5b718a0 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b76500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b76500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54632/0 (socket says 172.21.15.26:54632) 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 -- 172.21.15.26:0/139023996 learned_addr learned my addr 172.21.15.26:0/139023996 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e659c640 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 0x564ac5b3b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 -- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 msgr2=0x564ac5b3a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b3a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 -- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 msgr2=0x564ac5b3b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 0x564ac5b3b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.826+0000 7f10e6d9d640 1 -- 172.21.15.26:0/139023996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ac595bbd0 con 0x564ac5b76120 2024-04-21T09:22:43.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b76500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f10e001a0d0 tx=0x7f10e00a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b663acc53a3bc9de server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c7fff640 1 -- 172.21.15.26:0/139023996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00bc070 con 0x564ac5b76120 2024-04-21T09:22:43.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c7fff640 1 -- 172.21.15.26:0/139023996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00a8040 con 0x564ac5b76120 2024-04-21T09:22:43.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c7fff640 1 -- 172.21.15.26:0/139023996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b1040 con 0x564ac5b76120 2024-04-21T09:22:43.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/139023996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 msgr2=0x564ac5b76500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b76500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f10e001a0d0 tx=0x7f10e00a7000 comp rx=0 tx=0).stop 2024-04-21T09:22:43.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/139023996 shutdown_connections 2024-04-21T09:22:43.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b76500 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 0x564ac5b3b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- 172.21.15.26:0/139023996 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b3a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/139023996 >> 172.21.15.26:0/139023996 conn(0x564ac5a1cb00 msgr2=0x564ac5b73ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/139023996 shutdown_connections 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/139023996 wait complete. 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- start start 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 Processor -- start 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b3af00 0x564ac5b70650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b718a0 0x564ac5b70b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564ac5a3fd40 con 0x564ac5b718a0 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564ac593ceb0 con 0x564ac5b76120 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x564ac597d2a0 con 0x564ac5b3af00 2024-04-21T09:22:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 10 client.0 _ll_register_callbacks cb 0x564ac5b20a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b718a0 0x564ac5b70b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b718a0 0x564ac5b70b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54638/0 (socket says 172.21.15.26:54638) 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 -- 172.21.15.26:0/1528893480 learned_addr learned my addr 172.21.15.26:0/1528893480 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e659c640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b3af00 0x564ac5b70650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 -- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b3af00 msgr2=0x564ac5b70650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b3af00 0x564ac5b70650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 -- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 msgr2=0x564ac5b358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b358b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 -- 172.21.15.26:0/1528893480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ac59c8b30 con 0x564ac5b718a0 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e659c640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b3af00 0x564ac5b70650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b718a0 0x564ac5b70b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f10dc005e30 tx=0x7f10dc000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f4d66ed68133b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:22:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c57fa640 1 -- 172.21.15.26:0/1528893480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc027060 con 0x564ac5b718a0 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c57fa640 1 -- 172.21.15.26:0/1528893480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f10dc010040 con 0x564ac5b718a0 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564ac591c060 con 0x564ac5b718a0 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c57fa640 1 -- 172.21.15.26:0/1528893480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f10dc005e60 con 0x564ac5b718a0 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 10 client.5151 fetch_fsmap learned FSMap version 8 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564ac5921b70 con 0x564ac5b718a0 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c57fa640 1 -- 172.21.15.26:0/1528893480 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x564ac591c060 con 0x564ac5b718a0 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10c57fa640 1 -- 172.21.15.26:0/1528893480 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f10dc007560 con 0x564ac5b718a0 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 10 client.5151 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 10 client.5151 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 20 client.5151 populate_metadata read hostname 'smithi026' 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b36620 0x564ac5b36a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 4 client.5151 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.830+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564ac595ae30 con 0x564ac5b36620 2024-04-21T09:22:43.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10e659c640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b36620 0x564ac5b36a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10c57fa640 10 client.5151 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:43.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10e659c640 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b36620 0x564ac5b36a00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d7f237595fbce3 server_cookie=237662335479236a in_seq=0 out_seq=0 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10c57fa640 1 -- 172.21.15.26:0/1528893480 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564ac595ae30 con 0x564ac5b36620 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10c57fa640 10 client.5151 handle_command_reply: tid=0 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 client.5151 shutdown 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b718a0 msgr2=0x564ac5b70b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b718a0 0x564ac5b70b90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f10dc005e30 tx=0x7f10dc000bd0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 shutdown_connections 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b36620 0x564ac5b36a00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10c57fa640 0 client.5151 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:43.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b718a0 0x564ac5b70b90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 --2- 172.21.15.26:0/1528893480 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b3af00 0x564ac5b70650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 >> 172.21.15.26:0/1528893480 conn(0x564ac5a1cb00 msgr2=0x564ac5b759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 shutdown_connections 2024-04-21T09:22:43.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 1 -- 172.21.15.26:0/1528893480 wait complete. 2024-04-21T09:22:43.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.834+0000 7f10efad4000 20 client.5151 trim_cache size 0 max 16384 2024-04-21T09:22:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.850+0000 7f10efad4000 1 Processor -- start 2024-04-21T09:22:43.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.850+0000 7f10efad4000 1 -- start start 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 0x564ac5b392a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b397e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b8cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f10e81ff6b0 con 0x564ac5b76120 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f10e81f7600 con 0x564ac5b3af00 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f10e81f7c50 con 0x564ac5b718a0 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b8cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b8cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54642/0 (socket says 172.21.15.26:54642) 2024-04-21T09:22:43.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 -- 172.21.15.26:0/2530457873 learned_addr learned my addr 172.21.15.26:0/2530457873 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 -- 172.21.15.26:0/2530457873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 msgr2=0x564ac5b397e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 -- 172.21.15.26:0/2530457873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 msgr2=0x564ac5b392a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 0x564ac5b392a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 -- 172.21.15.26:0/2530457873 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564ac5a045e0 con 0x564ac5b76120 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b8cb10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f10e0008010 tx=0x7f10e0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dab26a0283eb293 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10c77fe640 1 -- 172.21.15.26:0/2530457873 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00bc070 con 0x564ac5b76120 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10c77fe640 1 -- 172.21.15.26:0/2530457873 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00a8040 con 0x564ac5b76120 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10c77fe640 1 -- 172.21.15.26:0/2530457873 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e00b1040 con 0x564ac5b76120 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- 172.21.15.26:0/2530457873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 msgr2=0x564ac5b8cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b8cb10 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f10e0008010 tx=0x7f10e0004740 comp rx=0 tx=0).stop 2024-04-21T09:22:43.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- 172.21.15.26:0/2530457873 shutdown_connections 2024-04-21T09:22:43.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b76120 0x564ac5b8cb10 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5b397e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- 172.21.15.26:0/2530457873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b3af00 0x564ac5b392a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- 172.21.15.26:0/2530457873 >> 172.21.15.26:0/2530457873 conn(0x564ac5a1cb00 msgr2=0x564ac5b71080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- 172.21.15.26:0/2530457873 shutdown_connections 2024-04-21T09:22:43.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- 172.21.15.26:0/2530457873 wait complete. 2024-04-21T09:22:43.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- start start 2024-04-21T09:22:43.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 Processor -- start 2024-04-21T09:22:43.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b3af00 0x564ac5be3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5be4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b8ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564ac5981970 con 0x564ac5b3af00 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x564ac59378f0 con 0x564ac5b76120 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x564ac5986c90 con 0x564ac5b718a0 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10efad4000 10 client.0 _ll_register_callbacks cb 0x7f10dc001430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b3af00 0x564ac5be3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b3af00 0x564ac5be3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54656/0 (socket says 172.21.15.26:54656) 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e659c640 1 -- 172.21.15.26:0/4118686436 learned_addr learned my addr 172.21.15.26:0/4118686436 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5be4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e659c640 1 -- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 msgr2=0x564ac5be4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e659c640 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5be4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.854+0000 7f10e659c640 1 -- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 msgr2=0x564ac5b8ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10e6d9d640 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b8ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10e659c640 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b8ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10e659c640 1 -- 172.21.15.26:0/4118686436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564ac5914ae0 con 0x564ac5b3af00 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10e659c640 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b3af00 0x564ac5be3b00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f10d800e9b0 tx=0x7f10d8009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7e65386a589e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 1 -- 172.21.15.26:0/4118686436 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d80870b0 con 0x564ac5b3af00 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 1 -- 172.21.15.26:0/4118686436 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f10d805b120 con 0x564ac5b3af00 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10e00a8040 con 0x564ac5b3af00 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 1 -- 172.21.15.26:0/4118686436 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f10d8053760 con 0x564ac5b3af00 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 10 client.5157 fetch_fsmap learned FSMap version 8 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x564ac5917d80 con 0x564ac5b3af00 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 1 -- 172.21.15.26:0/4118686436 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e00a8040 con 0x564ac5b3af00 2024-04-21T09:22:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 1 -- 172.21.15.26:0/4118686436 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f10d805f8d0 con 0x564ac5b3af00 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 10 client.5157 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 10 client.5157 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 20 client.5157 populate_metadata read hostname 'smithi026' 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b8f820 0x564ac5b8fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 4 client.5157 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "ac5da786", "release": true, "await": true}] 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "ac5da786", "release": true, "await": true}) -- 0x564ac59200d0 con 0x564ac5b8f820 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b8f820 0x564ac5b8fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 10 client.5157 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10e5d9b640 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b8f820 0x564ac5b8fc00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=568225541aba259d server_cookie=674bdadbaced4826 in_seq=0 out_seq=0 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 1 -- 172.21.15.26:0/4118686436 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x564ac59200d0 con 0x564ac5b8f820 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 10 client.5157 handle_command_reply: tid=0 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 client.5157 shutdown 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b3af00 msgr2=0x564ac5be3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b3af00 0x564ac5be3b00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f10d800e9b0 tx=0x7f10d8009a10 comp rx=0 tx=0).stop 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 shutdown_connections 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x564ac5b8f820 0x564ac5b8fc00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x564ac5b76120 0x564ac5b8ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x564ac5b718a0 0x564ac5be4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 --2- 172.21.15.26:0/4118686436 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564ac5b3af00 0x564ac5be3b00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10c57fa640 0 client.5157 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 >> 172.21.15.26:0/4118686436 conn(0x564ac5a1cb00 msgr2=0x564ac5b34d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 shutdown_connections 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 1 -- 172.21.15.26:0/4118686436 wait complete. 2024-04-21T09:22:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10efad4000 20 client.5157 trim_cache size 0 max 16384 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 28, 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "ac5da786": { 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 28, 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:22:43.865 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 80.0, 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:43.866 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:22:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f10c80683b0 msgr2=0x7f10c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f10c80683b0 0x7f10c806a870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f10e815bc30 tx=0x7f10dc009040 comp rx=0 tx=0).stop 2024-04-21T09:22:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 msgr2=0x7f10e8150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e8150ad0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007e70 tx=0x7f10d800e4b0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 shutdown_connections 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f10e8155120 0x7f10e8071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10e8154d40 0x7f10e814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f10c80683b0 0x7f10c806a870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 --2- 172.21.15.26:0/356712781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10e80cca10 0x7f10e8150ad0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 >> 172.21.15.26:0/356712781 conn(0x7f10e80cbef0 msgr2=0x7f10e80cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 shutdown_connections 2024-04-21T09:22:43.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.858+0000 7f10ec952640 1 -- 172.21.15.26:0/356712781 wait complete. 2024-04-21T09:22:43.879 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: ac5da786, seconds elapsed: 23.6 2024-04-21T09:22:43.879 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.95 2024-04-21T09:22:43.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:22:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.990+0000 7f31ab66b640 1 Processor -- start 2024-04-21T09:22:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.990+0000 7f31ab66b640 1 -- start start 2024-04-21T09:22:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31ab66b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f31a415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31ab66b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a40c73c0 con 0x7f31a40c8d90 2024-04-21T09:22:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31ab66b640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31a40c76a0 con 0x7f31a40c8970 2024-04-21T09:22:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31ab66b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f31a415f1c0 con 0x7f31a4155190 2024-04-21T09:22:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9c08640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f31a40c8d90 0x7f31a4072a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:42930/0 (socket says 172.21.15.26:42930) 2024-04-21T09:22:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9c08640 1 -- 172.21.15.26:0/1871588444 learned_addr learned my addr 172.21.15.26:0/1871588444 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:22:43.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f31a415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954391644 0 0) 0x7f31a40c73c0 con 0x7f31a40c8d90 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3190003530 con 0x7f31a40c8d90 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3881625449 0 0) 0x7f3190003530 con 0x7f31a40c8d90 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 msgr2=0x7f31a415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f31a415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 >> v1:172.21.15.169:6789/0 conn(0x7f31a40c8970 legacy=0x7f31a40c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a40c6600 con 0x7f31a40c8d90 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f319c001a20 con 0x7f31a40c8d90 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f31a415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T09:22:43.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 >> v1:172.21.15.26:6789/0 conn(0x7f31a40c8d90 legacy=0x7f31a4072a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900039f0 0x7f3190003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f3190004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3190004d50 0x7f31900051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f31a415f1c0 con 0x7f31900039f0 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f319000b9d0 con 0x7f3190004d50 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f319000bbd0 con 0x7f31a4155190 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900039f0 0x7f3190003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9c08640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3190004d50 0x7f31900051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a8c06640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f3190004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 -- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 msgr2=0x7f3190004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f3190004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 -- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3190004d50 msgr2=0x7f31900051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3190004d50 0x7f31900051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 -- 172.21.15.26:0/1871588444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3190003530 con 0x7f31900039f0 2024-04-21T09:22:43.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a8c06640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a4155190 0x7f3190004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:22:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.994+0000 7f31a9407640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900039f0 0x7f3190003dd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009cb0 tx=0x7f31a001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e045cdd68d521c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a00b2070 con 0x7f31900039f0 2024-04-21T09:22:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31a00a58d0 con 0x7f31900039f0 2024-04-21T09:22:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f319bfff640 1 -- 172.21.15.26:0/1871588444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0009880 con 0x7f31900039f0 2024-04-21T09:22:44.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- 172.21.15.26:0/1871588444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900039f0 msgr2=0x7f3190003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 --2- 172.21.15.26:0/1871588444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31900039f0 0x7f3190003dd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f31a0009cb0 tx=0x7f31a001cc10 comp rx=0 tx=0).stop 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a9c08640 1 -- 172.21.15.26:0/1871588444 reap_dead start 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- 172.21.15.26:0/1871588444 shutdown_connections 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- 172.21.15.26:0/1871588444 >> 172.21.15.26:0/1871588444 conn(0x7f31a40702c0 msgr2=0x7f31a40cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- 172.21.15.26:0/1871588444 shutdown_connections 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- 172.21.15.26:0/1871588444 wait complete. 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 Processor -- start 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- start start 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31900039f0 0x7f31a41480d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a414dc90 0x7f31a40c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a414f690 0x7f31a414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f31a40c6bc0 con 0x7f31a414dc90 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f31a40c8540 con 0x7f31900039f0 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f31a40c86c0 con 0x7f31a414f690 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a414dc90 0x7f31a40c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a414dc90 0x7f31a40c4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54668/0 (socket says 172.21.15.26:54668) 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 -- 172.21.15.26:0/3723543939 learned_addr learned my addr 172.21.15.26:0/3723543939 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a9407640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31900039f0 0x7f31a41480d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a9c08640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a414f690 0x7f31a414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 -- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a414f690 msgr2=0x7f31a414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a414f690 0x7f31a414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 -- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31900039f0 msgr2=0x7f31a41480d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31900039f0 0x7f31a41480d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 -- 172.21.15.26:0/3723543939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31a41f0720 con 0x7f31a414dc90 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a9407640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31900039f0 0x7f31a41480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31a8c06640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a414dc90 0x7f31a40c4aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3194010bb0 tx=0x7f319400e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f3199ffb640 1 -- 172.21.15.26:0/3723543939 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194019070 con 0x7f31a414dc90 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f3199ffb640 1 -- 172.21.15.26:0/3723543939 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f319400eb70 con 0x7f31a414dc90 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f3199ffb640 1 -- 172.21.15.26:0/3723543939 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3194011040 con 0x7f31a414dc90 2024-04-21T09:22:44.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31a41f09c0 con 0x7f31a414dc90 2024-04-21T09:22:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:43.998+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31a41f0f80 con 0x7f31a414dc90 2024-04-21T09:22:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.002+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a4075ef0 con 0x7f31a414dc90 2024-04-21T09:22:44.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.002+0000 7f3199ffb640 1 -- 172.21.15.26:0/3723543939 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f319401c070 con 0x7f31a414dc90 2024-04-21T09:22:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.002+0000 7f3199ffb640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31880683b0 0x7f318806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.002+0000 7f3199ffb640 1 -- 172.21.15.26:0/3723543939 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f3194089810 con 0x7f31a414dc90 2024-04-21T09:22:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.002+0000 7f31a9407640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31880683b0 0x7f318806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.002+0000 7f31a9407640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31880683b0 0x7f318806a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f31a00af000 tx=0x7f31a00046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.006+0000 7f3199ffb640 1 -- 172.21.15.26:0/3723543939 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3194059e40 con 0x7f31a414dc90 2024-04-21T09:22:44.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.218+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31a414f2b0 con 0x7f31a414dc90 2024-04-21T09:22:44.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.218+0000 7f3199ffb640 1 -- 172.21.15.26:0/3723543939 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f3194059740 con 0x7f31a414dc90 2024-04-21T09:22:44.220 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:22:44.220 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:22:44.220 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:22:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31880683b0 msgr2=0x7f318806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31880683b0 0x7f318806a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f31a00af000 tx=0x7f31a00046d0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a414dc90 msgr2=0x7f31a40c4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a414dc90 0x7f31a40c4aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3194010bb0 tx=0x7f319400e4c0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 shutdown_connections 2024-04-21T09:22:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31a414f690 0x7f31a414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f31880683b0 0x7f318806a870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f31a414dc90 0x7f31a40c4aa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 --2- 172.21.15.26:0/3723543939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31900039f0 0x7f31a41480d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 >> 172.21.15.26:0/3723543939 conn(0x7f31a40702c0 msgr2=0x7f31a40c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 shutdown_connections 2024-04-21T09:22:44.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.222+0000 7f31ab66b640 1 -- 172.21.15.26:0/3723543939 wait complete. 2024-04-21T09:22:44.238 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 79.95 --await' 2024-04-21T09:22:44.238 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 79.95 --await 2024-04-21T09:22:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.362+0000 7f9e62564640 1 Processor -- start 2024-04-21T09:22:44.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.362+0000 7f9e62564640 1 -- start start 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e5c152980 0x7f9e5c158e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c0c79a0 0x7f9e5c163110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5c074010 con 0x7f9e5c06f8b0 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5c0731c0 con 0x7f9e5c152980 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c1589c0 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e5c152980 0x7f9e5c158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e5c152980 0x7f9e5c158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54674/0 (socket says 172.21.15.26:54674) 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 -- 172.21.15.26:0/3877500574 learned_addr learned my addr 172.21.15.26:0/3877500574 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 -- 172.21.15.26:0/3877500574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c0c79a0 msgr2=0x7f9e5c163110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/3877500574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c0c79a0 0x7f9e5c163110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 -- 172.21.15.26:0/3877500574 >> v1:172.21.15.169:6789/0 conn(0x7f9e5c06f8b0 legacy=0x7f9e5c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 -- 172.21.15.26:0/3877500574 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c072ee0 con 0x7f9e5c152980 2024-04-21T09:22:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/3877500574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c152980 0x7f9e5c158e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009870 tx=0x7f9e4c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d665d97f97c089c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5affd640 1 -- 172.21.15.26:0/3877500574 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0ab5f0 con 0x7f9e5c152980 2024-04-21T09:22:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5affd640 1 -- 172.21.15.26:0/3877500574 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4c0b0070 con 0x7f9e5c152980 2024-04-21T09:22:44.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e5affd640 1 -- 172.21.15.26:0/3877500574 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0ab9b0 con 0x7f9e5c152980 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- 172.21.15.26:0/3877500574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c152980 msgr2=0x7f9e5c158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 --2- 172.21.15.26:0/3877500574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c152980 0x7f9e5c158e50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009870 tx=0x7f9e4c01c520 comp rx=0 tx=0).stop 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- 172.21.15.26:0/3877500574 shutdown_connections 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 --2- 172.21.15.26:0/3877500574 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c0c79a0 0x7f9e5c163110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 --2- 172.21.15.26:0/3877500574 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c152980 0x7f9e5c158e50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- 172.21.15.26:0/3877500574 >> 172.21.15.26:0/3877500574 conn(0x7f9e5c070190 msgr2=0x7f9e5c0705a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- 172.21.15.26:0/3877500574 shutdown_connections 2024-04-21T09:22:44.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.366+0000 7f9e62564640 1 -- 172.21.15.26:0/3877500574 wait complete. 2024-04-21T09:22:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 Processor -- start 2024-04-21T09:22:44.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 -- start start 2024-04-21T09:22:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c06f8b0 0x7f9e5c146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0c79a0 0x7f9e5c140d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e5c152980 0x7f9e5c143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c0c7470 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c0c72f0 con 0x7f9e5c152980 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c06c0f0 con 0x7f9e5c06f8b0 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0c79a0 0x7f9e5c140d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0c79a0 0x7f9e5c140d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54676/0 (socket says 172.21.15.26:54676) 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 -- 172.21.15.26:0/2661717986 learned_addr learned my addr 172.21.15.26:0/2661717986 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c06f8b0 0x7f9e5c146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e60b01640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e5c152980 0x7f9e5c143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 -- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c06f8b0 msgr2=0x7f9e5c146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c06f8b0 0x7f9e5c146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 -- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e5c152980 msgr2=0x7f9e5c143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e5c152980 0x7f9e5c143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 -- 172.21.15.26:0/2661717986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c1f2390 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e60b01640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e5c152980 0x7f9e5c143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0c79a0 0x7f9e5c140d40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000b410 tx=0x7f9e5000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e58ff9640 1 -- 172.21.15.26:0/2661717986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50015020 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e58ff9640 1 -- 172.21.15.26:0/2661717986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e50011850 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5c1f2670 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e58ff9640 1 -- 172.21.15.26:0/2661717986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e50011c40 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.370+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5c1f2c30 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e58ff9640 1 -- 172.21.15.26:0/2661717986 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e50018020 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e58ff9640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e48068380 0x7f9e4806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e58ff9640 1 -- 172.21.15.26:0/2661717986 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9e50086ae0 con 0x7f9e5c0c79a0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e48068380 0x7f9e4806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 Processor -- start 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- start start 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e48068380 0x7f9e4806a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0af000 tx=0x7f9e4c0a7000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533649bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x5653364d7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56533637d650 con 0x5653364d7990 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5653362e5bf0 con 0x5653364d25a0 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x56533628b0c0 con 0x56533649c500 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364d7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54686/0 (socket says 172.21.15.26:54686) 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 -- 172.21.15.26:0/2458484862 learned_addr learned my addr 172.21.15.26:0/2458484862 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533649bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x5653364d7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 -- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 msgr2=0x5653364d7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x5653364d7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 -- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 msgr2=0x56533649bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533649bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 -- 172.21.15.26:0/2458484862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653362a7fe0 con 0x5653364d7990 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533649bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e60b01640 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364d7d70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007f00 tx=0x7f9e5400c690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee59266d0472a921 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e41ffb640 1 -- 172.21.15.26:0/2458484862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54014070 con 0x5653364d7990 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e41ffb640 1 -- 172.21.15.26:0/2458484862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5400f850 con 0x5653364d7990 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e41ffb640 1 -- 172.21.15.26:0/2458484862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400fc20 con 0x5653364d7990 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- 172.21.15.26:0/2458484862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 msgr2=0x5653364d7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364d7d70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007f00 tx=0x7f9e5400c690 comp rx=0 tx=0).stop 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- 172.21.15.26:0/2458484862 shutdown_connections 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364d7d70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x5653364d7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 --2- 172.21.15.26:0/2458484862 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533649bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- 172.21.15.26:0/2458484862 >> 172.21.15.26:0/2458484862 conn(0x5653364d3200 msgr2=0x5653364d55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- 172.21.15.26:0/2458484862 shutdown_connections 2024-04-21T09:22:44.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.374+0000 7f9e656e6000 1 -- 172.21.15.26:0/2458484862 wait complete. 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 -- start start 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 Processor -- start 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x565336493c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x565336494190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364946d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5653362a1540 con 0x5653364d7990 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5653362e4f00 con 0x5653364d25a0 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5653362ea220 con 0x56533649c500 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 10 client.0 _ll_register_callbacks cb 0x5653364819a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364946d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54702/0 (socket says 172.21.15.26:54702) 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 -- 172.21.15.26:0/516900415 learned_addr learned my addr 172.21.15.26:0/516900415 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x565336494190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x565336493c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 -- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 msgr2=0x565336493c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x565336493c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 -- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 msgr2=0x565336494190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x565336494190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 -- 172.21.15.26:0/516900415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5653362f2570 con 0x5653364d7990 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e60b01640 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364946d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400cb90 tx=0x7f9e54004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c09100a3dd460f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e3affd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e3affd640 1 -- 172.21.15.26:0/516900415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54028060 con 0x5653364d7990 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e3affd640 1 -- 172.21.15.26:0/516900415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9e5400f650 con 0x5653364d7990 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e5400f850 con 0x5653364d7990 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e3affd640 1 -- 172.21.15.26:0/516900415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9e54014040 con 0x5653364d7990 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 10 client.5175 fetch_fsmap learned FSMap version 8 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56533628b310 con 0x5653364d7990 2024-04-21T09:22:44.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e3affd640 1 -- 172.21.15.26:0/516900415 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5400f850 con 0x5653364d7990 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e3affd640 1 -- 172.21.15.26:0/516900415 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f9e54022070 con 0x5653364d7990 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 10 client.5175 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 10 client.5175 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 20 client.5175 populate_metadata read hostname 'smithi026' 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5653364eb150 0x5653364ed540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 4 client.5175 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56533627f880 con 0x5653364eb150 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5653364eb150 0x5653364ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e3affd640 10 client.5175 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:44.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.378+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5653364eb150 0x5653364ed540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba31f190e10fd318 server_cookie=4918cc42d1b2644c in_seq=0 out_seq=0 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e3affd640 1 -- 172.21.15.26:0/516900415 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56533627f880 con 0x5653364eb150 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e3affd640 10 client.5175 handle_command_reply: tid=0 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 client.5175 shutdown 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 msgr2=0x5653364946d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364946d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9e5400cb90 tx=0x7f9e54004a50 comp rx=0 tx=0).stop 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 shutdown_connections 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5653364eb150 0x5653364ed540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x5653364946d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x565336494190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e3affd640 0 client.5175 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 --2- 172.21.15.26:0/516900415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x56533649c500 0x565336493c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 >> 172.21.15.26:0/516900415 conn(0x5653364d3200 msgr2=0x5653364d1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:44.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 shutdown_connections 2024-04-21T09:22:44.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 1 -- 172.21.15.26:0/516900415 wait complete. 2024-04-21T09:22:44.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.386+0000 7f9e656e6000 20 client.5175 trim_cache size 0 max 16384 2024-04-21T09:22:44.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.402+0000 7f9e656e6000 1 Processor -- start 2024-04-21T09:22:44.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.402+0000 7f9e656e6000 1 -- start start 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533649c500 0x56533649b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d25a0 0x56533649bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x56533650d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c1fdb00 con 0x5653364d7990 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c1f5750 con 0x56533649c500 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c1f5da0 con 0x5653364d25a0 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x56533650d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x56533650d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54708/0 (socket says 172.21.15.26:54708) 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 -- 172.21.15.26:0/231092317 learned_addr learned my addr 172.21.15.26:0/231092317 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d25a0 0x56533649bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533649c500 0x56533649b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 -- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d25a0 msgr2=0x56533649bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d25a0 0x56533649bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 -- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533649c500 msgr2=0x56533649b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533649c500 0x56533649b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 -- 172.21.15.26:0/231092317 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5653362b1ab0 con 0x5653364d7990 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e60b01640 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x56533650d100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007e00 tx=0x7f9e5401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392362709f9b0593 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e417fa640 1 -- 172.21.15.26:0/231092317 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54037070 con 0x5653364d7990 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e417fa640 1 -- 172.21.15.26:0/231092317 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5401a560 con 0x5653364d7990 2024-04-21T09:22:44.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e417fa640 1 -- 172.21.15.26:0/231092317 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5400f650 con 0x5653364d7990 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- 172.21.15.26:0/231092317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 msgr2=0x56533650d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x56533650d100 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9e54007e00 tx=0x7f9e5401f000 comp rx=0 tx=0).stop 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- 172.21.15.26:0/231092317 shutdown_connections 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5653364d7990 0x56533650d100 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d25a0 0x56533649bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- 172.21.15.26:0/231092317 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x56533649c500 0x56533649b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- 172.21.15.26:0/231092317 >> 172.21.15.26:0/231092317 conn(0x5653364d3200 msgr2=0x5653364f2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- 172.21.15.26:0/231092317 shutdown_connections 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- 172.21.15.26:0/231092317 wait complete. 2024-04-21T09:22:44.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- start start 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 Processor -- start 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56533649c500 0x56533654e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533654e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d7990 0x56533649a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56533627c470 con 0x56533649c500 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5653362f2e00 con 0x5653364d25a0 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5653362a9b70 con 0x5653364d7990 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.406+0000 7f9e656e6000 10 client.0 _ll_register_callbacks cb 0x7f9e54007d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56533649c500 0x56533654e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56533649c500 0x56533654e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54720/0 (socket says 172.21.15.26:54720) 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 -- 172.21.15.26:0/1810616175 learned_addr learned my addr 172.21.15.26:0/1810616175 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533654e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e60b01640 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d7990 0x56533649a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 -- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d7990 msgr2=0x56533649a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d7990 0x56533649a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 -- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 msgr2=0x56533654e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533654e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 -- 172.21.15.26:0/1810616175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565336366660 con 0x56533649c500 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5bfff640 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56533649c500 0x56533654e080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009630 tx=0x7f9e4c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65bba906efbf219f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e3affd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e3affd640 1 -- 172.21.15.26:0/1810616175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c0cc060 con 0x56533649c500 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e5401a560 con 0x56533649c500 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e3affd640 1 -- 172.21.15.26:0/1810616175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f9e4c0c8410 con 0x56533649c500 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e3affd640 1 -- 172.21.15.26:0/1810616175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f9e4c0d2050 con 0x56533649c500 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 10 client.5181 fetch_fsmap learned FSMap version 8 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x56533627b6a0 con 0x56533649c500 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e3affd640 1 -- 172.21.15.26:0/1810616175 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e5401a560 con 0x56533649c500 2024-04-21T09:22:44.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e3affd640 1 -- 172.21.15.26:0/1810616175 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f9e4c0d5020 con 0x56533649c500 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 10 client.5181 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 10 client.5181 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 20 client.5181 populate_metadata read hostname 'smithi026' 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56533649b490 0x56533649b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 4 client.5181 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.95, "await": true}] 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 79.95, "await": true}) -- 0x5653362f3610 con 0x56533649b490 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56533649b490 0x56533649b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e5b7fe640 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56533649b490 0x56533649b8a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f53d42893cdc7a5 server_cookie=b76296d475b0dea in_seq=0 out_seq=0 2024-04-21T09:22:44.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:44.410+0000 7f9e3affd640 10 client.5181 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e3affd640 1 -- 172.21.15.26:0/1810616175 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5653362f3610 con 0x56533649b490 2024-04-21T09:22:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e3affd640 10 client.5181 handle_command_reply: tid=0 2024-04-21T09:22:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 client.5181 shutdown 2024-04-21T09:22:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56533649c500 msgr2=0x56533654e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56533649c500 0x56533654e080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009630 tx=0x7f9e4c0046d0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 shutdown_connections 2024-04-21T09:22:45.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x56533649b490 0x56533649b8a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5653364d7990 0x56533649a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e3affd640 0 client.5181 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5653364d25a0 0x56533654e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 --2- 172.21.15.26:0/1810616175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56533649c500 0x56533654e080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 >> 172.21.15.26:0/1810616175 conn(0x5653364d3200 msgr2=0x5653364f1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 shutdown_connections 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 1 -- 172.21.15.26:0/1810616175 wait complete. 2024-04-21T09:22:45.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.094+0000 7f9e656e6000 20 client.5181 trim_cache size 0 max 16384 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 30, 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "d4a40035": { 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 30, 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:22:45.097 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 80.0, 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:45.098 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:45.099 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:22:45.099 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e48068380 msgr2=0x7f9e4806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e48068380 0x7f9e4806a840 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0af000 tx=0x7f9e4c0a7000 comp rx=0 tx=0).stop 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0c79a0 msgr2=0x7f9e5c140d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0c79a0 0x7f9e5c140d40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9e5000b410 tx=0x7f9e5000b8d0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 shutdown_connections 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9e5c152980 0x7f9e5c143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f9e48068380 0x7f9e4806a840 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0c79a0 0x7f9e5c140d40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 --2- 172.21.15.26:0/2661717986 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9e5c06f8b0 0x7f9e5c146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 >> 172.21.15.26:0/2661717986 conn(0x7f9e5c070190 msgr2=0x7f9e5c14d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 shutdown_connections 2024-04-21T09:22:45.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:22:45.098+0000 7f9e62564640 1 -- 172.21.15.26:0/2661717986 wait complete. 2024-04-21T09:22:45.126 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced, set_id: d4a40035, quiesce duration: 19.95 2024-04-21T09:22:50.868 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:22:50.871 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:23:05.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:23:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.214+0000 7f7ee5144640 1 Processor -- start 2024-04-21T09:23:05.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.214+0000 7f7ee5144640 1 -- start start 2024-04-21T09:23:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.214+0000 7f7ee5144640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7ee0154f90 0x7f7ee00c6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.214+0000 7f7ee5144640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee00c82f0 0x7f7ee015b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.214+0000 7f7ee5144640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ee00c8720 con 0x7f7ee00c7e80 2024-04-21T09:23:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.214+0000 7f7ee5144640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7ee00b14e0 con 0x7f7ee0154f90 2024-04-21T09:23:05.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.214+0000 7f7ee5144640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee00c6c80 con 0x7f7ee00c82f0 2024-04-21T09:23:05.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7edf59e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee00c82f0 0x7f7ee015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eded9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7ee0154f90 0x7f7ee00c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7edf59e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee00c82f0 0x7f7ee015b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:60944/0 (socket says 172.21.15.26:60944) 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7edf59e640 1 -- 172.21.15.26:0/1392908939 learned_addr learned my addr 172.21.15.26:0/1392908939 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eded9d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7ee0154f90 0x7f7ee00c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:57568/0 (socket says 172.21.15.26:57568) 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7ede59c640 1 --1- 172.21.15.26:0/1392908939 >> v1:172.21.15.169:6789/0 conn(0x7f7ee00c7e80 0x7f7ee015ac50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:45318/0 (socket says 172.21.15.26:45318) 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eded9d640 1 -- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee00c82f0 msgr2=0x7f7ee015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eded9d640 1 --2- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee00c82f0 0x7f7ee015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eded9d640 1 -- 172.21.15.26:0/1392908939 >> v1:172.21.15.169:6789/0 conn(0x7f7ee00c7e80 legacy=0x7f7ee015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eddd9b640 1 -- 172.21.15.26:0/1392908939 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1697704877 0 0) 0x7f7ed40014a0 con 0x7f7ee00c7e80 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eded9d640 1 -- 172.21.15.26:0/1392908939 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee0155370 con 0x7f7ee0154f90 2024-04-21T09:23:05.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7edf59e640 1 --2- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee00c82f0 0x7f7ee015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T09:23:05.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eded9d640 1 --2- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee0154f90 0x7f7ee00c6740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00097c0 tx=0x7f7ed001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=676f833876638a2d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eddd9b640 1 -- 172.21.15.26:0/1392908939 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00b0070 con 0x7f7ee0154f90 2024-04-21T09:23:05.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eddd9b640 1 -- 172.21.15.26:0/1392908939 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed00ab600 con 0x7f7ee0154f90 2024-04-21T09:23:05.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.218+0000 7f7eddd9b640 1 -- 172.21.15.26:0/1392908939 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00ab9d0 con 0x7f7ee0154f90 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee0154f90 msgr2=0x7f7ee00c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 --2- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee0154f90 0x7f7ee00c6740 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00097c0 tx=0x7f7ed001c410 comp rx=0 tx=0).stop 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- 172.21.15.26:0/1392908939 shutdown_connections 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 --2- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee00c82f0 0x7f7ee015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 --2- 172.21.15.26:0/1392908939 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee0154f90 0x7f7ee00c6740 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- 172.21.15.26:0/1392908939 >> 172.21.15.26:0/1392908939 conn(0x7f7ee00c8960 msgr2=0x7f7ee00c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- 172.21.15.26:0/1392908939 shutdown_connections 2024-04-21T09:23:05.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- 172.21.15.26:0/1392908939 wait complete. 2024-04-21T09:23:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 Processor -- start 2024-04-21T09:23:05.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- start start 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee00c7e80 0x7f7ee01f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee00c82f0 0x7f7ee0152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee0154f90 0x7f7ee0148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee00c9670 con 0x7f7ee00c82f0 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7ee00c7960 con 0x7f7ee00c7e80 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7ee00724e0 con 0x7f7ee0154f90 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee00c82f0 0x7f7ee0152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee00c82f0 0x7f7ee0152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35676/0 (socket says 172.21.15.26:35676) 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 -- 172.21.15.26:0/2807527901 learned_addr learned my addr 172.21.15.26:0/2807527901 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7edf59e640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee0154f90 0x7f7ee0148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7eded9d640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee00c7e80 0x7f7ee01f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 -- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee0154f90 msgr2=0x7f7ee0148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee0154f90 0x7f7ee0148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 -- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee00c7e80 msgr2=0x7f7ee01f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee00c7e80 0x7f7ee01f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 -- 172.21.15.26:0/2807527901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ee0152990 con 0x7f7ee00c82f0 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ede59c640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee00c82f0 0x7f7ee0152450 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c8f0 tx=0x7f7ed400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ec77fe640 1 -- 172.21.15.26:0/2807527901 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4018070 con 0x7f7ee00c82f0 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ec77fe640 1 -- 172.21.15.26:0/2807527901 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed400a5e0 con 0x7f7ee00c82f0 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ee0155600 con 0x7f7ee00c82f0 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ec77fe640 1 -- 172.21.15.26:0/2807527901 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed400aa10 con 0x7f7ee00c82f0 2024-04-21T09:23:05.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.222+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ee0155b80 con 0x7f7ee00c82f0 2024-04-21T09:23:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.226+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ee0075ef0 con 0x7f7ee00c82f0 2024-04-21T09:23:05.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.226+0000 7f7ec77fe640 1 -- 172.21.15.26:0/2807527901 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ed400abb0 con 0x7f7ee00c82f0 2024-04-21T09:23:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.226+0000 7f7ec77fe640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ecc0683b0 0x7f7ecc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.226+0000 7f7ec77fe640 1 -- 172.21.15.26:0/2807527901 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7f7ed4086420 con 0x7f7ee00c82f0 2024-04-21T09:23:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.226+0000 7f7eded9d640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ecc0683b0 0x7f7ecc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.226+0000 7f7eded9d640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ecc0683b0 0x7f7ecc06a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00ad000 tx=0x7f7ed00a6000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.230+0000 7f7ec77fe640 1 -- 172.21.15.26:0/2807527901 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7ee00c8720 con 0x7f7ee00c82f0 2024-04-21T09:23:05.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.426+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ee00c9450 con 0x7f7ee00c82f0 2024-04-21T09:23:05.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.426+0000 7f7ec77fe640 1 -- 172.21.15.26:0/2807527901 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7f7ed4056910 con 0x7f7ee00c82f0 2024-04-21T09:23:05.428 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:23:05.428 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:23:05.428 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:23:05.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ecc0683b0 msgr2=0x7f7ecc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ecc0683b0 0x7f7ecc06a870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00ad000 tx=0x7f7ed00a6000 comp rx=0 tx=0).stop 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee00c82f0 msgr2=0x7f7ee0152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee00c82f0 0x7f7ee0152450 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7ed400c8f0 tx=0x7f7ed400cdb0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 shutdown_connections 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7ee0154f90 0x7f7ee0148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7ecc0683b0 0x7f7ecc06a870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ee00c82f0 0x7f7ee0152450 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 --2- 172.21.15.26:0/2807527901 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7ee00c7e80 0x7f7ee01f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 >> 172.21.15.26:0/2807527901 conn(0x7f7ee00c8960 msgr2=0x7f7ee006caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 shutdown_connections 2024-04-21T09:23:05.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.430+0000 7f7ee5144640 1 -- 172.21.15.26:0/2807527901 wait complete. 2024-04-21T09:23:05.445 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --set-id d4a40035 --release --await' 2024-04-21T09:23:05.445 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --set-id d4a40035 --release --await 2024-04-21T09:23:05.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd942695640 1 Processor -- start 2024-04-21T09:23:05.573 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd942695640 1 -- start start 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd942695640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd93c0734a0 0x7fd93c15b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd942695640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd93c0bfbb0 con 0x7fd93c151fa0 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd942695640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd93c06ced0 con 0x7fd93c151bc0 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd942695640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd93c06d1b0 con 0x7fd93c0734a0 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd93b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd93c151fa0 0x7fd93c15af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51780/0 (socket says 172.21.15.26:51780) 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd93b7fe640 1 -- 172.21.15.26:0/445267334 learned_addr learned my addr 172.21.15.26:0/445267334 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd940c32640 1 --2- 172.21.15.26:0/445267334 >> v2:172.21.15.26:3300/0 conn(0x7fd93c0734a0 0x7fd93c15b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd93affd640 1 -- 172.21.15.26:0/445267334 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 627292583 0 0) 0x7fd93c0bfbb0 con 0x7fd93c151fa0 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd93affd640 1 -- 172.21.15.26:0/445267334 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd924003530 con 0x7fd93c151fa0 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd940c32640 1 -- 172.21.15.26:0/445267334 >> v1:172.21.15.169:6789/0 conn(0x7fd93c151bc0 legacy=0x7fd93c072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd940c32640 1 -- 172.21.15.26:0/445267334 >> v1:172.21.15.26:6789/0 conn(0x7fd93c151fa0 legacy=0x7fd93c15af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.575 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.574+0000 7fd940c32640 1 -- 172.21.15.26:0/445267334 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c071fd0 con 0x7fd93c0734a0 2024-04-21T09:23:05.576 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd940c32640 1 --2- 172.21.15.26:0/445267334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c15b640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd934009d90 tx=0x7fd93401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31492ed4b24c609 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93affd640 1 -- 172.21.15.26:0/445267334 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9340b2070 con 0x7fd93c0734a0 2024-04-21T09:23:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93affd640 1 -- 172.21.15.26:0/445267334 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9340a59c0 con 0x7fd93c0734a0 2024-04-21T09:23:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93affd640 1 -- 172.21.15.26:0/445267334 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9340a5d90 con 0x7fd93c0734a0 2024-04-21T09:23:05.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- 172.21.15.26:0/445267334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 msgr2=0x7fd93c15b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 --2- 172.21.15.26:0/445267334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c15b640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd934009d90 tx=0x7fd93401c900 comp rx=0 tx=0).stop 2024-04-21T09:23:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- 172.21.15.26:0/445267334 shutdown_connections 2024-04-21T09:23:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 --2- 172.21.15.26:0/445267334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c15b640 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- 172.21.15.26:0/445267334 >> 172.21.15.26:0/445267334 conn(0x7fd93c0cbef0 msgr2=0x7fd93c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- 172.21.15.26:0/445267334 shutdown_connections 2024-04-21T09:23:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- 172.21.15.26:0/445267334 wait complete. 2024-04-21T09:23:05.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 Processor -- start 2024-04-21T09:23:05.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- start start 2024-04-21T09:23:05.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd93c151bc0 0x7fd93c143980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd93c151fa0 0x7fd93c143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c06cc80 con 0x7fd93c0734a0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c06cb00 con 0x7fd93c151fa0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c165b40 con 0x7fd93c151bc0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35700/0 (socket says 172.21.15.26:35700) 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 -- 172.21.15.26:0/3943556393 learned_addr learned my addr 172.21.15.26:0/3943556393 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 -- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd93c151bc0 msgr2=0x7fd93c143980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd93c151bc0 0x7fd93c143980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 -- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd93c151fa0 msgr2=0x7fd93c143ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd93c151fa0 0x7fd93c143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 -- 172.21.15.26:0/3943556393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c1483f0 con 0x7fd93c0734a0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd93bfff640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c147eb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c480 tx=0x7fd92c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd938ff9640 1 -- 172.21.15.26:0/3943556393 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c012830 con 0x7fd93c0734a0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd938ff9640 1 -- 172.21.15.26:0/3943556393 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c017070 con 0x7fd93c0734a0 2024-04-21T09:23:05.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93c145ba0 con 0x7fd93c0734a0 2024-04-21T09:23:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd938ff9640 1 -- 172.21.15.26:0/3943556393 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c012c10 con 0x7fd93c0734a0 2024-04-21T09:23:05.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.578+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93c0cb5b0 con 0x7fd93c0734a0 2024-04-21T09:23:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd938ff9640 1 -- 172.21.15.26:0/3943556393 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd92c01c460 con 0x7fd93c0734a0 2024-04-21T09:23:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd938ff9640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd928068380 0x7fd92806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd938ff9640 1 -- 172.21.15.26:0/3943556393 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fd92c0867b0 con 0x7fd93c0734a0 2024-04-21T09:23:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd928068380 0x7fd92806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 Processor -- start 2024-04-21T09:23:05.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 -- start start 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd928068380 0x7fd92806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd930007fd0 tx=0x7fd930007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9c7a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9c7b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9cb6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5616e9ac2660 con 0x5616e9c7af00 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5616e9a675d0 con 0x5616e9cb18a0 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5616e9abe620 con 0x5616e9cb6120 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9c7b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9c7b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35702/0 (socket says 172.21.15.26:35702) 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 -- 172.21.15.26:0/698907640 learned_addr learned my addr 172.21.15.26:0/698907640 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:23:05.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93bfff640 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9c7a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd940c32640 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9cb6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 -- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 msgr2=0x5616e9cb6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9cb6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 -- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 msgr2=0x5616e9c7a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9c7a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 -- 172.21.15.26:0/698907640 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e9a9bbd0 con 0x5616e9c7af00 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.582+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9c7b2e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd93c06fad0 tx=0x7fd93000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b5824212222545 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd921ffb640 1 -- 172.21.15.26:0/698907640 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930015110 con 0x5616e9c7af00 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd921ffb640 1 -- 172.21.15.26:0/698907640 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd930007560 con 0x5616e9c7af00 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd921ffb640 1 -- 172.21.15.26:0/698907640 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd930015b50 con 0x5616e9c7af00 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/698907640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 msgr2=0x5616e9c7b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9c7b2e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd93c06fad0 tx=0x7fd93000f000 comp rx=0 tx=0).stop 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/698907640 shutdown_connections 2024-04-21T09:23:05.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9cb6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9c7b2e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- 172.21.15.26:0/698907640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9c7a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/698907640 >> 172.21.15.26:0/698907640 conn(0x5616e9b5cb00 msgr2=0x5616e9cb3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/698907640 shutdown_connections 2024-04-21T09:23:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/698907640 wait complete. 2024-04-21T09:23:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- start start 2024-04-21T09:23:05.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 Processor -- start 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9c7af00 0x5616e9cb0650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9cb0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9cb6120 0x5616e9c758a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5616e9b7fd40 con 0x5616e9cb6120 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5616e9a7ceb0 con 0x5616e9cb18a0 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5616e9abd2a0 con 0x5616e9c7af00 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 10 client.0 _ll_register_callbacks cb 0x5616e9c60a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9cb6120 0x5616e9c758a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9cb6120 0x5616e9c758a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35718/0 (socket says 172.21.15.26:35718) 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 -- 172.21.15.26:0/3616150095 learned_addr learned my addr 172.21.15.26:0/3616150095 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:23:05.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd93bfff640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9c7af00 0x5616e9cb0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9cb0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 -- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9c7af00 msgr2=0x5616e9cb0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9c7af00 0x5616e9cb0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 -- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 msgr2=0x5616e9cb0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9cb0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 -- 172.21.15.26:0/3616150095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e9b08b30 con 0x5616e9cb6120 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9cb0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd940c32640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9cb6120 0x5616e9c758a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd934019510 tx=0x7fd9340196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30138add65b63124 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd91affd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd91affd640 1 -- 172.21.15.26:0/3616150095 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9340b2040 con 0x5616e9cb6120 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd91affd640 1 -- 172.21.15.26:0/3616150095 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fd9340b8440 con 0x5616e9cb6120 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5616e9a5c060 con 0x5616e9cb6120 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd91affd640 1 -- 172.21.15.26:0/3616150095 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd9340c8050 con 0x5616e9cb6120 2024-04-21T09:23:05.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 10 client.5199 fetch_fsmap learned FSMap version 8 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5616e9a61b70 con 0x5616e9cb6120 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd91affd640 1 -- 172.21.15.26:0/3616150095 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5616e9a5c060 con 0x5616e9cb6120 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd91affd640 1 -- 172.21.15.26:0/3616150095 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fd9340cb020 con 0x5616e9cb6120 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 10 client.5199 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 10 client.5199 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 20 client.5199 populate_metadata read hostname 'smithi026' 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9c76640 0x5616e9c76a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 4 client.5199 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616e9a9ae30 con 0x5616e9c76640 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.586+0000 7fd93bfff640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9c76640 0x5616e9c76a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd91affd640 10 client.5199 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd93bfff640 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9c76640 0x5616e9c76a20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f60615a23af3e90 server_cookie=10ee414c504958a2 in_seq=0 out_seq=0 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd91affd640 1 -- 172.21.15.26:0/3616150095 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5616e9a9ae30 con 0x5616e9c76640 2024-04-21T09:23:05.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd91affd640 10 client.5199 handle_command_reply: tid=0 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 client.5199 shutdown 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9cb6120 msgr2=0x5616e9c758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9cb6120 0x5616e9c758a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd934019510 tx=0x7fd9340196a0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 shutdown_connections 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9c76640 0x5616e9c76a20 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9cb6120 0x5616e9c758a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd91affd640 0 client.5199 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9cb0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 --2- 172.21.15.26:0/3616150095 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9c7af00 0x5616e9cb0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 >> 172.21.15.26:0/3616150095 conn(0x5616e9b5cb00 msgr2=0x5616e9cb59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 shutdown_connections 2024-04-21T09:23:05.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 1 -- 172.21.15.26:0/3616150095 wait complete. 2024-04-21T09:23:05.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.590+0000 7fd945817000 20 client.5199 trim_cache size 0 max 16384 2024-04-21T09:23:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.606+0000 7fd945817000 1 Processor -- start 2024-04-21T09:23:05.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.606+0000 7fd945817000 1 -- start start 2024-04-21T09:23:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d1faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9d20030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9d20570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1ff810 con 0x5616e9c7af00 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c1fece0 con 0x5616e9cb18a0 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c1ff140 con 0x5616e9cb6120 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d1faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d1faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35720/0 (socket says 172.21.15.26:35720) 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/700974035 learned_addr learned my addr 172.21.15.26:0/700974035 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/700974035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 msgr2=0x5616e9d20570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- 172.21.15.26:0/700974035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9d20570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/700974035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 msgr2=0x5616e9d20030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- 172.21.15.26:0/700974035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9d20030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/700974035 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616e9b445e0 con 0x5616e9c7af00 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- 172.21.15.26:0/700974035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d1faf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd92c084d30 tx=0x7fd92c084c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6472a28fb28e932 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd9217fa640 1 -- 172.21.15.26:0/700974035 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c054760 con 0x5616e9c7af00 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd9217fa640 1 -- 172.21.15.26:0/700974035 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0549c0 con 0x5616e9c7af00 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd9217fa640 1 -- 172.21.15.26:0/700974035 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c05ee10 con 0x5616e9c7af00 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- 172.21.15.26:0/700974035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 msgr2=0x5616e9d1faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- 172.21.15.26:0/700974035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d1faf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd92c084d30 tx=0x7fd92c084c00 comp rx=0 tx=0).stop 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- 172.21.15.26:0/700974035 shutdown_connections 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- 172.21.15.26:0/700974035 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9d20570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- 172.21.15.26:0/700974035 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9d20030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- 172.21.15.26:0/700974035 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d1faf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- 172.21.15.26:0/700974035 >> 172.21.15.26:0/700974035 conn(0x5616e9b5cb00 msgr2=0x5616e9c78a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- 172.21.15.26:0/700974035 shutdown_connections 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- 172.21.15.26:0/700974035 wait complete. 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- start start 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 Processor -- start 2024-04-21T09:23:05.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d23f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9d24460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9d24d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5616e9ac1970 con 0x5616e9c7af00 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5616e9a778f0 con 0x5616e9cb18a0 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5616e9ac6c90 con 0x5616e9cb6120 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 10 client.0 _ll_register_callbacks cb 0x7fd9340b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d23f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d23f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:35736/0 (socket says 172.21.15.26:35736) 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/70642694 learned_addr learned my addr 172.21.15.26:0/70642694 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd940c32640 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9d24d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 msgr2=0x5616e9d24d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9d24460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9d24d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 msgr2=0x5616e9d24460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9d24460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 -- 172.21.15.26:0/70642694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616e9a54ae0 con 0x5616e9c7af00 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd93bfff640 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d23f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0566e0 tx=0x7fd92c014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a97a61b49d88091 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd91affd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd91affd640 1 -- 172.21.15.26:0/70642694 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c079020 con 0x5616e9c7af00 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd91affd640 1 -- 172.21.15.26:0/70642694 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(38..38 src has 1..38) ==== 5766+0+0 (secure 0 0 0) 0x7fd92c076c40 con 0x5616e9c7af00 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd92c0549c0 con 0x5616e9c7af00 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd91affd640 1 -- 172.21.15.26:0/70642694 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd92c074050 con 0x5616e9c7af00 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 10 client.5205 fetch_fsmap learned FSMap version 8 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.610+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5616e9a57d80 con 0x5616e9c7af00 2024-04-21T09:23:05.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd91affd640 1 -- 172.21.15.26:0/70642694 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0549c0 con 0x5616e9c7af00 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd91affd640 1 -- 172.21.15.26:0/70642694 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fd92c05ee10 con 0x5616e9c7af00 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 10 client.5205 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 10 client.5205 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 20 client.5205 populate_metadata read hostname 'smithi026' 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9d25770 0x5616e9d25b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 4 client.5205 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d4a40035", "release": true, "await": true}] 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d4a40035", "release": true, "await": true}) -- 0x5616e9a600d0 con 0x5616e9d25770 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9d25770 0x5616e9d25b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd93b7fe640 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9d25770 0x5616e9d25b80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e163cfa33a1e2772 server_cookie=48ab12ba8c0a2a8c in_seq=0 out_seq=0 2024-04-21T09:23:05.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd91affd640 10 client.5205 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:23:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd91affd640 1 -- 172.21.15.26:0/70642694 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5616e9a600d0 con 0x5616e9d25770 2024-04-21T09:23:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd91affd640 10 client.5205 handle_command_reply: tid=0 2024-04-21T09:23:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 client.5205 shutdown 2024-04-21T09:23:05.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 msgr2=0x5616e9d23f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d23f20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd92c0566e0 tx=0x7fd92c014040 comp rx=0 tx=0).stop 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 shutdown_connections 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5616e9d25770 0x5616e9d25b80 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5616e9cb6120 0x5616e9d24d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5616e9cb18a0 0x5616e9d24460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd91affd640 0 client.5205 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 --2- 172.21.15.26:0/70642694 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5616e9c7af00 0x5616e9d23f20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 >> 172.21.15.26:0/70642694 conn(0x5616e9b5cb00 msgr2=0x5616e9c75840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 shutdown_connections 2024-04-21T09:23:05.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 1 -- 172.21.15.26:0/70642694 wait complete. 2024-04-21T09:23:05.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd945817000 20 client.5205 trim_cache size 0 max 16384 2024-04-21T09:23:05.622 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:23:05.622 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:23:05.622 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 32, 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "d4a40035": { 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 32, 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:23:05.623 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 80.0, 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:23:05.624 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-21T09:23:05.625 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:23:05.625 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:23:05.625 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:23:05.625 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:23:05.625 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:23:05.625 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:23:05.625 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd928068380 msgr2=0x7fd92806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd928068380 0x7fd92806a840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd930007fd0 tx=0x7fd930007900 comp rx=0 tx=0).stop 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 msgr2=0x7fd93c147eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c147eb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00c480 tx=0x7fd92c00c940 comp rx=0 tx=0).stop 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 shutdown_connections 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd93c151fa0 0x7fd93c143ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd93c151bc0 0x7fd93c143980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd928068380 0x7fd92806a840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 --2- 172.21.15.26:0/3943556393 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0734a0 0x7fd93c147eb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:23:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 >> 172.21.15.26:0/3943556393 conn(0x7fd93c0cbef0 msgr2=0x7fd93c14ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:23:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 shutdown_connections 2024-04-21T09:23:05.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:23:05.614+0000 7fd942695640 1 -- 172.21.15.26:0/3943556393 wait complete. 2024-04-21T09:23:05.630 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set_id: d4a40035, seconds elapsed: 21.8 2024-04-21T09:23:09.927 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 26% (83/309) Updating files: 27% (84/309) Updating files: 28% (87/309) Updating files: 29% (90/309) Updating files: 30% (93/309) Updating files: 31% (96/309) Updating files: 32% (99/309) Updating files: 33% (102/309) Updating files: 34% (106/309) Updating files: 35% (109/309) Updating files: 36% (112/309) Updating files: 36% (113/309) Updating files: 36% (114/309) Updating files: 37% (115/309) Updating files: 38% (118/309) Updating files: 39% (121/309) Updating files: 40% (124/309) Updating files: 41% (127/309) Updating files: 42% (130/309) Updating files: 43% (133/309) Updating files: 44% (136/309) Updating files: 45% (140/309) Updating files: 46% (143/309) Updating files: 47% (146/309) Updating files: 48% (149/309) Updating files: 49% (152/309) Updating files: 50% (155/309) Updating files: 51% (158/309) Updating files: 52% (161/309) Updating files: 53% (164/309) Updating files: 54% (167/309) Updating files: 55% (170/309) Updating files: 56% (174/309) Updating files: 57% (177/309) Updating files: 58% (180/309) Updating files: 59% (183/309) Updating files: 60% (186/309) Updating files: 61% (189/309) Updating files: 62% (192/309) Updating files: 63% (195/309) Updating files: 64% (198/309) Updating files: 65% (201/309) Updating files: 66% (204/309) Updating files: 67% (208/309) Updating files: 68% (211/309) Updating files: 69% (214/309) Updating files: 70% (217/309) Updating files: 71% (220/309) Updating files: 72% (223/309) Updating files: 73% (226/309) Updating files: 74% (229/309) Updating files: 75% (232/309) Updating files: 76% (235/309) Updating files: 77% (238/309) Updating files: 78% (242/309) Updating files: 79% (245/309) Updating files: 80% (248/309) Updating files: 81% (251/309) Updating files: 82% (254/309) Updating files: 83% (257/309) Updating files: 84% (260/309) Updating files: 85% (263/309) Updating files: 86% (266/309) Updating files: 87% (269/309) Updating files: 88% (272/309) Updating files: 89% (276/309) Updating files: 90% (279/309) Updating files: 91% (282/309) Updating files: 92% (285/309) Updating files: 93% (288/309) Updating files: 94% (291/309) Updating files: 95% (294/309) Updating files: 96% (297/309) Updating files: 96% (299/309) Updating files: 97% (300/309) Updating files: 98% (303/309) Updating files: 99% (306/309) Updating files: 100% (309/309) Updating files: 100% (309/309), done. 2024-04-21T09:23:10.344 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 8de9501df27 0.81 2024-04-21T09:23:10.353 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.81 2024-04-21T09:23:10.473 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 82 -eq 48 ] 2024-04-21T09:23:10.474 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.82 2024-04-21T09:23:10.474 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.82 2024-04-21T09:23:10.474 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.82 2024-04-21T09:23:10.474 INFO:tasks.workunit.client.0.smithi026.stdout:v0.82 2024-04-21T09:23:20.917 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:23:20.920 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:23:23.153 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 27% (57/204) Updating files: 28% (58/204) Updating files: 29% (60/204) Updating files: 30% (62/204) Updating files: 31% (64/204) Updating files: 32% (66/204) Updating files: 33% (68/204) Updating files: 34% (70/204) Updating files: 35% (72/204) Updating files: 36% (74/204) Updating files: 37% (76/204) Updating files: 38% (78/204) Updating files: 39% (80/204) Updating files: 40% (82/204) Updating files: 41% (84/204) Updating files: 42% (86/204) Updating files: 43% (88/204) Updating files: 44% (90/204) Updating files: 45% (92/204) Updating files: 46% (94/204) Updating files: 47% (96/204) Updating files: 48% (98/204) Updating files: 49% (100/204) Updating files: 50% (102/204) Updating files: 51% (105/204) Updating files: 52% (107/204) Updating files: 53% (109/204) Updating files: 54% (111/204) Updating files: 55% (113/204) Updating files: 56% (115/204) Updating files: 57% (117/204) Updating files: 58% (119/204) Updating files: 59% (121/204) Updating files: 60% (123/204) Updating files: 61% (125/204) Updating files: 62% (127/204) Updating files: 63% (129/204) Updating files: 64% (131/204) Updating files: 65% (133/204) Updating files: 66% (135/204) Updating files: 67% (137/204) Updating files: 68% (139/204) Updating files: 69% (141/204) Updating files: 70% (143/204) Updating files: 71% (145/204) Updating files: 71% (146/204) Updating files: 72% (147/204) Updating files: 73% (149/204) Updating files: 74% (151/204) Updating files: 75% (153/204) Updating files: 76% (156/204) Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2024-04-21T09:23:23.654 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 14085f42ddd 0.82 2024-04-21T09:23:23.663 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.82 2024-04-21T09:23:23.740 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 83 -eq 48 ] 2024-04-21T09:23:23.741 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.83 2024-04-21T09:23:23.741 INFO:tasks.workunit.client.0.smithi026.stdout:v0.83 2024-04-21T09:23:23.741 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.83 2024-04-21T09:23:23.741 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.83 2024-04-21T09:23:30.805 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 22% (48/218) Updating files: 23% (51/218) Updating files: 24% (53/218) Updating files: 25% (55/218) Updating files: 26% (57/218) Updating files: 27% (59/218) Updating files: 28% (62/218) Updating files: 29% (64/218) Updating files: 30% (66/218) Updating files: 31% (68/218) Updating files: 32% (70/218) Updating files: 33% (72/218) Updating files: 34% (75/218) Updating files: 35% (77/218) Updating files: 36% (79/218) Updating files: 37% (81/218) Updating files: 38% (83/218) Updating files: 39% (86/218) Updating files: 40% (88/218) Updating files: 41% (90/218) Updating files: 42% (92/218) Updating files: 43% (94/218) Updating files: 44% (96/218) Updating files: 45% (99/218) Updating files: 46% (101/218) Updating files: 47% (103/218) Updating files: 47% (104/218) Updating files: 48% (105/218) Updating files: 49% (107/218) Updating files: 50% (109/218) Updating files: 51% (112/218) Updating files: 52% (114/218) Updating files: 53% (116/218) Updating files: 54% (118/218) Updating files: 55% (120/218) Updating files: 56% (123/218) Updating files: 57% (125/218) Updating files: 58% (127/218) Updating files: 59% (129/218) Updating files: 60% (131/218) Updating files: 61% (133/218) Updating files: 62% (136/218) Updating files: 63% (138/218) Updating files: 64% (140/218) Updating files: 65% (142/218) Updating files: 66% (144/218) Updating files: 67% (147/218) Updating files: 68% (149/218) Updating files: 69% (151/218) Updating files: 70% (153/218) Updating files: 71% (155/218) Updating files: 71% (156/218) Updating files: 72% (157/218) Updating files: 73% (160/218) Updating files: 74% (162/218) Updating files: 75% (164/218) Updating files: 76% (166/218) Updating files: 77% (168/218) Updating files: 78% (171/218) Updating files: 79% (173/218) Updating files: 80% (175/218) Updating files: 81% (177/218) Updating files: 82% (179/218) Updating files: 83% (181/218) Updating files: 84% (184/218) Updating files: 85% (186/218) Updating files: 86% (188/218) Updating files: 87% (190/218) Updating files: 88% (192/218) Updating files: 89% (195/218) Updating files: 90% (197/218) Updating files: 91% (199/218) Updating files: 92% (201/218) Updating files: 93% (203/218) Updating files: 94% (205/218) Updating files: 95% (208/218) Updating files: 96% (210/218) Updating files: 97% (212/218) Updating files: 98% (214/218) Updating files: 99% (216/218) Updating files: 100% (218/218) Updating files: 100% (218/218), done. 2024-04-21T09:23:31.209 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 78ff1f0a5df 0.83 2024-04-21T09:23:31.216 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.83 2024-04-21T09:23:31.335 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 84 -eq 48 ] 2024-04-21T09:23:31.335 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.84 2024-04-21T09:23:31.335 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.84 2024-04-21T09:23:31.336 INFO:tasks.workunit.client.0.smithi026.stdout:v0.84 2024-04-21T09:23:31.336 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.84 2024-04-21T09:23:41.015 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 16% (57/356) Updating files: 17% (61/356) Updating files: 18% (65/356) Updating files: 19% (68/356) Updating files: 20% (72/356) Updating files: 21% (75/356) Updating files: 22% (79/356) Updating files: 23% (82/356) Updating files: 24% (86/356) Updating files: 25% (89/356) Updating files: 26% (93/356) Updating files: 27% (97/356) Updating files: 28% (100/356) Updating files: 28% (102/356) Updating files: 29% (104/356) Updating files: 30% (107/356) Updating files: 31% (111/356) Updating files: 32% (114/356) Updating files: 33% (118/356) Updating files: 34% (122/356) Updating files: 35% (125/356) Updating files: 36% (129/356) Updating files: 37% (132/356) Updating files: 38% (136/356) Updating files: 39% (139/356) Updating files: 40% (143/356) Updating files: 41% (146/356) Updating files: 42% (150/356) Updating files: 42% (151/356) Updating files: 43% (154/356) Updating files: 44% (157/356) Updating files: 45% (161/356) Updating files: 46% (164/356) Updating files: 47% (168/356) Updating files: 48% (171/356) Updating files: 49% (175/356) Updating files: 50% (178/356) Updating files: 51% (182/356) Updating files: 52% (186/356) Updating files: 53% (189/356) Updating files: 54% (193/356) Updating files: 55% (196/356) Updating files: 56% (200/356) Updating files: 57% (203/356) Updating files: 58% (207/356) Updating files: 59% (211/356) Updating files: 60% (214/356) Updating files: 61% (218/356) Updating files: 62% (221/356) Updating files: 63% (225/356) Updating files: 64% (228/356) Updating files: 65% (232/356) Updating files: 66% (235/356) Updating files: 67% (239/356) Updating files: 68% (243/356) Updating files: 69% (246/356) Updating files: 70% (250/356) Updating files: 71% (253/356) Updating files: 72% (257/356) Updating files: 73% (260/356) Updating files: 74% (264/356) Updating files: 75% (267/356) Updating files: 76% (271/356) Updating files: 77% (275/356) Updating files: 78% (278/356) Updating files: 79% (282/356) Updating files: 80% (285/356) Updating files: 81% (289/356) Updating files: 82% (292/356) Updating files: 83% (296/356) Updating files: 84% (300/356) Updating files: 85% (303/356) Updating files: 85% (306/356) Updating files: 86% (307/356) Updating files: 87% (310/356) Updating files: 88% (314/356) Updating files: 89% (317/356) Updating files: 90% (321/356) Updating files: 91% (324/356) Updating files: 92% (328/356) Updating files: 93% (332/356) Updating files: 94% (335/356) Updating files: 95% (339/356) Updating files: 96% (342/356) Updating files: 97% (346/356) Updating files: 97% (348/356) Updating files: 98% (349/356) Updating files: 99% (353/356) Updating files: 100% (356/356) Updating files: 100% (356/356), done. 2024-04-21T09:23:41.556 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 8336f81c5c7 0.84 2024-04-21T09:23:41.566 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.84 2024-04-21T09:23:41.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 85 -eq 48 ] 2024-04-21T09:23:41.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.85 2024-04-21T09:23:41.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.85 2024-04-21T09:23:41.696 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.85 2024-04-21T09:23:41.697 INFO:tasks.workunit.client.0.smithi026.stdout:v0.85 2024-04-21T09:23:49.311 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 27% (68/243) Updating files: 28% (69/243) Updating files: 29% (71/243) Updating files: 30% (73/243) Updating files: 31% (76/243) Updating files: 32% (78/243) Updating files: 33% (81/243) Updating files: 34% (83/243) Updating files: 35% (86/243) Updating files: 36% (88/243) Updating files: 37% (90/243) Updating files: 38% (93/243) Updating files: 39% (95/243) Updating files: 40% (98/243) Updating files: 41% (100/243) Updating files: 42% (103/243) Updating files: 43% (105/243) Updating files: 44% (107/243) Updating files: 45% (110/243) Updating files: 46% (112/243) Updating files: 47% (115/243) Updating files: 48% (117/243) Updating files: 49% (120/243) Updating files: 50% (122/243) Updating files: 51% (124/243) Updating files: 52% (127/243) Updating files: 53% (129/243) Updating files: 53% (130/243) Updating files: 54% (132/243) Updating files: 55% (134/243) Updating files: 56% (137/243) Updating files: 57% (139/243) Updating files: 58% (141/243) Updating files: 59% (144/243) Updating files: 60% (146/243) Updating files: 61% (149/243) Updating files: 62% (151/243) Updating files: 63% (154/243) Updating files: 64% (156/243) Updating files: 65% (158/243) Updating files: 66% (161/243) Updating files: 67% (163/243) Updating files: 68% (166/243) Updating files: 69% (168/243) Updating files: 70% (171/243) Updating files: 71% (173/243) Updating files: 72% (175/243) Updating files: 73% (178/243) Updating files: 74% (180/243) Updating files: 75% (183/243) Updating files: 76% (185/243) Updating files: 77% (188/243) Updating files: 78% (190/243) Updating files: 79% (192/243) Updating files: 80% (195/243) Updating files: 81% (197/243) Updating files: 82% (200/243) Updating files: 83% (202/243) Updating files: 84% (205/243) Updating files: 85% (207/243) Updating files: 86% (209/243) Updating files: 87% (212/243) Updating files: 88% (214/243) Updating files: 89% (217/243) Updating files: 90% (219/243) Updating files: 91% (222/243) Updating files: 92% (224/243) Updating files: 93% (226/243) Updating files: 93% (228/243) Updating files: 94% (229/243) Updating files: 95% (231/243) Updating files: 96% (234/243) Updating files: 97% (236/243) Updating files: 98% (239/243) Updating files: 99% (241/243) Updating files: 100% (243/243) Updating files: 100% (243/243), done. 2024-04-21T09:23:49.610 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at a0c22842db9 0.85 2024-04-21T09:23:49.619 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.85 2024-04-21T09:23:49.748 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 86 -eq 48 ] 2024-04-21T09:23:49.748 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.86 2024-04-21T09:23:49.749 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.86 2024-04-21T09:23:49.749 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.86 2024-04-21T09:23:49.749 INFO:tasks.workunit.client.0.smithi026.stdout:v0.86 2024-04-21T09:23:51.305 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:23:51.308 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:24:00.941 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 12% (54/447) Updating files: 13% (59/447) Updating files: 14% (63/447) Updating files: 15% (68/447) Updating files: 16% (72/447) Updating files: 17% (76/447) Updating files: 18% (81/447) Updating files: 19% (85/447) Updating files: 20% (90/447) Updating files: 21% (94/447) Updating files: 22% (99/447) Updating files: 23% (103/447) Updating files: 24% (108/447) Updating files: 25% (112/447) Updating files: 26% (117/447) Updating files: 27% (121/447) Updating files: 28% (126/447) Updating files: 29% (130/447) Updating files: 30% (135/447) Updating files: 31% (139/447) Updating files: 32% (144/447) Updating files: 33% (148/447) Updating files: 34% (152/447) Updating files: 35% (157/447) Updating files: 36% (161/447) Updating files: 36% (164/447) Updating files: 37% (166/447) Updating files: 38% (170/447) Updating files: 39% (175/447) Updating files: 40% (179/447) Updating files: 41% (184/447) Updating files: 42% (188/447) Updating files: 43% (193/447) Updating files: 44% (197/447) Updating files: 45% (202/447) Updating files: 46% (206/447) Updating files: 47% (211/447) Updating files: 47% (213/447) Updating files: 48% (215/447) Updating files: 49% (220/447) Updating files: 50% (224/447) Updating files: 51% (228/447) Updating files: 52% (233/447) Updating files: 53% (237/447) Updating files: 54% (242/447) Updating files: 55% (246/447) Updating files: 56% (251/447) Updating files: 57% (255/447) Updating files: 58% (260/447) Updating files: 59% (264/447) Updating files: 60% (269/447) Updating files: 61% (273/447) Updating files: 62% (278/447) Updating files: 63% (282/447) Updating files: 64% (287/447) Updating files: 65% (291/447) Updating files: 66% (296/447) Updating files: 67% (300/447) Updating files: 68% (304/447) Updating files: 68% (307/447) Updating files: 69% (309/447) Updating files: 70% (313/447) Updating files: 71% (318/447) Updating files: 72% (322/447) Updating files: 73% (327/447) Updating files: 74% (331/447) Updating files: 75% (336/447) Updating files: 76% (340/447) Updating files: 77% (345/447) Updating files: 78% (349/447) Updating files: 79% (354/447) Updating files: 80% (358/447) Updating files: 81% (363/447) Updating files: 82% (367/447) Updating files: 82% (368/447) Updating files: 83% (372/447) Updating files: 84% (376/447) Updating files: 85% (380/447) Updating files: 86% (385/447) Updating files: 87% (389/447) Updating files: 88% (394/447) Updating files: 89% (398/447) Updating files: 90% (403/447) Updating files: 91% (407/447) Updating files: 92% (412/447) Updating files: 93% (416/447) Updating files: 94% (421/447) Updating files: 94% (422/447) Updating files: 95% (425/447) Updating files: 96% (430/447) Updating files: 97% (434/447) Updating files: 98% (439/447) Updating files: 99% (443/447) Updating files: 100% (447/447) Updating files: 100% (447/447), done. 2024-04-21T09:24:01.276 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 97dcc0539df 0.86 2024-04-21T09:24:01.286 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.86 2024-04-21T09:24:01.437 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 87 -eq 48 ] 2024-04-21T09:24:01.437 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.87 2024-04-21T09:24:01.437 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.87 2024-04-21T09:24:01.438 INFO:tasks.workunit.client.0.smithi026.stdout:v0.87 2024-04-21T09:24:01.438 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.87 2024-04-21T09:24:05.690 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 76% (45/59) Updating files: 77% (46/59) Updating files: 79% (47/59) Updating files: 81% (48/59) Updating files: 83% (49/59) Updating files: 84% (50/59) Updating files: 86% (51/59) Updating files: 88% (52/59) Updating files: 89% (53/59) Updating files: 91% (54/59) Updating files: 93% (55/59) Updating files: 94% (56/59) Updating files: 96% (57/59) Updating files: 98% (58/59) Updating files: 100% (59/59) Updating files: 100% (59/59), done. 2024-04-21T09:24:05.880 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at c51c8f9d80f 0.87 2024-04-21T09:24:05.884 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.87 2024-04-21T09:24:06.089 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 88 -eq 48 ] 2024-04-21T09:24:06.090 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.88 2024-04-21T09:24:06.090 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.88 2024-04-21T09:24:06.090 INFO:tasks.workunit.client.0.smithi026.stdout:v0.88 2024-04-21T09:24:06.090 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.88 2024-04-21T09:24:15.220 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 20% (69/335) Updating files: 21% (71/335) Updating files: 22% (74/335) Updating files: 23% (78/335) Updating files: 24% (81/335) Updating files: 25% (84/335) Updating files: 26% (88/335) Updating files: 27% (91/335) Updating files: 28% (94/335) Updating files: 29% (98/335) Updating files: 30% (101/335) Updating files: 31% (104/335) Updating files: 32% (108/335) Updating files: 33% (111/335) Updating files: 34% (114/335) Updating files: 35% (118/335) Updating files: 36% (121/335) Updating files: 37% (124/335) Updating files: 38% (128/335) Updating files: 39% (131/335) Updating files: 40% (134/335) Updating files: 41% (138/335) Updating files: 42% (141/335) Updating files: 43% (145/335) Updating files: 44% (148/335) Updating files: 45% (151/335) Updating files: 46% (155/335) Updating files: 47% (158/335) Updating files: 48% (161/335) Updating files: 48% (162/335) Updating files: 49% (165/335) Updating files: 50% (168/335) Updating files: 51% (171/335) Updating files: 52% (175/335) Updating files: 53% (178/335) Updating files: 54% (181/335) Updating files: 55% (185/335) Updating files: 56% (188/335) Updating files: 57% (191/335) Updating files: 58% (195/335) Updating files: 59% (198/335) Updating files: 60% (201/335) Updating files: 61% (205/335) Updating files: 62% (208/335) Updating files: 63% (212/335) Updating files: 64% (215/335) Updating files: 65% (218/335) Updating files: 66% (222/335) Updating files: 67% (225/335) Updating files: 68% (228/335) Updating files: 69% (232/335) Updating files: 70% (235/335) Updating files: 71% (238/335) Updating files: 72% (242/335) Updating files: 73% (245/335) Updating files: 74% (248/335) Updating files: 75% (252/335) Updating files: 76% (255/335) Updating files: 77% (258/335) Updating files: 78% (262/335) Updating files: 79% (265/335) Updating files: 80% (268/335) Updating files: 81% (272/335) Updating files: 82% (275/335) Updating files: 82% (277/335) Updating files: 83% (279/335) Updating files: 84% (282/335) Updating files: 85% (285/335) Updating files: 86% (289/335) Updating files: 87% (292/335) Updating files: 88% (295/335) Updating files: 89% (299/335) Updating files: 90% (302/335) Updating files: 91% (305/335) Updating files: 92% (309/335) Updating files: 93% (312/335) Updating files: 94% (315/335) Updating files: 95% (319/335) Updating files: 96% (322/335) Updating files: 97% (325/335) Updating files: 98% (329/335) Updating files: 99% (332/335) Updating files: 99% (333/335) Updating files: 100% (335/335) Updating files: 100% (335/335), done. 2024-04-21T09:24:15.525 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 4be687bf448 0.88 2024-04-21T09:24:15.534 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.88 2024-04-21T09:24:15.661 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 89 -eq 48 ] 2024-04-21T09:24:15.661 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.89 2024-04-21T09:24:15.661 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.89 2024-04-21T09:24:15.661 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.89 2024-04-21T09:24:15.661 INFO:tasks.workunit.client.0.smithi026.stdout:v0.89 2024-04-21T09:24:21.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:24:21.354 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:24:22.579 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 26% (53/197) Updating files: 27% (54/197) Updating files: 28% (56/197) Updating files: 29% (58/197) Updating files: 30% (60/197) Updating files: 31% (62/197) Updating files: 32% (64/197) Updating files: 33% (66/197) Updating files: 34% (67/197) Updating files: 35% (69/197) Updating files: 36% (71/197) Updating files: 37% (73/197) Updating files: 38% (75/197) Updating files: 39% (77/197) Updating files: 40% (79/197) Updating files: 41% (81/197) Updating files: 42% (83/197) Updating files: 43% (85/197) Updating files: 44% (87/197) Updating files: 45% (89/197) Updating files: 46% (91/197) Updating files: 47% (93/197) Updating files: 48% (95/197) Updating files: 49% (97/197) Updating files: 50% (99/197) Updating files: 51% (101/197) Updating files: 52% (103/197) Updating files: 53% (105/197) Updating files: 54% (107/197) Updating files: 55% (109/197) Updating files: 56% (111/197) Updating files: 57% (113/197) Updating files: 58% (115/197) Updating files: 59% (117/197) Updating files: 60% (119/197) Updating files: 61% (121/197) Updating files: 62% (123/197) Updating files: 63% (125/197) Updating files: 64% (127/197) Updating files: 65% (129/197) Updating files: 66% (131/197) Updating files: 67% (132/197) Updating files: 68% (134/197) Updating files: 69% (136/197) Updating files: 70% (138/197) Updating files: 71% (140/197) Updating files: 72% (142/197) Updating files: 73% (144/197) Updating files: 74% (146/197) Updating files: 75% (148/197) Updating files: 76% (150/197) Updating files: 77% (152/197) Updating files: 78% (154/197) Updating files: 79% (156/197) Updating files: 80% (158/197) Updating files: 81% (160/197) Updating files: 82% (162/197) Updating files: 83% (164/197) Updating files: 84% (166/197) Updating files: 85% (168/197) Updating files: 86% (170/197) Updating files: 87% (172/197) Updating files: 88% (174/197) Updating files: 89% (176/197) Updating files: 90% (178/197) Updating files: 91% (180/197) Updating files: 92% (182/197) Updating files: 93% (184/197) Updating files: 94% (186/197) Updating files: 95% (188/197) Updating files: 96% (190/197) Updating files: 97% (192/197) Updating files: 98% (194/197) Updating files: 99% (196/197) Updating files: 100% (197/197) Updating files: 100% (197/197), done. 2024-04-21T09:24:22.879 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 68fdc0f68e6 0.89 2024-04-21T09:24:22.887 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.89 2024-04-21T09:24:23.024 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 90 -eq 48 ] 2024-04-21T09:24:23.024 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.90 2024-04-21T09:24:23.024 INFO:tasks.workunit.client.0.smithi026.stdout:v0.90 2024-04-21T09:24:23.025 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo v0.90 2024-04-21T09:24:23.025 INFO:tasks.workunit.client.0.smithi026.stderr:+ git reset --hard v0.90 2024-04-21T09:24:30.579 INFO:tasks.workunit.client.0.smithi026.stderr:Updating files: 22% (59/265) Updating files: 23% (61/265) Updating files: 24% (64/265) Updating files: 25% (67/265) Updating files: 26% (69/265) Updating files: 27% (72/265) Updating files: 28% (75/265) Updating files: 29% (77/265) Updating files: 30% (80/265) Updating files: 31% (83/265) Updating files: 32% (85/265) Updating files: 33% (88/265) Updating files: 34% (91/265) Updating files: 35% (93/265) Updating files: 36% (96/265) Updating files: 37% (99/265) Updating files: 38% (101/265) Updating files: 39% (104/265) Updating files: 40% (106/265) Updating files: 40% (107/265) Updating files: 41% (109/265) Updating files: 42% (112/265) Updating files: 43% (114/265) Updating files: 44% (117/265) Updating files: 45% (120/265) Updating files: 46% (122/265) Updating files: 47% (125/265) Updating files: 48% (128/265) Updating files: 49% (130/265) Updating files: 50% (133/265) Updating files: 51% (136/265) Updating files: 52% (138/265) Updating files: 53% (141/265) Updating files: 54% (144/265) Updating files: 55% (146/265) Updating files: 56% (149/265) Updating files: 57% (152/265) Updating files: 58% (154/265) Updating files: 59% (157/265) Updating files: 60% (159/265) Updating files: 61% (162/265) Updating files: 62% (165/265) Updating files: 63% (167/265) Updating files: 64% (170/265) Updating files: 65% (173/265) Updating files: 66% (175/265) Updating files: 67% (178/265) Updating files: 68% (181/265) Updating files: 69% (183/265) Updating files: 70% (186/265) Updating files: 71% (189/265) Updating files: 72% (191/265) Updating files: 73% (194/265) Updating files: 74% (197/265) Updating files: 75% (199/265) Updating files: 76% (202/265) Updating files: 77% (205/265) Updating files: 78% (207/265) Updating files: 79% (210/265) Updating files: 80% (212/265) Updating files: 81% (215/265) Updating files: 82% (218/265) Updating files: 83% (220/265) Updating files: 84% (223/265) Updating files: 85% (226/265) Updating files: 86% (228/265) Updating files: 87% (231/265) Updating files: 88% (234/265) Updating files: 89% (236/265) Updating files: 89% (237/265) Updating files: 90% (239/265) Updating files: 91% (242/265) Updating files: 92% (244/265) Updating files: 93% (247/265) Updating files: 94% (250/265) Updating files: 95% (252/265) Updating files: 96% (255/265) Updating files: 97% (258/265) Updating files: 98% (260/265) Updating files: 99% (263/265) Updating files: 100% (265/265) Updating files: 100% (265/265), done. 2024-04-21T09:24:30.898 INFO:tasks.workunit.client.0.smithi026.stdout:HEAD is now at 08bd1e1eee3 0.90 2024-04-21T09:24:30.905 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/v0.90 2024-04-21T09:24:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 1 -eq 48 ] 2024-04-21T09:24:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.1 2024-04-21T09:24:31.030 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.1 2024-04-21T09:24:31.031 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.1 2024-04-21T09:24:31.031 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.1 2024-04-21T09:24:31.313 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:35.427 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:35.428 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.2 2024-04-21T09:24:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 2 -eq 48 ] 2024-04-21T09:24:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.2 2024-04-21T09:24:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.2 2024-04-21T09:24:35.429 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.2 2024-04-21T09:24:35.435 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:37.703 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:37.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 3 -eq 48 ] 2024-04-21T09:24:37.704 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.3 2024-04-21T09:24:37.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.3 2024-04-21T09:24:37.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.3 2024-04-21T09:24:37.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.3 2024-04-21T09:24:37.709 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:39.738 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:39.739 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 4 -eq 48 ] 2024-04-21T09:24:39.740 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.4 2024-04-21T09:24:39.740 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.4 2024-04-21T09:24:39.740 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.4 2024-04-21T09:24:39.740 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.4 2024-04-21T09:24:39.746 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:41.901 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:41.906 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 5 -eq 48 ] 2024-04-21T09:24:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.5 2024-04-21T09:24:41.906 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.5 2024-04-21T09:24:41.907 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.5 2024-04-21T09:24:41.907 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.5 2024-04-21T09:24:41.912 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:44.452 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:44.453 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 6 -eq 48 ] 2024-04-21T09:24:44.453 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.6 2024-04-21T09:24:44.453 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.6 2024-04-21T09:24:44.454 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.6 2024-04-21T09:24:44.454 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.6 2024-04-21T09:24:44.459 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:46.419 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:46.420 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 7 -eq 48 ] 2024-04-21T09:24:46.421 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.7 2024-04-21T09:24:46.421 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.7 2024-04-21T09:24:46.421 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.7 2024-04-21T09:24:46.421 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.7 2024-04-21T09:24:46.426 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:48.340 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:48.341 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 8 -eq 48 ] 2024-04-21T09:24:48.342 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.8 2024-04-21T09:24:48.342 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.8 2024-04-21T09:24:48.342 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.8 2024-04-21T09:24:48.342 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.8 2024-04-21T09:24:48.349 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:49.987 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:49.988 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 9 -eq 48 ] 2024-04-21T09:24:49.988 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.9 2024-04-21T09:24:49.988 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.9 2024-04-21T09:24:49.988 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.9 2024-04-21T09:24:49.988 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.9 2024-04-21T09:24:49.993 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:51.418 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:24:51.421 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:24:52.038 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:52.039 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 10 -eq 48 ] 2024-04-21T09:24:52.039 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.10 2024-04-21T09:24:52.039 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.10 2024-04-21T09:24:52.039 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.10 2024-04-21T09:24:52.040 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.10 2024-04-21T09:24:52.045 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:54.617 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:54.618 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 11 -eq 48 ] 2024-04-21T09:24:54.618 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.11 2024-04-21T09:24:54.619 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.11 2024-04-21T09:24:54.619 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.11 2024-04-21T09:24:54.619 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.11 2024-04-21T09:24:54.624 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:56.762 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:56.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 12 -eq 48 ] 2024-04-21T09:24:56.764 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.12 2024-04-21T09:24:56.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.12 2024-04-21T09:24:56.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.12 2024-04-21T09:24:56.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.12 2024-04-21T09:24:56.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:24:58.946 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:24:58.947 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 13 -eq 48 ] 2024-04-21T09:24:58.948 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.13 2024-04-21T09:24:58.948 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.13 2024-04-21T09:24:58.948 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.13 2024-04-21T09:24:58.948 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.13 2024-04-21T09:24:58.954 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:01.115 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:01.115 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 14 -eq 48 ] 2024-04-21T09:25:01.115 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.14 2024-04-21T09:25:01.116 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.14 2024-04-21T09:25:01.116 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.14 2024-04-21T09:25:01.116 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.14 2024-04-21T09:25:01.121 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:03.730 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 15 -eq 48 ] 2024-04-21T09:25:03.731 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.15 2024-04-21T09:25:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.15 2024-04-21T09:25:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.15 2024-04-21T09:25:03.731 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.15 2024-04-21T09:25:03.736 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:06.243 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:06.244 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 16 -eq 48 ] 2024-04-21T09:25:06.244 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.16 2024-04-21T09:25:06.244 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.16 2024-04-21T09:25:06.244 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.16 2024-04-21T09:25:06.245 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.16 2024-04-21T09:25:06.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:08.640 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:08.640 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 17 -eq 48 ] 2024-04-21T09:25:08.641 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.17 2024-04-21T09:25:08.641 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.17 2024-04-21T09:25:08.641 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.17 2024-04-21T09:25:08.641 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.17 2024-04-21T09:25:08.647 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:11.084 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:11.085 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 18 -eq 48 ] 2024-04-21T09:25:11.085 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.18 2024-04-21T09:25:11.085 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.18 2024-04-21T09:25:11.085 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.18 2024-04-21T09:25:11.085 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.18 2024-04-21T09:25:11.091 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:13.701 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:13.701 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 19 -eq 48 ] 2024-04-21T09:25:13.701 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.19 2024-04-21T09:25:13.702 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.19 2024-04-21T09:25:13.702 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.19 2024-04-21T09:25:13.702 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.19 2024-04-21T09:25:13.708 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:16.410 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:16.411 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 20 -eq 48 ] 2024-04-21T09:25:16.411 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.20 2024-04-21T09:25:16.411 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.20 2024-04-21T09:25:16.411 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.20 2024-04-21T09:25:16.411 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.20 2024-04-21T09:25:16.417 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:19.206 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:19.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 21 -eq 48 ] 2024-04-21T09:25:19.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.21 2024-04-21T09:25:19.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.21 2024-04-21T09:25:19.208 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.21 2024-04-21T09:25:19.208 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.21 2024-04-21T09:25:19.215 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:21.471 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:25:21.474 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:25:21.959 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 22 -eq 48 ] 2024-04-21T09:25:21.960 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.22 2024-04-21T09:25:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.22 2024-04-21T09:25:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.22 2024-04-21T09:25:21.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.22 2024-04-21T09:25:21.965 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:24.385 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 23 -eq 48 ] 2024-04-21T09:25:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.23 2024-04-21T09:25:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.23 2024-04-21T09:25:24.386 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.23 2024-04-21T09:25:24.386 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.23 2024-04-21T09:25:24.387 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:27.261 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:27.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 24 -eq 48 ] 2024-04-21T09:25:27.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.24 2024-04-21T09:25:27.263 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.24 2024-04-21T09:25:27.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.24 2024-04-21T09:25:27.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.24 2024-04-21T09:25:27.269 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:30.180 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:30.181 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 25 -eq 48 ] 2024-04-21T09:25:30.181 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.25 2024-04-21T09:25:30.181 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.25 2024-04-21T09:25:30.181 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.25 2024-04-21T09:25:30.181 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.25 2024-04-21T09:25:30.186 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:32.047 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:32.048 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 26 -eq 48 ] 2024-04-21T09:25:32.048 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.26 2024-04-21T09:25:32.048 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.26 2024-04-21T09:25:32.048 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.26 2024-04-21T09:25:32.048 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.26 2024-04-21T09:25:32.055 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:34.333 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:34.334 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.27 2024-04-21T09:25:34.335 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 27 -eq 48 ] 2024-04-21T09:25:34.335 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.27 2024-04-21T09:25:34.335 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.27 2024-04-21T09:25:34.335 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.27 2024-04-21T09:25:34.342 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:36.628 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:36.629 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 28 -eq 48 ] 2024-04-21T09:25:36.629 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.28 2024-04-21T09:25:36.629 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.28 2024-04-21T09:25:36.629 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.28 2024-04-21T09:25:36.629 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.28 2024-04-21T09:25:36.634 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:38.511 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:38.511 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.29 2024-04-21T09:25:38.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 29 -eq 48 ] 2024-04-21T09:25:38.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.29 2024-04-21T09:25:38.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.29 2024-04-21T09:25:38.512 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.29 2024-04-21T09:25:38.518 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:40.547 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:40.548 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 30 -eq 48 ] 2024-04-21T09:25:40.548 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.30 2024-04-21T09:25:40.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.30 2024-04-21T09:25:40.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.30 2024-04-21T09:25:40.549 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.30 2024-04-21T09:25:40.555 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:42.690 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:42.691 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 31 -eq 48 ] 2024-04-21T09:25:42.691 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.31 2024-04-21T09:25:42.692 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.31 2024-04-21T09:25:42.692 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.31 2024-04-21T09:25:42.692 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.31 2024-04-21T09:25:42.697 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:45.124 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:45.124 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 32 -eq 48 ] 2024-04-21T09:25:45.125 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.32 2024-04-21T09:25:45.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.32 2024-04-21T09:25:45.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.32 2024-04-21T09:25:45.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.32 2024-04-21T09:25:45.130 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:47.145 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:47.145 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 33 -eq 48 ] 2024-04-21T09:25:47.145 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.33 2024-04-21T09:25:47.146 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.33 2024-04-21T09:25:47.146 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.33 2024-04-21T09:25:47.146 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.33 2024-04-21T09:25:47.151 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:49.447 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:49.448 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 34 -eq 48 ] 2024-04-21T09:25:49.448 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.34 2024-04-21T09:25:49.448 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.34 2024-04-21T09:25:49.449 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.34 2024-04-21T09:25:49.449 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.34 2024-04-21T09:25:49.454 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:51.483 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:51.484 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 35 -eq 48 ] 2024-04-21T09:25:51.484 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.35 2024-04-21T09:25:51.484 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.35 2024-04-21T09:25:51.485 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.35 2024-04-21T09:25:51.485 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.35 2024-04-21T09:25:51.490 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:51.519 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:25:51.522 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:25:53.561 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:53.562 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.36 2024-04-21T09:25:53.562 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 36 -eq 48 ] 2024-04-21T09:25:53.562 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.36 2024-04-21T09:25:53.562 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.36 2024-04-21T09:25:53.562 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.36 2024-04-21T09:25:53.568 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:56.052 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:56.053 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 37 -eq 48 ] 2024-04-21T09:25:56.053 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.37 2024-04-21T09:25:56.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.37 2024-04-21T09:25:56.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.37 2024-04-21T09:25:56.054 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.37 2024-04-21T09:25:56.060 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:25:58.580 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:25:58.581 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 38 -eq 48 ] 2024-04-21T09:25:58.581 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.38 2024-04-21T09:25:58.581 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.38 2024-04-21T09:25:58.581 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.38 2024-04-21T09:25:58.582 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.38 2024-04-21T09:25:58.589 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:01.131 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:01.132 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.39 2024-04-21T09:26:01.132 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 39 -eq 48 ] 2024-04-21T09:26:01.132 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.39 2024-04-21T09:26:01.132 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.39 2024-04-21T09:26:01.132 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.39 2024-04-21T09:26:01.138 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:03.687 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 40 -eq 48 ] 2024-04-21T09:26:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.40 2024-04-21T09:26:03.688 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.40 2024-04-21T09:26:03.688 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.40 2024-04-21T09:26:03.689 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.40 2024-04-21T09:26:03.695 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:06.350 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:06.351 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 41 -eq 48 ] 2024-04-21T09:26:06.351 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.41 2024-04-21T09:26:06.351 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.41 2024-04-21T09:26:06.351 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.41 2024-04-21T09:26:06.352 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.41 2024-04-21T09:26:06.360 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:08.721 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:08.722 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 42 -eq 48 ] 2024-04-21T09:26:08.722 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.42 2024-04-21T09:26:08.723 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.42 2024-04-21T09:26:08.723 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.42 2024-04-21T09:26:08.723 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.42 2024-04-21T09:26:08.730 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:11.240 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:11.240 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 43 -eq 48 ] 2024-04-21T09:26:11.241 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.43 2024-04-21T09:26:11.241 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.43 2024-04-21T09:26:11.241 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.43 2024-04-21T09:26:11.241 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.43 2024-04-21T09:26:11.246 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:14.309 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 44 -eq 48 ] 2024-04-21T09:26:14.310 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.44 2024-04-21T09:26:14.311 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.44 2024-04-21T09:26:14.311 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.44 2024-04-21T09:26:14.311 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.44 2024-04-21T09:26:14.316 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:17.257 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:17.258 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 45 -eq 48 ] 2024-04-21T09:26:17.258 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.45 2024-04-21T09:26:17.259 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.45 2024-04-21T09:26:17.259 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.45 2024-04-21T09:26:17.259 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.45 2024-04-21T09:26:17.264 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:19.826 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:19.827 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 46 -eq 48 ] 2024-04-21T09:26:19.827 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.46 2024-04-21T09:26:19.828 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.46 2024-04-21T09:26:19.828 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.46 2024-04-21T09:26:19.828 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.46 2024-04-21T09:26:19.834 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:21.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:26:21.564 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:26:22.604 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:22.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 47 -eq 48 ] 2024-04-21T09:26:22.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.47 2024-04-21T09:26:22.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.47 2024-04-21T09:26:22.605 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.47 2024-04-21T09:26:22.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.47 2024-04-21T09:26:22.611 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:23.765 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:23.766 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 48 -eq 48 ] 2024-04-21T09:26:23.766 INFO:tasks.workunit.client.0.smithi026.stderr:+ continue 2024-04-21T09:26:23.766 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.49 2024-04-21T09:26:23.766 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 49 -eq 48 ] 2024-04-21T09:26:23.766 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.49 2024-04-21T09:26:23.767 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.49 2024-04-21T09:26:23.767 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.49 2024-04-21T09:26:23.771 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:25.146 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:25.147 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 50 -eq 48 ] 2024-04-21T09:26:25.147 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.50 2024-04-21T09:26:25.147 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.50 2024-04-21T09:26:25.147 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.50 2024-04-21T09:26:25.147 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.50 2024-04-21T09:26:25.153 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:26.513 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:26.514 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 51 -eq 48 ] 2024-04-21T09:26:26.514 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.51 2024-04-21T09:26:26.514 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.51 2024-04-21T09:26:26.514 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.51 2024-04-21T09:26:26.514 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.51 2024-04-21T09:26:26.518 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:27.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:27.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 52 -eq 48 ] 2024-04-21T09:26:27.571 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.52 2024-04-21T09:26:27.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.52 2024-04-21T09:26:27.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.52 2024-04-21T09:26:27.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.52 2024-04-21T09:26:27.575 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:28.673 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:28.674 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 53 -eq 48 ] 2024-04-21T09:26:28.674 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.53 2024-04-21T09:26:28.674 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.53 2024-04-21T09:26:28.674 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.53 2024-04-21T09:26:28.674 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.53 2024-04-21T09:26:28.675 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:29.840 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:29.840 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 54 -eq 48 ] 2024-04-21T09:26:29.840 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.54 2024-04-21T09:26:29.841 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.54 2024-04-21T09:26:29.841 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.54 2024-04-21T09:26:29.841 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.54 2024-04-21T09:26:29.844 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:30.889 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:30.889 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 55 -eq 48 ] 2024-04-21T09:26:30.890 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.55 2024-04-21T09:26:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.55 2024-04-21T09:26:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.55 2024-04-21T09:26:30.890 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.55 2024-04-21T09:26:30.893 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:32.059 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:32.060 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 56 -eq 48 ] 2024-04-21T09:26:32.060 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.56 2024-04-21T09:26:32.060 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.56 2024-04-21T09:26:32.060 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.56 2024-04-21T09:26:32.060 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.56 2024-04-21T09:26:32.063 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:33.087 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:33.087 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 57 -eq 48 ] 2024-04-21T09:26:33.087 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.57 2024-04-21T09:26:33.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.57 2024-04-21T09:26:33.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.57 2024-04-21T09:26:33.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.57 2024-04-21T09:26:33.090 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:34.106 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:34.106 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.58 2024-04-21T09:26:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 58 -eq 48 ] 2024-04-21T09:26:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.58 2024-04-21T09:26:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.58 2024-04-21T09:26:34.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.58 2024-04-21T09:26:34.109 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:35.149 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:35.149 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 59 -eq 48 ] 2024-04-21T09:26:35.149 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.59 2024-04-21T09:26:35.150 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.59 2024-04-21T09:26:35.150 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.59 2024-04-21T09:26:35.150 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.59 2024-04-21T09:26:35.151 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:36.330 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:36.330 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 60 -eq 48 ] 2024-04-21T09:26:36.331 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.60 2024-04-21T09:26:36.331 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.60 2024-04-21T09:26:36.331 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.60 2024-04-21T09:26:36.331 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.60 2024-04-21T09:26:36.334 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:37.445 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:37.445 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 61 -eq 48 ] 2024-04-21T09:26:37.445 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.61 2024-04-21T09:26:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.61 2024-04-21T09:26:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.61 2024-04-21T09:26:37.446 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.61 2024-04-21T09:26:37.447 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:38.681 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:38.681 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 62 -eq 48 ] 2024-04-21T09:26:38.681 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.62 2024-04-21T09:26:38.682 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.62 2024-04-21T09:26:38.682 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.62 2024-04-21T09:26:38.682 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.62 2024-04-21T09:26:38.685 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:39.825 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:39.825 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 63 -eq 48 ] 2024-04-21T09:26:39.826 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.63 2024-04-21T09:26:39.826 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.63 2024-04-21T09:26:39.826 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.63 2024-04-21T09:26:39.826 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.63 2024-04-21T09:26:39.828 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:40.941 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:40.941 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 64 -eq 48 ] 2024-04-21T09:26:40.942 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.64 2024-04-21T09:26:40.942 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.64 2024-04-21T09:26:40.942 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.64 2024-04-21T09:26:40.942 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.64 2024-04-21T09:26:40.944 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:42.124 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:42.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 65 -eq 48 ] 2024-04-21T09:26:42.125 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.65 2024-04-21T09:26:42.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.65 2024-04-21T09:26:42.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.65 2024-04-21T09:26:42.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.65 2024-04-21T09:26:42.128 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:43.360 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:43.360 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 66 -eq 48 ] 2024-04-21T09:26:43.360 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.66 2024-04-21T09:26:43.360 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.66 2024-04-21T09:26:43.361 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.66 2024-04-21T09:26:43.361 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.66 2024-04-21T09:26:43.364 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:44.613 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:44.613 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 67 -eq 48 ] 2024-04-21T09:26:44.613 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.67 2024-04-21T09:26:44.613 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.67 2024-04-21T09:26:44.614 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.67 2024-04-21T09:26:44.614 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.67 2024-04-21T09:26:44.617 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:45.685 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 68 -eq 48 ] 2024-04-21T09:26:45.686 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.68 2024-04-21T09:26:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.68 2024-04-21T09:26:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.68 2024-04-21T09:26:45.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.68 2024-04-21T09:26:45.688 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:46.773 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:46.773 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 69 -eq 48 ] 2024-04-21T09:26:46.774 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.69 2024-04-21T09:26:46.774 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.69 2024-04-21T09:26:46.774 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.69 2024-04-21T09:26:46.774 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.69 2024-04-21T09:26:46.777 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:47.946 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:47.946 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 70 -eq 48 ] 2024-04-21T09:26:47.946 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.70 2024-04-21T09:26:47.947 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.70 2024-04-21T09:26:47.947 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.70 2024-04-21T09:26:47.947 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.70 2024-04-21T09:26:47.949 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:49.142 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:49.143 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 71 -eq 48 ] 2024-04-21T09:26:49.143 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.71 2024-04-21T09:26:49.143 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.71 2024-04-21T09:26:49.143 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.71 2024-04-21T09:26:49.143 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.71 2024-04-21T09:26:49.146 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:50.313 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:50.313 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 72 -eq 48 ] 2024-04-21T09:26:50.313 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.72 2024-04-21T09:26:50.314 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.72 2024-04-21T09:26:50.314 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.72 2024-04-21T09:26:50.314 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.72 2024-04-21T09:26:50.317 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:51.595 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:51.596 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 73 -eq 48 ] 2024-04-21T09:26:51.596 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.73 2024-04-21T09:26:51.596 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.73 2024-04-21T09:26:51.596 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.73 2024-04-21T09:26:51.597 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.73 2024-04-21T09:26:51.600 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:51.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:26:51.609 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:26:52.793 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:52.793 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 74 -eq 48 ] 2024-04-21T09:26:52.793 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.74 2024-04-21T09:26:52.794 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.74 2024-04-21T09:26:52.794 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.74 2024-04-21T09:26:52.794 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.74 2024-04-21T09:26:52.797 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:53.974 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:53.974 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 75 -eq 48 ] 2024-04-21T09:26:53.975 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.75 2024-04-21T09:26:53.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.75 2024-04-21T09:26:53.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.75 2024-04-21T09:26:53.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.75 2024-04-21T09:26:53.978 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:55.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:55.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 76 -eq 48 ] 2024-04-21T09:26:55.251 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.76 2024-04-21T09:26:55.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.76 2024-04-21T09:26:55.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.76 2024-04-21T09:26:55.252 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.76 2024-04-21T09:26:55.255 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:56.412 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:56.412 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 77 -eq 48 ] 2024-04-21T09:26:56.412 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.77 2024-04-21T09:26:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.77 2024-04-21T09:26:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.77 2024-04-21T09:26:56.413 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.77 2024-04-21T09:26:56.416 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:57.828 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:57.828 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 78 -eq 48 ] 2024-04-21T09:26:57.829 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.78 2024-04-21T09:26:57.829 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.78 2024-04-21T09:26:57.829 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.78 2024-04-21T09:26:57.829 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.78 2024-04-21T09:26:57.832 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:26:59.092 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:26:59.092 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 79 -eq 48 ] 2024-04-21T09:26:59.093 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.79 2024-04-21T09:26:59.093 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.79 2024-04-21T09:26:59.093 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.79 2024-04-21T09:26:59.093 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.79 2024-04-21T09:26:59.095 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:00.300 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:00.300 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 80 -eq 48 ] 2024-04-21T09:27:00.300 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.80 2024-04-21T09:27:00.300 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.80 2024-04-21T09:27:00.300 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.80 2024-04-21T09:27:00.301 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.80 2024-04-21T09:27:00.303 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:01.488 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:01.488 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 81 -eq 48 ] 2024-04-21T09:27:01.489 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.81 2024-04-21T09:27:01.489 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.81 2024-04-21T09:27:01.489 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.81 2024-04-21T09:27:01.489 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.81 2024-04-21T09:27:01.491 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:02.853 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:02.853 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 82 -eq 48 ] 2024-04-21T09:27:02.854 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.82 2024-04-21T09:27:02.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.82 2024-04-21T09:27:02.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.82 2024-04-21T09:27:02.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.82 2024-04-21T09:27:02.858 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:04.106 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:04.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 83 -eq 48 ] 2024-04-21T09:27:04.107 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.83 2024-04-21T09:27:04.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.83 2024-04-21T09:27:04.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.83 2024-04-21T09:27:04.107 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.83 2024-04-21T09:27:04.110 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:05.480 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:05.480 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 84 -eq 48 ] 2024-04-21T09:27:05.480 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.84 2024-04-21T09:27:05.480 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.84 2024-04-21T09:27:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.84 2024-04-21T09:27:05.481 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.84 2024-04-21T09:27:05.484 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:07.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:07.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 85 -eq 48 ] 2024-04-21T09:27:07.015 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.85 2024-04-21T09:27:07.015 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.85 2024-04-21T09:27:07.015 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.85 2024-04-21T09:27:07.015 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.85 2024-04-21T09:27:07.018 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:08.378 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:08.378 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 86 -eq 48 ] 2024-04-21T09:27:08.378 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.86 2024-04-21T09:27:08.378 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.86 2024-04-21T09:27:08.379 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.86 2024-04-21T09:27:08.379 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.86 2024-04-21T09:27:08.382 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:09.657 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:09.657 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 87 -eq 48 ] 2024-04-21T09:27:09.657 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.87 2024-04-21T09:27:09.657 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.87 2024-04-21T09:27:09.658 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.87 2024-04-21T09:27:09.658 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.87 2024-04-21T09:27:09.659 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:10.981 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:10.981 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 88 -eq 48 ] 2024-04-21T09:27:10.981 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.88 2024-04-21T09:27:10.982 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.88 2024-04-21T09:27:10.982 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.88 2024-04-21T09:27:10.982 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.88 2024-04-21T09:27:10.984 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:12.250 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:12.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 89 -eq 48 ] 2024-04-21T09:27:12.251 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.89 2024-04-21T09:27:12.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.89 2024-04-21T09:27:12.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.89 2024-04-21T09:27:12.251 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.89 2024-04-21T09:27:12.253 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 90 -eq 48 ] 2024-04-21T09:27:13.633 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.90 2024-04-21T09:27:13.634 INFO:tasks.workunit.client.0.smithi026.stdout:checking v0.90 2024-04-21T09:27:13.634 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking v0.90 2024-04-21T09:27:13.634 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd .snap/v0.90 2024-04-21T09:27:13.637 INFO:tasks.workunit.client.0.smithi026.stderr:+ git diff --exit-code 2024-04-21T09:27:18.570 INFO:tasks.workunit.client.0.smithi026.stderr:+ cd ../.. 2024-04-21T09:27:18.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 1 -eq 48 ] 2024-04-21T09:27:18.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.1 2024-04-21T09:27:18.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.1 2024-04-21T09:27:18.590 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 2 -eq 48 ] 2024-04-21T09:27:18.590 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.2 2024-04-21T09:27:18.590 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.2 2024-04-21T09:27:18.609 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 3 -eq 48 ] 2024-04-21T09:27:18.609 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.3 2024-04-21T09:27:18.609 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.3 2024-04-21T09:27:18.627 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 4 -eq 48 ] 2024-04-21T09:27:18.627 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.4 2024-04-21T09:27:18.627 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.4 2024-04-21T09:27:18.649 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 5 -eq 48 ] 2024-04-21T09:27:18.649 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.5 2024-04-21T09:27:18.649 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.5 2024-04-21T09:27:18.669 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 6 -eq 48 ] 2024-04-21T09:27:18.669 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.6 2024-04-21T09:27:18.669 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.6 2024-04-21T09:27:18.693 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 7 -eq 48 ] 2024-04-21T09:27:18.693 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.7 2024-04-21T09:27:18.693 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.7 2024-04-21T09:27:18.716 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 8 -eq 48 ] 2024-04-21T09:27:18.716 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.8 2024-04-21T09:27:18.716 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.8 2024-04-21T09:27:18.735 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 9 -eq 48 ] 2024-04-21T09:27:18.735 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.9 2024-04-21T09:27:18.735 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.9 2024-04-21T09:27:18.753 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 10 -eq 48 ] 2024-04-21T09:27:18.753 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.10 2024-04-21T09:27:18.753 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.10 2024-04-21T09:27:18.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 11 -eq 48 ] 2024-04-21T09:27:18.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.11 2024-04-21T09:27:18.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.11 2024-04-21T09:27:18.786 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 12 -eq 48 ] 2024-04-21T09:27:18.786 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.12 2024-04-21T09:27:18.786 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.12 2024-04-21T09:27:18.803 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 13 -eq 48 ] 2024-04-21T09:27:18.803 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.13 2024-04-21T09:27:18.803 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.13 2024-04-21T09:27:18.819 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 14 -eq 48 ] 2024-04-21T09:27:18.819 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.14 2024-04-21T09:27:18.819 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.14 2024-04-21T09:27:18.836 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 15 -eq 48 ] 2024-04-21T09:27:18.836 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.15 2024-04-21T09:27:18.836 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.15 2024-04-21T09:27:18.855 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 16 -eq 48 ] 2024-04-21T09:27:18.855 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.16 2024-04-21T09:27:18.855 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.16 2024-04-21T09:27:18.874 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 17 -eq 48 ] 2024-04-21T09:27:18.874 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.17 2024-04-21T09:27:18.874 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.17 2024-04-21T09:27:18.893 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 18 -eq 48 ] 2024-04-21T09:27:18.893 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.18 2024-04-21T09:27:18.893 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.18 2024-04-21T09:27:18.914 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 19 -eq 48 ] 2024-04-21T09:27:18.914 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.19 2024-04-21T09:27:18.914 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.19 2024-04-21T09:27:18.932 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 20 -eq 48 ] 2024-04-21T09:27:18.932 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.20 2024-04-21T09:27:18.932 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.20 2024-04-21T09:27:18.952 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 21 -eq 48 ] 2024-04-21T09:27:18.952 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.21 2024-04-21T09:27:18.952 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.21 2024-04-21T09:27:18.968 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 22 -eq 48 ] 2024-04-21T09:27:18.968 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.22 2024-04-21T09:27:18.969 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.22 2024-04-21T09:27:18.984 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 23 -eq 48 ] 2024-04-21T09:27:18.984 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.23 2024-04-21T09:27:18.984 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.23 2024-04-21T09:27:19.210 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 24 -eq 48 ] 2024-04-21T09:27:19.211 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.24 2024-04-21T09:27:19.211 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.24 2024-04-21T09:27:19.234 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 25 -eq 48 ] 2024-04-21T09:27:19.235 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.25 2024-04-21T09:27:19.235 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.25 2024-04-21T09:27:19.253 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 26 -eq 48 ] 2024-04-21T09:27:19.253 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.26 2024-04-21T09:27:19.253 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.26 2024-04-21T09:27:19.273 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 27 -eq 48 ] 2024-04-21T09:27:19.273 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.27 2024-04-21T09:27:19.273 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.27 2024-04-21T09:27:19.298 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 28 -eq 48 ] 2024-04-21T09:27:19.299 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.28 2024-04-21T09:27:19.299 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.28 2024-04-21T09:27:19.323 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 29 -eq 48 ] 2024-04-21T09:27:19.323 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.29 2024-04-21T09:27:19.323 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.29 2024-04-21T09:27:19.344 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 30 -eq 48 ] 2024-04-21T09:27:19.344 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.30 2024-04-21T09:27:19.344 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.30 2024-04-21T09:27:19.374 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 31 -eq 48 ] 2024-04-21T09:27:19.374 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.31 2024-04-21T09:27:19.374 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.31 2024-04-21T09:27:19.394 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 32 -eq 48 ] 2024-04-21T09:27:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.32 2024-04-21T09:27:19.395 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.32 2024-04-21T09:27:19.417 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 33 -eq 48 ] 2024-04-21T09:27:19.417 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.33 2024-04-21T09:27:19.417 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.33 2024-04-21T09:27:19.435 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 34 -eq 48 ] 2024-04-21T09:27:19.435 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.34 2024-04-21T09:27:19.435 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.34 2024-04-21T09:27:19.464 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 35 -eq 48 ] 2024-04-21T09:27:19.464 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.35 2024-04-21T09:27:19.464 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.35 2024-04-21T09:27:19.487 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 36 -eq 48 ] 2024-04-21T09:27:19.487 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.36 2024-04-21T09:27:19.487 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.36 2024-04-21T09:27:19.509 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 37 -eq 48 ] 2024-04-21T09:27:19.509 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.37 2024-04-21T09:27:19.509 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.37 2024-04-21T09:27:19.530 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 38 -eq 48 ] 2024-04-21T09:27:19.530 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.38 2024-04-21T09:27:19.531 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.38 2024-04-21T09:27:19.548 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 39 -eq 48 ] 2024-04-21T09:27:19.548 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.39 2024-04-21T09:27:19.548 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.39 2024-04-21T09:27:19.567 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 40 -eq 48 ] 2024-04-21T09:27:19.567 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.40 2024-04-21T09:27:19.567 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.40 2024-04-21T09:27:19.586 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 41 -eq 48 ] 2024-04-21T09:27:19.586 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.41 2024-04-21T09:27:19.587 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.41 2024-04-21T09:27:19.614 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 42 -eq 48 ] 2024-04-21T09:27:19.614 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.42 2024-04-21T09:27:19.614 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.42 2024-04-21T09:27:19.633 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 43 -eq 48 ] 2024-04-21T09:27:19.633 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.43 2024-04-21T09:27:19.633 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.43 2024-04-21T09:27:19.659 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 44 -eq 48 ] 2024-04-21T09:27:19.659 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.44 2024-04-21T09:27:19.659 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.44 2024-04-21T09:27:19.688 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 45 -eq 48 ] 2024-04-21T09:27:19.688 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.45 2024-04-21T09:27:19.688 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.45 2024-04-21T09:27:19.712 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 46 -eq 48 ] 2024-04-21T09:27:19.712 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.46 2024-04-21T09:27:19.712 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.46 2024-04-21T09:27:19.737 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 47 -eq 48 ] 2024-04-21T09:27:19.737 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.47 2024-04-21T09:27:19.737 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.47 2024-04-21T09:27:19.764 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 48 -eq 48 ] 2024-04-21T09:27:19.765 INFO:tasks.workunit.client.0.smithi026.stderr:+ continue 2024-04-21T09:27:19.765 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 49 -eq 48 ] 2024-04-21T09:27:19.765 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.49 2024-04-21T09:27:19.765 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.49 2024-04-21T09:27:19.790 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 50 -eq 48 ] 2024-04-21T09:27:19.790 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.50 2024-04-21T09:27:19.790 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.50 2024-04-21T09:27:19.811 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 51 -eq 48 ] 2024-04-21T09:27:19.811 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.51 2024-04-21T09:27:19.811 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.51 2024-04-21T09:27:19.833 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 52 -eq 48 ] 2024-04-21T09:27:19.833 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.52 2024-04-21T09:27:19.833 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.52 2024-04-21T09:27:19.852 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 53 -eq 48 ] 2024-04-21T09:27:19.852 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.53 2024-04-21T09:27:19.852 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.53 2024-04-21T09:27:19.872 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 54 -eq 48 ] 2024-04-21T09:27:19.872 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.54 2024-04-21T09:27:19.873 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.54 2024-04-21T09:27:19.892 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 55 -eq 48 ] 2024-04-21T09:27:19.892 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.55 2024-04-21T09:27:19.892 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.55 2024-04-21T09:27:19.909 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 56 -eq 48 ] 2024-04-21T09:27:19.910 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.56 2024-04-21T09:27:19.910 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.56 2024-04-21T09:27:19.929 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 57 -eq 48 ] 2024-04-21T09:27:19.929 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.57 2024-04-21T09:27:19.929 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.57 2024-04-21T09:27:19.948 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 58 -eq 48 ] 2024-04-21T09:27:19.948 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.58 2024-04-21T09:27:19.948 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.58 2024-04-21T09:27:19.970 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 59 -eq 48 ] 2024-04-21T09:27:19.970 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.59 2024-04-21T09:27:19.970 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.59 2024-04-21T09:27:19.994 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 60 -eq 48 ] 2024-04-21T09:27:19.994 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.60 2024-04-21T09:27:19.994 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.60 2024-04-21T09:27:20.033 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 61 -eq 48 ] 2024-04-21T09:27:20.033 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.61 2024-04-21T09:27:20.033 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.61 2024-04-21T09:27:20.062 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 62 -eq 48 ] 2024-04-21T09:27:20.062 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.62 2024-04-21T09:27:20.062 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.62 2024-04-21T09:27:20.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 63 -eq 48 ] 2024-04-21T09:27:20.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.63 2024-04-21T09:27:20.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.63 2024-04-21T09:27:20.114 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 64 -eq 48 ] 2024-04-21T09:27:20.114 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.64 2024-04-21T09:27:20.115 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.64 2024-04-21T09:27:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 65 -eq 48 ] 2024-04-21T09:27:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.65 2024-04-21T09:27:20.144 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.65 2024-04-21T09:27:20.164 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 66 -eq 48 ] 2024-04-21T09:27:20.164 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.66 2024-04-21T09:27:20.164 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.66 2024-04-21T09:27:20.188 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 67 -eq 48 ] 2024-04-21T09:27:20.188 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.67 2024-04-21T09:27:20.188 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.67 2024-04-21T09:27:20.211 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 68 -eq 48 ] 2024-04-21T09:27:20.211 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.68 2024-04-21T09:27:20.211 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.68 2024-04-21T09:27:20.809 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 69 -eq 48 ] 2024-04-21T09:27:20.809 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.69 2024-04-21T09:27:20.809 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.69 2024-04-21T09:27:20.840 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 70 -eq 48 ] 2024-04-21T09:27:20.840 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.70 2024-04-21T09:27:20.840 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.70 2024-04-21T09:27:20.861 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 71 -eq 48 ] 2024-04-21T09:27:20.861 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.71 2024-04-21T09:27:20.861 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.71 2024-04-21T09:27:20.887 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 72 -eq 48 ] 2024-04-21T09:27:20.887 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.72 2024-04-21T09:27:20.887 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.72 2024-04-21T09:27:20.911 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 73 -eq 48 ] 2024-04-21T09:27:20.911 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.73 2024-04-21T09:27:20.911 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.73 2024-04-21T09:27:20.932 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 74 -eq 48 ] 2024-04-21T09:27:20.932 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.74 2024-04-21T09:27:20.932 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.74 2024-04-21T09:27:20.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 75 -eq 48 ] 2024-04-21T09:27:20.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.75 2024-04-21T09:27:20.960 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.75 2024-04-21T09:27:20.993 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 76 -eq 48 ] 2024-04-21T09:27:20.993 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.76 2024-04-21T09:27:20.993 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.76 2024-04-21T09:27:21.018 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 77 -eq 48 ] 2024-04-21T09:27:21.018 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.77 2024-04-21T09:27:21.018 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.77 2024-04-21T09:27:21.045 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 78 -eq 48 ] 2024-04-21T09:27:21.045 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.78 2024-04-21T09:27:21.045 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.78 2024-04-21T09:27:21.071 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 79 -eq 48 ] 2024-04-21T09:27:21.071 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.79 2024-04-21T09:27:21.072 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.79 2024-04-21T09:27:21.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 80 -eq 48 ] 2024-04-21T09:27:21.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.80 2024-04-21T09:27:21.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.80 2024-04-21T09:27:21.126 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 81 -eq 48 ] 2024-04-21T09:27:21.126 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.81 2024-04-21T09:27:21.126 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.81 2024-04-21T09:27:21.150 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 82 -eq 48 ] 2024-04-21T09:27:21.150 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.82 2024-04-21T09:27:21.151 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.82 2024-04-21T09:27:21.184 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 83 -eq 48 ] 2024-04-21T09:27:21.184 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.83 2024-04-21T09:27:21.184 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.83 2024-04-21T09:27:21.222 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 84 -eq 48 ] 2024-04-21T09:27:21.222 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.84 2024-04-21T09:27:21.222 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.84 2024-04-21T09:27:21.257 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 85 -eq 48 ] 2024-04-21T09:27:21.257 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.85 2024-04-21T09:27:21.257 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.85 2024-04-21T09:27:21.279 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 86 -eq 48 ] 2024-04-21T09:27:21.279 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.86 2024-04-21T09:27:21.279 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.86 2024-04-21T09:27:21.302 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 87 -eq 48 ] 2024-04-21T09:27:21.302 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.87 2024-04-21T09:27:21.302 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.87 2024-04-21T09:27:21.325 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 88 -eq 48 ] 2024-04-21T09:27:21.325 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.88 2024-04-21T09:27:21.325 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.88 2024-04-21T09:27:21.343 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 89 -eq 48 ] 2024-04-21T09:27:21.343 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.89 2024-04-21T09:27:21.344 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.89 2024-04-21T09:27:21.370 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ 90 -eq 48 ] 2024-04-21T09:27:21.370 INFO:tasks.workunit.client.0.smithi026.stderr:+ ver=v0.90 2024-04-21T09:27:21.370 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/v0.90 2024-04-21T09:27:21.402 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:21.403 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:27:21.403 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:21.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:21.681 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:27:21.684 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:27:21.708 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-21T09:27:21.708+0000 7f41f8546640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32030) UID: 0 2024-04-21T09:27:21.708 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-04-21T09:27:21.708+0000 7fe70a6a7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32030) UID: 0 2024-04-21T09:27:21.708 INFO:tasks.ceph.mds.b.smithi169.stderr:2024-04-21T09:27:21.708+0000 7f4b797fa640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 32030) UID: 0 2024-04-21T09:27:43.784 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-hardlink.sh... 2024-04-21T09:27:43.785 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-hardlink.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-hardlink.sh 2024-04-21T09:27:43.803 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:27:43.803 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 1 2 2024-04-21T09:27:43.818 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo asdf 2024-04-21T09:27:43.823 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo asdf 2024-04-21T09:27:43.823 INFO:tasks.workunit.client.0.smithi026.stderr:+ ln 1/file1 2/file1 2024-04-21T09:27:43.826 INFO:tasks.workunit.client.0.smithi026.stderr:+ ln 1/file2 2/file2 2024-04-21T09:27:43.828 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 2/.snap/s1 2024-04-21T09:27:43.879 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo qwer 2024-04-21T09:27:43.885 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep asdf 2/.snap/s1/file1 2024-04-21T09:27:43.898 INFO:tasks.workunit.client.0.smithi026.stdout:asdf 2024-04-21T09:27:43.898 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -f 1/file2 2024-04-21T09:27:43.902 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep asdf 2/.snap/s1/file2 2024-04-21T09:27:43.911 INFO:tasks.workunit.client.0.smithi026.stdout:asdf 2024-04-21T09:27:43.912 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -f 2/file2 2024-04-21T09:27:43.918 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep asdf 2/.snap/s1/file2 2024-04-21T09:27:43.923 INFO:tasks.workunit.client.0.smithi026.stdout:asdf 2024-04-21T09:27:43.923 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir 2/.snap/s1 2024-04-21T09:27:43.929 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -rf 1 2 2024-04-21T09:27:43.962 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:43.963 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:27:43.963 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:43.963 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:44.028 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-intodir.sh... 2024-04-21T09:27:44.029 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-intodir.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-intodir.sh 2024-04-21T09:27:44.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir foo 2024-04-21T09:27:44.091 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir foo/.snap/one 2024-04-21T09:27:44.103 INFO:tasks.workunit.client.0.smithi026.stderr:+ touch bar 2024-04-21T09:27:44.106 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv bar foo 2024-04-21T09:27:44.111 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:27:45.502 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir baz 2024-04-21T09:27:45.513 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir baz/.snap/two 2024-04-21T09:27:45.551 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv baz foo 2024-04-21T09:27:45.561 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:27:45.668 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir foo/baz/.snap/two 2024-04-21T09:27:45.689 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir foo/.snap/one 2024-04-21T09:27:45.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -r foo 2024-04-21T09:27:45.753 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:27:45.754 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:45.755 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:45.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:45.832 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-multiple-capsnaps.sh... 2024-04-21T09:27:45.832 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-multiple-capsnaps.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-multiple-capsnaps.sh 2024-04-21T09:27:45.892 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:27:45.895 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo asdf 2024-04-21T09:27:45.896 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/1 2024-04-21T09:27:45.916 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 777 a 2024-04-21T09:27:45.918 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/2 2024-04-21T09:27:45.940 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo qwer 2024-04-21T09:27:45.942 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/3 2024-04-21T09:27:45.958 INFO:tasks.workunit.client.0.smithi026.stderr:+ chmod 666 a 2024-04-21T09:27:45.959 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/4 2024-04-21T09:27:45.981 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo zxcv 2024-04-21T09:27:45.984 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/5 2024-04-21T09:27:46.031 INFO:tasks.workunit.client.0.smithi026.stderr:+ ls -al .snap/1/a .snap/2/a .snap/3/a .snap/4/a .snap/5/a 2024-04-21T09:27:46.056 INFO:tasks.workunit.client.0.smithi026.stdout:-rw-rw-r-- 1 ubuntu ubuntu 5 Apr 21 09:27 .snap/1/a 2024-04-21T09:27:46.056 INFO:tasks.workunit.client.0.smithi026.stdout:-rwxrwxrwx 1 ubuntu ubuntu 5 Apr 21 09:27 .snap/2/a 2024-04-21T09:27:46.056 INFO:tasks.workunit.client.0.smithi026.stdout:-rwxrwxrwx 1 ubuntu ubuntu 5 Apr 21 09:27 .snap/3/a 2024-04-21T09:27:46.056 INFO:tasks.workunit.client.0.smithi026.stdout:-rw-rw-rw- 1 ubuntu ubuntu 5 Apr 21 09:27 .snap/4/a 2024-04-21T09:27:46.056 INFO:tasks.workunit.client.0.smithi026.stdout:-rw-rw-rw- 1 ubuntu ubuntu 5 Apr 21 09:27 .snap/5/a 2024-04-21T09:27:46.057 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep asdf .snap/1/a 2024-04-21T09:27:46.062 INFO:tasks.workunit.client.0.smithi026.stdout:asdf 2024-04-21T09:27:46.062 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/1/a 2024-04-21T09:27:46.062 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep Size: 5 2024-04-21T09:27:46.065 INFO:tasks.workunit.client.0.smithi026.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2024-04-21T09:27:46.065 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep asdf .snap/2/a 2024-04-21T09:27:46.070 INFO:tasks.workunit.client.0.smithi026.stdout:asdf 2024-04-21T09:27:46.071 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/2/a 2024-04-21T09:27:46.071 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep Size: 5 2024-04-21T09:27:46.073 INFO:tasks.workunit.client.0.smithi026.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2024-04-21T09:27:46.074 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/2/a 2024-04-21T09:27:46.074 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep -- -rwxrwxrwx 2024-04-21T09:27:46.077 INFO:tasks.workunit.client.0.smithi026.stdout:Access: (0777/-rwxrwxrwx) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2024-04-21T09:27:46.077 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep qwer .snap/3/a 2024-04-21T09:27:46.082 INFO:tasks.workunit.client.0.smithi026.stdout:qwer 2024-04-21T09:27:46.082 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/3/a 2024-04-21T09:27:46.082 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep Size: 5 2024-04-21T09:27:46.085 INFO:tasks.workunit.client.0.smithi026.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2024-04-21T09:27:46.085 INFO:tasks.workunit.client.0.smithi026.stderr:+ + grep -- -rwxrwxrwx 2024-04-21T09:27:46.085 INFO:tasks.workunit.client.0.smithi026.stderr:stat .snap/3/a 2024-04-21T09:27:46.088 INFO:tasks.workunit.client.0.smithi026.stdout:Access: (0777/-rwxrwxrwx) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2024-04-21T09:27:46.088 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep qwer .snap/4/a 2024-04-21T09:27:46.094 INFO:tasks.workunit.client.0.smithi026.stdout:qwer 2024-04-21T09:27:46.094 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/4/a 2024-04-21T09:27:46.094 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep Size: 5 2024-04-21T09:27:46.097 INFO:tasks.workunit.client.0.smithi026.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2024-04-21T09:27:46.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/4/a 2024-04-21T09:27:46.098 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep -- -rw-rw-rw- 2024-04-21T09:27:46.100 INFO:tasks.workunit.client.0.smithi026.stdout:Access: (0666/-rw-rw-rw-) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2024-04-21T09:27:46.100 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep zxcv .snap/5/a 2024-04-21T09:27:46.114 INFO:tasks.workunit.client.0.smithi026.stdout:zxcv 2024-04-21T09:27:46.114 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/5/a 2024-04-21T09:27:46.114 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep Size: 5 2024-04-21T09:27:46.117 INFO:tasks.workunit.client.0.smithi026.stdout: Size: 5 Blocks: 1 IO Block: 4194304 regular file 2024-04-21T09:27:46.117 INFO:tasks.workunit.client.0.smithi026.stderr:+ stat .snap/5/a 2024-04-21T09:27:46.117 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep -- -rw-rw-rw- 2024-04-21T09:27:46.119 INFO:tasks.workunit.client.0.smithi026.stdout:Access: (0666/-rw-rw-rw-) Uid: ( 1000/ ubuntu) Gid: ( 1271/ ubuntu) 2024-04-21T09:27:46.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/1 .snap/2 .snap/3 .snap/4 .snap/5 2024-04-21T09:27:46.187 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:46.188 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:27:46.189 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:46.189 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:46.269 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-name-limits.sh... 2024-04-21T09:27:46.270 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-name-limits.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-name-limits.sh 2024-04-21T09:27:46.354 INFO:tasks.workunit.client.0.smithi026.stderr:rmdir: failed to remove 'd1/.snap/*': No such file or directory 2024-04-21T09:27:46.364 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:46.364 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:46.364 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:46.396 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-parents.sh... 2024-04-21T09:27:46.397 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-parents.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-parents.sh 2024-04-21T09:27:46.455 INFO:tasks.workunit.client.0.smithi026.stdout:making directory tree and files 2024-04-21T09:27:46.456 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo making directory tree and files 2024-04-21T09:27:46.456 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir -p 1/a/b/c/ 2024-04-21T09:27:46.471 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo i'm file1 2024-04-21T09:27:46.476 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo i'm file2 2024-04-21T09:27:46.481 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo i'm file3 2024-04-21T09:27:46.481 INFO:tasks.workunit.client.0.smithi026.stdout:snapshotting 2024-04-21T09:27:46.481 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo snapshotting 2024-04-21T09:27:46.481 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 1/.snap/foosnap1 2024-04-21T09:27:46.505 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 2 2024-04-21T09:27:46.509 INFO:tasks.workunit.client.0.smithi026.stdout:moving tree 2024-04-21T09:27:46.509 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo moving tree 2024-04-21T09:27:46.509 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv 1/a 2 2024-04-21T09:27:46.516 INFO:tasks.workunit.client.0.smithi026.stdout:checking snapshot contains tree... 2024-04-21T09:27:46.517 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo checking snapshot contains tree... 2024-04-21T09:27:46.517 INFO:tasks.workunit.client.0.smithi026.stderr:+ find 1/.snap/foosnap1 2024-04-21T09:27:46.517 INFO:tasks.workunit.client.0.smithi026.stderr:+ wc -w 2024-04-21T09:27:46.560 INFO:tasks.workunit.client.0.smithi026.stderr:+ dir1=7 2024-04-21T09:27:46.560 INFO:tasks.workunit.client.0.smithi026.stderr:+ find 2/ 2024-04-21T09:27:46.560 INFO:tasks.workunit.client.0.smithi026.stderr:+ wc -w 2024-04-21T09:27:46.580 INFO:tasks.workunit.client.0.smithi026.stderr:+ dir2=7 2024-04-21T09:27:46.580 INFO:tasks.workunit.client.0.smithi026.stderr:+ test 7==7 2024-04-21T09:27:46.580 INFO:tasks.workunit.client.0.smithi026.stdout:Success! 2024-04-21T09:27:46.580 INFO:tasks.workunit.client.0.smithi026.stdout:adding folder and file to tree... 2024-04-21T09:27:46.580 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo Success! 2024-04-21T09:27:46.581 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo adding folder and file to tree... 2024-04-21T09:27:46.581 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 2/a/b/c/d 2024-04-21T09:27:46.587 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo i'm file 4! 2024-04-21T09:27:46.587 INFO:tasks.workunit.client.0.smithi026.stdout:snapshotting tree 2 2024-04-21T09:27:46.588 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo snapshotting tree 2 2024-04-21T09:27:46.588 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 2/.snap/barsnap2 2024-04-21T09:27:46.604 INFO:tasks.workunit.client.0.smithi026.stdout:comparing snapshots 2024-04-21T09:27:46.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo comparing snapshots 2024-04-21T09:27:46.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ find 1/.snap/foosnap1/ -maxdepth 2 2024-04-21T09:27:46.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ wc -w 2024-04-21T09:27:46.625 INFO:tasks.workunit.client.0.smithi026.stderr:+ dir1=4 2024-04-21T09:27:46.625 INFO:tasks.workunit.client.0.smithi026.stderr:+ find 2/.snap/barsnap2/ -maxdepth 2 2024-04-21T09:27:46.625 INFO:tasks.workunit.client.0.smithi026.stderr:+ wc -w 2024-04-21T09:27:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:+ dir2=4 2024-04-21T09:27:46.649 INFO:tasks.workunit.client.0.smithi026.stderr:+ test 4==4 2024-04-21T09:27:46.650 INFO:tasks.workunit.client.0.smithi026.stdout:Success! 2024-04-21T09:27:46.650 INFO:tasks.workunit.client.0.smithi026.stdout:moving subtree to first folder 2024-04-21T09:27:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo Success! 2024-04-21T09:27:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo moving subtree to first folder 2024-04-21T09:27:46.650 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv 2/a/b/c 1 2024-04-21T09:27:46.657 INFO:tasks.workunit.client.0.smithi026.stdout:comparing snapshots and new tree 2024-04-21T09:27:46.658 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo comparing snapshots and new tree 2024-04-21T09:27:46.658 INFO:tasks.workunit.client.0.smithi026.stderr:+ find 1/ 2024-04-21T09:27:46.658 INFO:tasks.workunit.client.0.smithi026.stderr:+ wc -w 2024-04-21T09:27:46.680 INFO:tasks.workunit.client.0.smithi026.stderr:+ dir1=5 2024-04-21T09:27:46.680 INFO:tasks.workunit.client.0.smithi026.stderr:+ find 2/.snap/barsnap2/a/b/c 2024-04-21T09:27:46.680 INFO:tasks.workunit.client.0.smithi026.stderr:+ wc -w 2024-04-21T09:27:46.703 INFO:tasks.workunit.client.0.smithi026.stderr:+ dir2=4 2024-04-21T09:27:46.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ test 5==4 2024-04-21T09:27:46.704 INFO:tasks.workunit.client.0.smithi026.stdout:Success! 2024-04-21T09:27:46.704 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo Success! 2024-04-21T09:27:46.711 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir 1/.snap/foosnap1 2024-04-21T09:27:46.739 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir 2/.snap/barsnap2 2024-04-21T09:27:46.756 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:46.757 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:27:46.757 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:46.757 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:47.007 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-realm-split.sh... 2024-04-21T09:27:47.007 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-realm-split.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-realm-split.sh 2024-04-21T09:27:47.030 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:27:47.030 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir -p 1/a 2024-04-21T09:27:47.046 INFO:tasks.workunit.client.0.smithi026.stderr:+ exec 2024-04-21T09:27:47.047 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo -n a 2024-04-21T09:27:47.047 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 1/.snap/s1 2024-04-21T09:27:47.070 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo -n b 2024-04-21T09:27:47.074 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 2 2024-04-21T09:27:47.077 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv 1/a 2 2024-04-21T09:27:47.083 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir 2/.snap/s2 2024-04-21T09:27:47.159 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo -n c 2024-04-21T09:27:47.163 INFO:tasks.workunit.client.0.smithi026.stderr:+ exec 2024-04-21T09:27:47.163 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep ^a$ 1/.snap/s1/a/file1 2024-04-21T09:27:47.174 INFO:tasks.workunit.client.0.smithi026.stdout:a 2024-04-21T09:27:47.174 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep ^ab$ 2/.snap/s2/a/file1 2024-04-21T09:27:47.192 INFO:tasks.workunit.client.0.smithi026.stdout:ab 2024-04-21T09:27:47.192 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep ^abc$ 2/a/file1 2024-04-21T09:27:47.196 INFO:tasks.workunit.client.0.smithi026.stdout:abc 2024-04-21T09:27:47.196 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir 1/.snap/s1 2024-04-21T09:27:47.210 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir 2/.snap/s2 2024-04-21T09:27:47.225 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -rf 1 2 2024-04-21T09:27:47.294 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:47.295 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:27:47.295 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:47.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:47.376 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-snap-rename.sh... 2024-04-21T09:27:47.376 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-snap-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-snap-rename.sh 2024-04-21T09:27:47.439 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:27:47.439 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir -p d1/d2 2024-04-21T09:27:47.449 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir -p d1/d3 2024-04-21T09:27:47.454 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir d1/.snap/foo 2024-04-21T09:27:47.477 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir d1/d2/.snap/foo 2024-04-21T09:27:47.490 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir d1/d3/.snap/foo 2024-04-21T09:27:47.504 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir d1/d3/.snap/bar 2024-04-21T09:27:47.518 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv d1/d2/.snap/foo d1/d2/.snap/bar 2024-04-21T09:27:47.547 INFO:tasks.workunit.client.0.smithi026.stderr:+ expect_failure mv d1/d2/.snap/bar d1/d2/.snap/_bar 2024-04-21T09:27:47.547 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv d1/d2/.snap/bar d1/d2/.snap/_bar 2024-04-21T09:27:47.577 INFO:tasks.workunit.client.0.smithi026.stderr:mv: cannot move 'd1/d2/.snap/bar' to a subdirectory of itself, 'd1/d2/.snap/_bar' 2024-04-21T09:27:47.577 INFO:tasks.workunit.client.0.smithi026.stderr:+ return 0 2024-04-21T09:27:47.581 INFO:tasks.workunit.client.0.smithi026.stderr:+ expect_failure mv d1/d2/.snap/_foo_1099511669447 d1/d2/.snap/foo 2024-04-21T09:27:47.582 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv d1/d2/.snap/_foo_1099511669447 d1/d2/.snap/foo 2024-04-21T09:27:47.602 INFO:tasks.workunit.client.0.smithi026.stderr:mv: cannot move 'd1/d2/.snap/_foo_1099511669447' to a subdirectory of itself, 'd1/d2/.snap/foo' 2024-04-21T09:27:47.602 INFO:tasks.workunit.client.0.smithi026.stderr:+ return 0 2024-04-21T09:27:47.609 INFO:tasks.workunit.client.0.smithi026.stderr:+ expect_failure mv d1/d2/.snap/_foo_1099511669447 d1/d2/.snap/_foo_1 2024-04-21T09:27:47.609 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv d1/d2/.snap/_foo_1099511669447 d1/d2/.snap/_foo_1 2024-04-21T09:27:47.634 INFO:tasks.workunit.client.0.smithi026.stderr:mv: cannot move 'd1/d2/.snap/_foo_1099511669447' to a subdirectory of itself, 'd1/d2/.snap/_foo_1' 2024-04-21T09:27:47.634 INFO:tasks.workunit.client.0.smithi026.stderr:+ return 0 2024-04-21T09:27:47.634 INFO:tasks.workunit.client.0.smithi026.stderr:+ expect_failure mv d1/d2/.snap/bar d1/.snap/ 2024-04-21T09:27:47.634 INFO:tasks.workunit.client.0.smithi026.stderr:+ mv d1/d2/.snap/bar d1/.snap/ 2024-04-21T09:27:47.655 INFO:tasks.workunit.client.0.smithi026.stderr:mv: cannot move 'd1/d2/.snap/bar' to 'd1/.snap/bar': Read-only file system 2024-04-21T09:27:47.655 INFO:tasks.workunit.client.0.smithi026.stderr:+ return 0 2024-04-21T09:27:47.655 INFO:tasks.workunit.client.0.smithi026.stderr:+ expect_failure python3 -c import os; os.rename('d1/d3/.snap/foo', 'd1/d3/.snap/bar') 2024-04-21T09:27:47.655 INFO:tasks.workunit.client.0.smithi026.stderr:+ python3 -c import os; os.rename('d1/d3/.snap/foo', 'd1/d3/.snap/bar') 2024-04-21T09:27:47.683 INFO:tasks.workunit.client.0.smithi026.stderr:Traceback (most recent call last): 2024-04-21T09:27:47.683 INFO:tasks.workunit.client.0.smithi026.stderr: File "", line 1, in 2024-04-21T09:27:47.683 INFO:tasks.workunit.client.0.smithi026.stderr:FileExistsError: [Errno 17] File exists: 'd1/d3/.snap/foo' -> 'd1/d3/.snap/bar' 2024-04-21T09:27:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ return 0 2024-04-21T09:27:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ expect_failure python3 -c import os; os.rename('d1/.snap/foo', 'd1/foo') 2024-04-21T09:27:47.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ python3 -c import os; os.rename('d1/.snap/foo', 'd1/foo') 2024-04-21T09:27:47.713 INFO:tasks.workunit.client.0.smithi026.stderr:Traceback (most recent call last): 2024-04-21T09:27:47.713 INFO:tasks.workunit.client.0.smithi026.stderr: File "", line 1, in 2024-04-21T09:27:47.714 INFO:tasks.workunit.client.0.smithi026.stderr:OSError: [Errno 18] Invalid cross-device link: 'd1/.snap/foo' -> 'd1/foo' 2024-04-21T09:27:47.718 INFO:tasks.workunit.client.0.smithi026.stderr:+ return 0 2024-04-21T09:27:47.718 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir d1/.snap/foo 2024-04-21T09:27:47.732 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir d1/d2/.snap/bar 2024-04-21T09:27:47.746 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir d1/d3/.snap/foo 2024-04-21T09:27:47.762 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir d1/d3/.snap/bar 2024-04-21T09:27:47.776 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -rf d1 2024-04-21T09:27:47.836 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:27:47.836 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:27:47.837 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:27:47.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:27:47.964 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-snap-rm-cmp.sh... 2024-04-21T09:27:47.964 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-snap-rm-cmp.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-snap-rm-cmp.sh 2024-04-21T09:27:48.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:27:48.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ file=linux-2.6.33.tar.bz2 2024-04-21T09:27:48.014 INFO:tasks.workunit.client.0.smithi026.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-04-21T09:27:52.035 INFO:tasks.workunit.client.0.smithi026.stderr:+ + awk {print $1} 2024-04-21T09:27:52.035 INFO:tasks.workunit.client.0.smithi026.stderr:md5sum linux-2.6.33.tar.bz2 2024-04-21T09:27:52.620 INFO:tasks.workunit.client.0.smithi026.stderr:+ real=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:27:52.620 INFO:tasks.workunit.client.0.smithi026.stderr:+ seq 1 20 2024-04-21T09:27:52.620 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 1 2024-04-21T09:27:52.621 INFO:tasks.workunit.client.0.smithi026.stdout:1 2024-04-21T09:27:52.621 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:27:52.773 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:27:52.801 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:27:52.808 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:27:57.540 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:27:57.540 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:27:57.661 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:27:57.661 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:27:57.661 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:27:57.682 INFO:tasks.workunit.client.0.smithi026.stdout:2 2024-04-21T09:27:57.682 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 2 2024-04-21T09:27:57.682 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:27:57.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:27:57.884 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:27:57.896 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:02.830 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:02.831 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:02.957 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:02.958 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:02.958 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:02.981 INFO:tasks.workunit.client.0.smithi026.stdout:3 2024-04-21T09:28:02.982 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 3 2024-04-21T09:28:02.982 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:03.130 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:03.145 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:03.153 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:04.259 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:04.259 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:04.379 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:04.379 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:04.379 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:04.403 INFO:tasks.workunit.client.0.smithi026.stdout:4 2024-04-21T09:28:04.404 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 4 2024-04-21T09:28:04.404 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:04.564 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:04.588 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:04.597 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:05.247 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:05.247 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:05.367 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:05.367 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:05.367 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:05.388 INFO:tasks.workunit.client.0.smithi026.stdout:5 2024-04-21T09:28:05.388 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 5 2024-04-21T09:28:05.389 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:05.537 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:05.562 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:05.571 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:06.303 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:06.304 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:06.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:06.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:06.423 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:06.451 INFO:tasks.workunit.client.0.smithi026.stdout:6 2024-04-21T09:28:06.451 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 6 2024-04-21T09:28:06.451 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:06.605 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:06.632 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:06.646 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:07.291 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:07.291 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:07.411 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:07.411 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:07.411 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:07.433 INFO:tasks.workunit.client.0.smithi026.stdout:7 2024-04-21T09:28:07.433 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 7 2024-04-21T09:28:07.433 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:07.601 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:07.623 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:07.634 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:08.352 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:08.362 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:08.525 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:08.525 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:08.525 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:08.557 INFO:tasks.workunit.client.0.smithi026.stdout:8 2024-04-21T09:28:08.558 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 8 2024-04-21T09:28:08.558 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:08.811 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:08.836 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:08.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:12.821 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:12.821 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:12.939 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:12.939 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:12.940 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:12.964 INFO:tasks.workunit.client.0.smithi026.stdout:9 2024-04-21T09:28:12.965 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 9 2024-04-21T09:28:12.965 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:13.125 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:13.153 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:13.165 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:13.862 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:13.862 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:13.980 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:13.980 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:13.980 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:14.012 INFO:tasks.workunit.client.0.smithi026.stdout:10 2024-04-21T09:28:14.012 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 10 2024-04-21T09:28:14.012 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:14.178 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:14.196 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:14.205 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:18.329 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:18.329 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:18.447 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:18.447 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:18.447 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:18.473 INFO:tasks.workunit.client.0.smithi026.stdout:11 2024-04-21T09:28:18.473 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 11 2024-04-21T09:28:18.473 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:18.638 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:18.654 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:18.663 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:19.315 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:19.315 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:19.432 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:19.432 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:19.432 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:19.455 INFO:tasks.workunit.client.0.smithi026.stdout:12 2024-04-21T09:28:19.455 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 12 2024-04-21T09:28:19.455 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:19.606 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:19.636 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:19.645 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:22.785 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:22.785 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:22.905 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:22.905 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:22.905 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:22.949 INFO:tasks.workunit.client.0.smithi026.stdout:13 2024-04-21T09:28:22.950 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 13 2024-04-21T09:28:22.950 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:23.128 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:23.148 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:23.156 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:23.677 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:23.677 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:23.795 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:23.795 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:23.795 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:23.820 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 14 2024-04-21T09:28:23.820 INFO:tasks.workunit.client.0.smithi026.stdout:14 2024-04-21T09:28:23.820 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:23.986 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:24.016 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:24.024 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:27.819 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:27.820 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:27.940 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:27.977 INFO:tasks.workunit.client.0.smithi026.stdout:15 2024-04-21T09:28:27.978 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 15 2024-04-21T09:28:27.978 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:28.172 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:28.204 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:28.225 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:32.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:32.854 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:32.971 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:32.971 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:32.971 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:33.001 INFO:tasks.workunit.client.0.smithi026.stdout:16 2024-04-21T09:28:33.001 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 16 2024-04-21T09:28:33.001 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:33.183 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:33.214 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:33.233 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:33.875 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:33.875 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:33.994 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:33.994 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:33.994 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:34.022 INFO:tasks.workunit.client.0.smithi026.stdout:17 2024-04-21T09:28:34.023 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 17 2024-04-21T09:28:34.023 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:34.191 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:34.214 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:34.222 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:34.828 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:34.829 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:34.947 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:34.947 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:34.947 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:34.975 INFO:tasks.workunit.client.0.smithi026.stdout:18 2024-04-21T09:28:34.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 18 2024-04-21T09:28:34.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:35.135 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:35.155 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:35.165 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:37.856 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:37.857 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:37.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:37.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:37.975 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:38.010 INFO:tasks.workunit.client.0.smithi026.stdout:19 2024-04-21T09:28:38.011 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 19 2024-04-21T09:28:38.011 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:38.249 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:38.266 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:38.284 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:38.991 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:38.991 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:39.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:39.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:39.097 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:39.127 INFO:tasks.workunit.client.0.smithi026.stdout:20 2024-04-21T09:28:39.128 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo 20 2024-04-21T09:28:39.128 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp linux-2.6.33.tar.bz2 a 2024-04-21T09:28:39.293 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s 2024-04-21T09:28:39.322 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm a 2024-04-21T09:28:39.330 INFO:tasks.workunit.client.0.smithi026.stderr:+ cp .snap/s/a /tmp/a 2024-04-21T09:28:39.931 INFO:tasks.workunit.client.0.smithi026.stderr:+ md5sum /tmp/a 2024-04-21T09:28:39.931 INFO:tasks.workunit.client.0.smithi026.stderr:+ awk {print $1} 2024-04-21T09:28:40.051 INFO:tasks.workunit.client.0.smithi026.stderr:+ cur=c3883760b18d50e8d78819c54d579b00 2024-04-21T09:28:40.051 INFO:tasks.workunit.client.0.smithi026.stderr:+ [ c3883760b18d50e8d78819c54d579b00 != c3883760b18d50e8d78819c54d579b00 ] 2024-04-21T09:28:40.051 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s 2024-04-21T09:28:40.077 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm linux-2.6.33.tar.bz2 2024-04-21T09:28:40.094 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:28:40.094 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:28:40.133 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-upchildrealms.sh... 2024-04-21T09:28:40.133 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-upchildrealms.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-upchildrealms.sh 2024-04-21T09:28:40.194 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:28:40.194 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:28:40.200 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/b 2024-04-21T09:28:40.206 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/a1 2024-04-21T09:28:40.232 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/b/.snap/b1 2024-04-21T09:28:40.252 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo asdf 2024-04-21T09:28:40.252 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/a2 2024-04-21T09:28:40.270 INFO:tasks.workunit.client.0.smithi026.stderr:+ ln a/b/foo a/b/bar 2024-04-21T09:28:40.280 INFO:tasks.workunit.client.0.smithi026.stdout:this should not hang... 2024-04-21T09:28:40.281 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo this should not hang... 2024-04-21T09:28:40.298 INFO:tasks.workunit.client.0.smithi026.stderr:+ cat a/b/.snap/_a2_1099511669473/foo 2024-04-21T09:28:40.302 INFO:tasks.workunit.client.0.smithi026.stdout:asdf 2024-04-21T09:28:40.303 INFO:tasks.workunit.client.0.smithi026.stdout:good, it did not hang. 2024-04-21T09:28:40.303 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo good, it did not hang. 2024-04-21T09:28:40.303 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/b/.snap/b1 2024-04-21T09:28:40.318 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/a1 2024-04-21T09:28:40.333 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/a2 2024-04-21T09:28:40.347 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -r a 2024-04-21T09:28:40.395 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:28:40.396 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:28:40.396 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:28:40.397 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:28:40.472 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-xattrwb.sh... 2024-04-21T09:28:40.473 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/snaptest-xattrwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-xattrwb.sh 2024-04-21T09:28:40.538 INFO:tasks.workunit.client.0.smithi026.stderr:+ set -e 2024-04-21T09:28:40.538 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo testing simple xattr wb 2024-04-21T09:28:40.538 INFO:tasks.workunit.client.0.smithi026.stderr:+ touch x 2024-04-21T09:28:40.539 INFO:tasks.workunit.client.0.smithi026.stdout:testing simple xattr wb 2024-04-21T09:28:40.544 INFO:tasks.workunit.client.0.smithi026.stderr:+ setfattr -n user.foo x 2024-04-21T09:28:40.565 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/s1 2024-04-21T09:28:40.584 INFO:tasks.workunit.client.0.smithi026.stderr:+ getfattr -n+ user.foo .snap/s1/x 2024-04-21T09:28:40.584 INFO:tasks.workunit.client.0.smithi026.stderr:grep user.foo 2024-04-21T09:28:40.607 INFO:tasks.workunit.client.0.smithi026.stdout:user.foo="" 2024-04-21T09:28:40.607 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm x 2024-04-21T09:28:40.614 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir .snap/s1 2024-04-21T09:28:40.635 INFO:tasks.workunit.client.0.smithi026.stdout:testing wb with pre-wb server cow 2024-04-21T09:28:40.635 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo testing wb with pre-wb server cow 2024-04-21T09:28:40.635 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a 2024-04-21T09:28:40.639 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/b 2024-04-21T09:28:40.644 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/b/c 2024-04-21T09:28:40.649 INFO:tasks.workunit.client.0.smithi026.stderr:+ setfattr -n user.foo a/b 2024-04-21T09:28:40.654 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/.snap/s 2024-04-21T09:28:40.686 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir a/b/cc 2024-04-21T09:28:40.690 INFO:tasks.workunit.client.0.smithi026.stderr:+ getfattr -n user.foo a/b 2024-04-21T09:28:40.692 INFO:tasks.workunit.client.0.smithi026.stdout:# file: a/b 2024-04-21T09:28:40.692 INFO:tasks.workunit.client.0.smithi026.stdout:user.foo="" 2024-04-21T09:28:40.692 INFO:tasks.workunit.client.0.smithi026.stdout: 2024-04-21T09:28:40.693 INFO:tasks.workunit.client.0.smithi026.stderr:+ getfattr -n user.foo a/.snap/s/b 2024-04-21T09:28:40.693 INFO:tasks.workunit.client.0.smithi026.stderr:+ grep user.foo 2024-04-21T09:28:40.707 INFO:tasks.workunit.client.0.smithi026.stdout:user.foo="" 2024-04-21T09:28:40.707 INFO:tasks.workunit.client.0.smithi026.stderr:+ rmdir a/.snap/s 2024-04-21T09:28:40.721 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -r a 2024-04-21T09:28:40.768 INFO:tasks.workunit.client.0.smithi026.stdout:OK 2024-04-21T09:28:40.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ echo OK 2024-04-21T09:28:40.769 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-21T09:28:40.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-21T09:28:40.841 INFO:tasks.workunit:Running workunit fs/snaps/untar_snap_rm.sh... 2024-04-21T09:28:40.841 DEBUG:teuthology.orchestra.run.smithi026:workunit test fs/snaps/untar_snap_rm.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh 2024-04-21T09:28:40.904 INFO:tasks.workunit.client.0.smithi026.stderr:+ do_tarball coreutils_8.5.orig.tar.gz z coreutils-8.5 2024-04-21T09:28:40.904 INFO:tasks.workunit.client.0.smithi026.stderr:+ wget http://download.ceph.com/qa/coreutils_8.5.orig.tar.gz 2024-04-21T09:28:40.907 INFO:tasks.workunit.client.0.smithi026.stderr:--2024-04-21 09:28:40-- http://download.ceph.com/qa/coreutils_8.5.orig.tar.gz 2024-04-21T09:28:40.908 INFO:tasks.workunit.client.0.smithi026.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2024-04-21T09:28:40.944 INFO:tasks.workunit.client.0.smithi026.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2024-04-21T09:28:40.979 INFO:tasks.workunit.client.0.smithi026.stderr:HTTP request sent, awaiting response... 200 OK 2024-04-21T09:28:40.980 INFO:tasks.workunit.client.0.smithi026.stderr:Length: 10740866 (10M) [application/octet-stream] 2024-04-21T09:28:40.983 INFO:tasks.workunit.client.0.smithi026.stderr:Saving to: 'coreutils_8.5.orig.tar.gz' 2024-04-21T09:28:40.984 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T09:28:41.052 INFO:tasks.workunit.client.0.smithi026.stderr: 0K .......... .......... .......... .......... .......... 0% 734K 14s 2024-04-21T09:28:41.087 INFO:tasks.workunit.client.0.smithi026.stderr: 50K .......... .......... .......... .......... .......... 0% 1.42M 11s 2024-04-21T09:28:41.093 INFO:tasks.workunit.client.0.smithi026.stderr: 100K .......... .......... .......... .......... .......... 1% 9.42M 7s 2024-04-21T09:28:41.124 INFO:tasks.workunit.client.0.smithi026.stderr: 150K .......... .......... .......... .......... .......... 1% 1.61M 7s 2024-04-21T09:28:41.129 INFO:tasks.workunit.client.0.smithi026.stderr: 200K .......... .......... .......... .......... .......... 2% 7.52M 6s 2024-04-21T09:28:41.134 INFO:tasks.workunit.client.0.smithi026.stderr: 250K .......... .......... .......... .......... .......... 2% 8.81M 5s 2024-04-21T09:28:41.140 INFO:tasks.workunit.client.0.smithi026.stderr: 300K .......... .......... .......... .......... .......... 3% 9.53M 4s 2024-04-21T09:28:41.158 INFO:tasks.workunit.client.0.smithi026.stderr: 350K .......... .......... .......... .......... .......... 3% 2.65M 4s 2024-04-21T09:28:41.163 INFO:tasks.workunit.client.0.smithi026.stderr: 400K .......... .......... .......... .......... .......... 4% 8.88M 4s 2024-04-21T09:28:41.168 INFO:tasks.workunit.client.0.smithi026.stderr: 450K .......... .......... .......... .......... .......... 4% 9.48M 4s 2024-04-21T09:28:41.174 INFO:tasks.workunit.client.0.smithi026.stderr: 500K .......... .......... .......... .......... .......... 5% 9.54M 3s 2024-04-21T09:28:41.179 INFO:tasks.workunit.client.0.smithi026.stderr: 550K .......... .......... .......... .......... .......... 5% 8.24M 3s 2024-04-21T09:28:41.185 INFO:tasks.workunit.client.0.smithi026.stderr: 600K .......... .......... .......... .......... .......... 6% 9.26M 3s 2024-04-21T09:28:41.191 INFO:tasks.workunit.client.0.smithi026.stderr: 650K .......... .......... .......... .......... .......... 6% 8.65M 3s 2024-04-21T09:28:41.197 INFO:tasks.workunit.client.0.smithi026.stderr: 700K .......... .......... .......... .......... .......... 7% 8.72M 3s 2024-04-21T09:28:41.202 INFO:tasks.workunit.client.0.smithi026.stderr: 750K .......... .......... .......... .......... .......... 7% 8.21M 3s 2024-04-21T09:28:41.207 INFO:tasks.workunit.client.0.smithi026.stderr: 800K .......... .......... .......... .......... .......... 8% 9.59M 3s 2024-04-21T09:28:41.212 INFO:tasks.workunit.client.0.smithi026.stderr: 850K .......... .......... .......... .......... .......... 8% 10.0M 2s 2024-04-21T09:28:41.218 INFO:tasks.workunit.client.0.smithi026.stderr: 900K .......... .......... .......... .......... .......... 9% 9.23M 2s 2024-04-21T09:28:41.224 INFO:tasks.workunit.client.0.smithi026.stderr: 950K .......... .......... .......... .......... .......... 9% 7.56M 2s 2024-04-21T09:28:41.230 INFO:tasks.workunit.client.0.smithi026.stderr: 1000K .......... .......... .......... .......... .......... 10% 8.35M 2s 2024-04-21T09:28:41.235 INFO:tasks.workunit.client.0.smithi026.stderr: 1050K .......... .......... .......... .......... .......... 10% 8.99M 2s 2024-04-21T09:28:41.241 INFO:tasks.workunit.client.0.smithi026.stderr: 1100K .......... .......... .......... .......... .......... 10% 8.90M 2s 2024-04-21T09:28:41.247 INFO:tasks.workunit.client.0.smithi026.stderr: 1150K .......... .......... .......... .......... .......... 11% 7.93M 2s 2024-04-21T09:28:41.252 INFO:tasks.workunit.client.0.smithi026.stderr: 1200K .......... .......... .......... .......... .......... 11% 9.28M 2s 2024-04-21T09:28:41.258 INFO:tasks.workunit.client.0.smithi026.stderr: 1250K .......... .......... .......... .......... .......... 12% 8.17M 2s 2024-04-21T09:28:41.265 INFO:tasks.workunit.client.0.smithi026.stderr: 1300K .......... .......... .......... .......... .......... 12% 8.20M 2s 2024-04-21T09:28:41.271 INFO:tasks.workunit.client.0.smithi026.stderr: 1350K .......... .......... .......... .......... .......... 13% 7.14M 2s 2024-04-21T09:28:41.276 INFO:tasks.workunit.client.0.smithi026.stderr: 1400K .......... .......... .......... .......... .......... 13% 8.64M 2s 2024-04-21T09:28:41.282 INFO:tasks.workunit.client.0.smithi026.stderr: 1450K .......... .......... .......... .......... .......... 14% 8.75M 2s 2024-04-21T09:28:41.288 INFO:tasks.workunit.client.0.smithi026.stderr: 1500K .......... .......... .......... .......... .......... 14% 8.87M 2s 2024-04-21T09:28:41.294 INFO:tasks.workunit.client.0.smithi026.stderr: 1550K .......... .......... .......... .......... .......... 15% 7.24M 2s 2024-04-21T09:28:41.300 INFO:tasks.workunit.client.0.smithi026.stderr: 1600K .......... .......... .......... .......... .......... 15% 7.89M 2s 2024-04-21T09:28:41.307 INFO:tasks.workunit.client.0.smithi026.stderr: 1650K .......... .......... .......... .......... .......... 16% 7.91M 2s 2024-04-21T09:28:41.314 INFO:tasks.workunit.client.0.smithi026.stderr: 1700K .......... .......... .......... .......... .......... 16% 8.04M 2s 2024-04-21T09:28:41.320 INFO:tasks.workunit.client.0.smithi026.stderr: 1750K .......... .......... .......... .......... .......... 17% 6.75M 2s 2024-04-21T09:28:41.326 INFO:tasks.workunit.client.0.smithi026.stderr: 1800K .......... .......... .......... .......... .......... 17% 8.29M 2s 2024-04-21T09:28:41.332 INFO:tasks.workunit.client.0.smithi026.stderr: 1850K .......... .......... .......... .......... .......... 18% 7.88M 2s 2024-04-21T09:28:41.340 INFO:tasks.workunit.client.0.smithi026.stderr: 1900K .......... .......... .......... .......... .......... 18% 7.77M 2s 2024-04-21T09:28:41.346 INFO:tasks.workunit.client.0.smithi026.stderr: 1950K .......... .......... .......... .......... .......... 19% 6.26M 2s 2024-04-21T09:28:41.353 INFO:tasks.workunit.client.0.smithi026.stderr: 2000K .......... .......... .......... .......... .......... 19% 7.78M 2s 2024-04-21T09:28:41.359 INFO:tasks.workunit.client.0.smithi026.stderr: 2050K .......... .......... .......... .......... .......... 20% 7.24M 1s 2024-04-21T09:28:41.366 INFO:tasks.workunit.client.0.smithi026.stderr: 2100K .......... .......... .......... .......... .......... 20% 8.03M 1s 2024-04-21T09:28:41.372 INFO:tasks.workunit.client.0.smithi026.stderr: 2150K .......... .......... .......... .......... .......... 20% 7.51M 1s 2024-04-21T09:28:41.378 INFO:tasks.workunit.client.0.smithi026.stderr: 2200K .......... .......... .......... .......... .......... 21% 8.14M 1s 2024-04-21T09:28:41.384 INFO:tasks.workunit.client.0.smithi026.stderr: 2250K .......... .......... .......... .......... .......... 21% 7.88M 1s 2024-04-21T09:28:41.392 INFO:tasks.workunit.client.0.smithi026.stderr: 2300K .......... .......... .......... .......... .......... 22% 7.17M 1s 2024-04-21T09:28:41.398 INFO:tasks.workunit.client.0.smithi026.stderr: 2350K .......... .......... .......... .......... .......... 22% 6.42M 1s 2024-04-21T09:28:41.405 INFO:tasks.workunit.client.0.smithi026.stderr: 2400K .......... .......... .......... .......... .......... 23% 7.45M 1s 2024-04-21T09:28:41.412 INFO:tasks.workunit.client.0.smithi026.stderr: 2450K .......... .......... .......... .......... .......... 23% 7.20M 1s 2024-04-21T09:28:41.420 INFO:tasks.workunit.client.0.smithi026.stderr: 2500K .......... .......... .......... .......... .......... 24% 6.91M 1s 2024-04-21T09:28:41.426 INFO:tasks.workunit.client.0.smithi026.stderr: 2550K .......... .......... .......... .......... .......... 24% 6.50M 1s 2024-04-21T09:28:41.433 INFO:tasks.workunit.client.0.smithi026.stderr: 2600K .......... .......... .......... .......... .......... 25% 7.59M 1s 2024-04-21T09:28:41.439 INFO:tasks.workunit.client.0.smithi026.stderr: 2650K .......... .......... .......... .......... .......... 25% 7.73M 1s 2024-04-21T09:28:41.448 INFO:tasks.workunit.client.0.smithi026.stderr: 2700K .......... .......... .......... .......... .......... 26% 6.84M 1s 2024-04-21T09:28:41.455 INFO:tasks.workunit.client.0.smithi026.stderr: 2750K .......... .......... .......... .......... .......... 26% 5.85M 1s 2024-04-21T09:28:41.461 INFO:tasks.workunit.client.0.smithi026.stderr: 2800K .......... .......... .......... .......... .......... 27% 7.32M 1s 2024-04-21T09:28:41.468 INFO:tasks.workunit.client.0.smithi026.stderr: 2850K .......... .......... .......... .......... .......... 27% 6.78M 1s 2024-04-21T09:28:41.476 INFO:tasks.workunit.client.0.smithi026.stderr: 2900K .......... .......... .......... .......... .......... 28% 7.66M 1s 2024-04-21T09:28:41.482 INFO:tasks.workunit.client.0.smithi026.stderr: 2950K .......... .......... .......... .......... .......... 28% 6.45M 1s 2024-04-21T09:28:41.489 INFO:tasks.workunit.client.0.smithi026.stderr: 3000K .......... .......... .......... .......... .......... 29% 6.95M 1s 2024-04-21T09:28:41.497 INFO:tasks.workunit.client.0.smithi026.stderr: 3050K .......... .......... .......... .......... .......... 29% 6.78M 1s 2024-04-21T09:28:41.505 INFO:tasks.workunit.client.0.smithi026.stderr: 3100K .......... .......... .......... .......... .......... 30% 6.98M 1s 2024-04-21T09:28:41.513 INFO:tasks.workunit.client.0.smithi026.stderr: 3150K .......... .......... .......... .......... .......... 30% 5.45M 1s 2024-04-21T09:28:41.520 INFO:tasks.workunit.client.0.smithi026.stderr: 3200K .......... .......... .......... .......... .......... 30% 6.94M 1s 2024-04-21T09:28:41.527 INFO:tasks.workunit.client.0.smithi026.stderr: 3250K .......... .......... .......... .......... .......... 31% 6.64M 1s 2024-04-21T09:28:41.536 INFO:tasks.workunit.client.0.smithi026.stderr: 3300K .......... .......... .......... .......... .......... 31% 6.61M 1s 2024-04-21T09:28:41.543 INFO:tasks.workunit.client.0.smithi026.stderr: 3350K .......... .......... .......... .......... .......... 32% 5.74M 1s 2024-04-21T09:28:41.551 INFO:tasks.workunit.client.0.smithi026.stderr: 3400K .......... .......... .......... .......... .......... 32% 6.41M 1s 2024-04-21T09:28:41.559 INFO:tasks.workunit.client.0.smithi026.stderr: 3450K .......... .......... .......... .......... .......... 33% 6.06M 1s 2024-04-21T09:28:41.568 INFO:tasks.workunit.client.0.smithi026.stderr: 3500K .......... .......... .......... .......... .......... 33% 6.34M 1s 2024-04-21T09:28:41.575 INFO:tasks.workunit.client.0.smithi026.stderr: 3550K .......... .......... .......... .......... .......... 34% 5.62M 1s 2024-04-21T09:28:41.583 INFO:tasks.workunit.client.0.smithi026.stderr: 3600K .......... .......... .......... .......... .......... 34% 6.50M 1s 2024-04-21T09:28:41.590 INFO:tasks.workunit.client.0.smithi026.stderr: 3650K .......... .......... .......... .......... .......... 35% 6.55M 1s 2024-04-21T09:28:41.598 INFO:tasks.workunit.client.0.smithi026.stderr: 3700K .......... .......... .......... .......... .......... 35% 6.58M 1s 2024-04-21T09:28:41.606 INFO:tasks.workunit.client.0.smithi026.stderr: 3750K .......... .......... .......... .......... .......... 36% 5.89M 1s 2024-04-21T09:28:41.613 INFO:tasks.workunit.client.0.smithi026.stderr: 3800K .......... .......... .......... .......... .......... 36% 6.92M 1s 2024-04-21T09:28:41.620 INFO:tasks.workunit.client.0.smithi026.stderr: 3850K .......... .......... .......... .......... .......... 37% 6.98M 1s 2024-04-21T09:28:41.629 INFO:tasks.workunit.client.0.smithi026.stderr: 3900K .......... .......... .......... .......... .......... 37% 6.45M 1s 2024-04-21T09:28:41.636 INFO:tasks.workunit.client.0.smithi026.stderr: 3950K .......... .......... .......... .......... .......... 38% 5.39M 1s 2024-04-21T09:28:41.644 INFO:tasks.workunit.client.0.smithi026.stderr: 4000K .......... .......... .......... .......... .......... 38% 6.56M 1s 2024-04-21T09:28:41.651 INFO:tasks.workunit.client.0.smithi026.stderr: 4050K .......... .......... .......... .......... .......... 39% 6.72M 1s 2024-04-21T09:28:41.656 INFO:tasks.workunit.client.0.smithi026.stderr: 4100K .......... .......... .......... .......... .......... 39% 10.1M 1s 2024-04-21T09:28:41.661 INFO:tasks.workunit.client.0.smithi026.stderr: 4150K .......... .......... .......... .......... .......... 40% 10.0M 1s 2024-04-21T09:28:41.665 INFO:tasks.workunit.client.0.smithi026.stderr: 4200K .......... .......... .......... .......... .......... 40% 10.8M 1s 2024-04-21T09:28:41.671 INFO:tasks.workunit.client.0.smithi026.stderr: 4250K .......... .......... .......... .......... .......... 40% 8.89M 1s 2024-04-21T09:28:41.689 INFO:tasks.workunit.client.0.smithi026.stderr: 4300K .......... .......... .......... .......... .......... 41% 4.04M 1s 2024-04-21T09:28:41.714 INFO:tasks.workunit.client.0.smithi026.stderr: 4350K .......... .......... .......... .......... .......... 41% 1.70M 1s 2024-04-21T09:28:41.719 INFO:tasks.workunit.client.0.smithi026.stderr: 4400K .......... .......... .......... .......... .......... 42% 6.55M 1s 2024-04-21T09:28:41.722 INFO:tasks.workunit.client.0.smithi026.stderr: 4450K .......... .......... .......... .......... .......... 42% 12.9M 1s 2024-04-21T09:28:41.727 INFO:tasks.workunit.client.0.smithi026.stderr: 4500K .......... .......... .......... .......... .......... 43% 12.7M 1s 2024-04-21T09:28:41.735 INFO:tasks.workunit.client.0.smithi026.stderr: 4550K .......... .......... .......... .......... .......... 43% 5.41M 1s 2024-04-21T09:28:41.740 INFO:tasks.workunit.client.0.smithi026.stderr: 4600K .......... .......... .......... .......... .......... 44% 11.0M 1s 2024-04-21T09:28:41.744 INFO:tasks.workunit.client.0.smithi026.stderr: 4650K .......... .......... .......... .......... .......... 44% 12.0M 1s 2024-04-21T09:28:41.748 INFO:tasks.workunit.client.0.smithi026.stderr: 4700K .......... .......... .......... .......... .......... 45% 13.6M 1s 2024-04-21T09:28:41.751 INFO:tasks.workunit.client.0.smithi026.stderr: 4750K .......... .......... .......... .......... .......... 45% 11.9M 1s 2024-04-21T09:28:41.755 INFO:tasks.workunit.client.0.smithi026.stderr: 4800K .......... .......... .......... .......... .......... 46% 13.8M 1s 2024-04-21T09:28:41.759 INFO:tasks.workunit.client.0.smithi026.stderr: 4850K .......... .......... .......... .......... .......... 46% 12.1M 1s 2024-04-21T09:28:41.763 INFO:tasks.workunit.client.0.smithi026.stderr: 4900K .......... .......... .......... .......... .......... 47% 13.6M 1s 2024-04-21T09:28:41.766 INFO:tasks.workunit.client.0.smithi026.stderr: 4950K .......... .......... .......... .......... .......... 47% 12.4M 1s 2024-04-21T09:28:41.770 INFO:tasks.workunit.client.0.smithi026.stderr: 5000K .......... .......... .......... .......... .......... 48% 13.2M 1s 2024-04-21T09:28:41.774 INFO:tasks.workunit.client.0.smithi026.stderr: 5050K .......... .......... .......... .......... .......... 48% 13.6M 1s 2024-04-21T09:28:41.779 INFO:tasks.workunit.client.0.smithi026.stderr: 5100K .......... .......... .......... .......... .......... 49% 11.6M 1s 2024-04-21T09:28:41.785 INFO:tasks.workunit.client.0.smithi026.stderr: 5150K .......... .......... .......... .......... .......... 49% 6.82M 1s 2024-04-21T09:28:41.789 INFO:tasks.workunit.client.0.smithi026.stderr: 5200K .......... .......... .......... .......... .......... 50% 13.2M 1s 2024-04-21T09:28:41.792 INFO:tasks.workunit.client.0.smithi026.stderr: 5250K .......... .......... .......... .......... .......... 50% 14.9M 1s 2024-04-21T09:28:41.796 INFO:tasks.workunit.client.0.smithi026.stderr: 5300K .......... .......... .......... .......... .......... 51% 13.6M 1s 2024-04-21T09:28:41.800 INFO:tasks.workunit.client.0.smithi026.stderr: 5350K .......... .......... .......... .......... .......... 51% 11.2M 1s 2024-04-21T09:28:41.804 INFO:tasks.workunit.client.0.smithi026.stderr: 5400K .......... .......... .......... .......... .......... 51% 13.3M 1s 2024-04-21T09:28:41.807 INFO:tasks.workunit.client.0.smithi026.stderr: 5450K .......... .......... .......... .......... .......... 52% 13.0M 1s 2024-04-21T09:28:41.812 INFO:tasks.workunit.client.0.smithi026.stderr: 5500K .......... .......... .......... .......... .......... 52% 13.0M 1s 2024-04-21T09:28:41.816 INFO:tasks.workunit.client.0.smithi026.stderr: 5550K .......... .......... .......... .......... .......... 53% 10.9M 1s 2024-04-21T09:28:41.819 INFO:tasks.workunit.client.0.smithi026.stderr: 5600K .......... .......... .......... .......... .......... 53% 13.0M 1s 2024-04-21T09:28:41.823 INFO:tasks.workunit.client.0.smithi026.stderr: 5650K .......... .......... .......... .......... .......... 54% 14.0M 1s 2024-04-21T09:28:41.827 INFO:tasks.workunit.client.0.smithi026.stderr: 5700K .......... .......... .......... .......... .......... 54% 13.0M 1s 2024-04-21T09:28:41.831 INFO:tasks.workunit.client.0.smithi026.stderr: 5750K .......... .......... .......... .......... .......... 55% 11.1M 1s 2024-04-21T09:28:41.835 INFO:tasks.workunit.client.0.smithi026.stderr: 5800K .......... .......... .......... .......... .......... 55% 12.5M 1s 2024-04-21T09:28:41.839 INFO:tasks.workunit.client.0.smithi026.stderr: 5850K .......... .......... .......... .......... .......... 56% 13.1M 1s 2024-04-21T09:28:41.843 INFO:tasks.workunit.client.0.smithi026.stderr: 5900K .......... .......... .......... .......... .......... 56% 12.2M 1s 2024-04-21T09:28:41.847 INFO:tasks.workunit.client.0.smithi026.stderr: 5950K .......... .......... .......... .......... .......... 57% 10.6M 1s 2024-04-21T09:28:41.852 INFO:tasks.workunit.client.0.smithi026.stderr: 6000K .......... .......... .......... .......... .......... 57% 10.9M 1s 2024-04-21T09:28:41.856 INFO:tasks.workunit.client.0.smithi026.stderr: 6050K .......... .......... .......... .......... .......... 58% 12.5M 1s 2024-04-21T09:28:41.860 INFO:tasks.workunit.client.0.smithi026.stderr: 6100K .......... .......... .......... .......... .......... 58% 11.4M 1s 2024-04-21T09:28:41.865 INFO:tasks.workunit.client.0.smithi026.stderr: 6150K .......... .......... .......... .......... .......... 59% 10.4M 1s 2024-04-21T09:28:41.869 INFO:tasks.workunit.client.0.smithi026.stderr: 6200K .......... .......... .......... .......... .......... 59% 10.4M 1s 2024-04-21T09:28:41.874 INFO:tasks.workunit.client.0.smithi026.stderr: 6250K .......... .......... .......... .......... .......... 60% 11.5M 1s 2024-04-21T09:28:41.879 INFO:tasks.workunit.client.0.smithi026.stderr: 6300K .......... .......... .......... .......... .......... 60% 10.2M 1s 2024-04-21T09:28:41.885 INFO:tasks.workunit.client.0.smithi026.stderr: 6350K .......... .......... .......... .......... .......... 61% 8.36M 1s 2024-04-21T09:28:41.890 INFO:tasks.workunit.client.0.smithi026.stderr: 6400K .......... .......... .......... .......... .......... 61% 10.0M 1s 2024-04-21T09:28:41.895 INFO:tasks.workunit.client.0.smithi026.stderr: 6450K .......... .......... .......... .......... .......... 61% 9.29M 1s 2024-04-21T09:28:41.900 INFO:tasks.workunit.client.0.smithi026.stderr: 6500K .......... .......... .......... .......... .......... 62% 9.35M 1s 2024-04-21T09:28:41.905 INFO:tasks.workunit.client.0.smithi026.stderr: 6550K .......... .......... .......... .......... .......... 62% 8.94M 1s 2024-04-21T09:28:41.911 INFO:tasks.workunit.client.0.smithi026.stderr: 6600K .......... .......... .......... .......... .......... 63% 9.05M 1s 2024-04-21T09:28:41.916 INFO:tasks.workunit.client.0.smithi026.stderr: 6650K .......... .......... .......... .......... .......... 63% 8.53M 1s 2024-04-21T09:28:41.923 INFO:tasks.workunit.client.0.smithi026.stderr: 6700K .......... .......... .......... .......... .......... 64% 9.40M 1s 2024-04-21T09:28:41.928 INFO:tasks.workunit.client.0.smithi026.stderr: 6750K .......... .......... .......... .......... .......... 64% 7.28M 1s 2024-04-21T09:28:41.932 INFO:tasks.workunit.client.0.smithi026.stderr: 6800K .......... .......... .......... .......... .......... 65% 11.1M 1s 2024-04-21T09:28:41.937 INFO:tasks.workunit.client.0.smithi026.stderr: 6850K .......... .......... .......... .......... .......... 65% 10.4M 0s 2024-04-21T09:28:41.943 INFO:tasks.workunit.client.0.smithi026.stderr: 6900K .......... .......... .......... .......... .......... 66% 10.1M 0s 2024-04-21T09:28:41.948 INFO:tasks.workunit.client.0.smithi026.stderr: 6950K .......... .......... .......... .......... .......... 66% 8.64M 0s 2024-04-21T09:28:41.953 INFO:tasks.workunit.client.0.smithi026.stderr: 7000K .......... .......... .......... .......... .......... 67% 9.76M 0s 2024-04-21T09:28:41.958 INFO:tasks.workunit.client.0.smithi026.stderr: 7050K .......... .......... .......... .......... .......... 67% 9.99M 0s 2024-04-21T09:28:41.964 INFO:tasks.workunit.client.0.smithi026.stderr: 7100K .......... .......... .......... .......... .......... 68% 9.67M 0s 2024-04-21T09:28:41.969 INFO:tasks.workunit.client.0.smithi026.stderr: 7150K .......... .......... .......... .......... .......... 68% 8.48M 0s 2024-04-21T09:28:41.973 INFO:tasks.workunit.client.0.smithi026.stderr: 7200K .......... .......... .......... .......... .......... 69% 10.2M 0s 2024-04-21T09:28:41.978 INFO:tasks.workunit.client.0.smithi026.stderr: 7250K .......... .......... .......... .......... .......... 69% 9.29M 0s 2024-04-21T09:28:41.984 INFO:tasks.workunit.client.0.smithi026.stderr: 7300K .......... .......... .......... .......... .......... 70% 9.73M 0s 2024-04-21T09:28:41.989 INFO:tasks.workunit.client.0.smithi026.stderr: 7350K .......... .......... .......... .......... .......... 70% 8.57M 0s 2024-04-21T09:28:41.994 INFO:tasks.workunit.client.0.smithi026.stderr: 7400K .......... .......... .......... .......... .......... 71% 10.8M 0s 2024-04-21T09:28:41.999 INFO:tasks.workunit.client.0.smithi026.stderr: 7450K .......... .......... .......... .......... .......... 71% 9.88M 0s 2024-04-21T09:28:42.005 INFO:tasks.workunit.client.0.smithi026.stderr: 7500K .......... .......... .......... .......... .......... 71% 8.96M 0s 2024-04-21T09:28:42.010 INFO:tasks.workunit.client.0.smithi026.stderr: 7550K .......... .......... .......... .......... .......... 72% 8.30M 0s 2024-04-21T09:28:42.016 INFO:tasks.workunit.client.0.smithi026.stderr: 7600K .......... .......... .......... .......... .......... 72% 8.56M 0s 2024-04-21T09:28:42.021 INFO:tasks.workunit.client.0.smithi026.stderr: 7650K .......... .......... .......... .......... .......... 73% 9.37M 0s 2024-04-21T09:28:42.027 INFO:tasks.workunit.client.0.smithi026.stderr: 7700K .......... .......... .......... .......... .......... 73% 9.03M 0s 2024-04-21T09:28:42.033 INFO:tasks.workunit.client.0.smithi026.stderr: 7750K .......... .......... .......... .......... .......... 74% 7.57M 0s 2024-04-21T09:28:42.038 INFO:tasks.workunit.client.0.smithi026.stderr: 7800K .......... .......... .......... .......... .......... 74% 9.36M 0s 2024-04-21T09:28:42.044 INFO:tasks.workunit.client.0.smithi026.stderr: 7850K .......... .......... .......... .......... .......... 75% 9.13M 0s 2024-04-21T09:28:42.050 INFO:tasks.workunit.client.0.smithi026.stderr: 7900K .......... .......... .......... .......... .......... 75% 9.17M 0s 2024-04-21T09:28:42.056 INFO:tasks.workunit.client.0.smithi026.stderr: 7950K .......... .......... .......... .......... .......... 76% 7.13M 0s 2024-04-21T09:28:42.061 INFO:tasks.workunit.client.0.smithi026.stderr: 8000K .......... .......... .......... .......... .......... 76% 8.92M 0s 2024-04-21T09:28:42.067 INFO:tasks.workunit.client.0.smithi026.stderr: 8050K .......... .......... .......... .......... .......... 77% 8.63M 0s 2024-04-21T09:28:42.074 INFO:tasks.workunit.client.0.smithi026.stderr: 8100K .......... .......... .......... .......... .......... 77% 8.29M 0s 2024-04-21T09:28:42.080 INFO:tasks.workunit.client.0.smithi026.stderr: 8150K .......... .......... .......... .......... .......... 78% 7.62M 0s 2024-04-21T09:28:42.084 INFO:tasks.workunit.client.0.smithi026.stderr: 8200K .......... .......... .......... .......... .......... 78% 10.9M 0s 2024-04-21T09:28:42.087 INFO:tasks.workunit.client.0.smithi026.stderr: 8250K .......... .......... .......... .......... .......... 79% 12.1M 0s 2024-04-21T09:28:42.091 INFO:tasks.workunit.client.0.smithi026.stderr: 8300K .......... .......... .......... .......... .......... 79% 13.1M 0s 2024-04-21T09:28:42.095 INFO:tasks.workunit.client.0.smithi026.stderr: 8350K .......... .......... .......... .......... .......... 80% 11.2M 0s 2024-04-21T09:28:42.099 INFO:tasks.workunit.client.0.smithi026.stderr: 8400K .......... .......... .......... .......... .......... 80% 13.4M 0s 2024-04-21T09:28:42.103 INFO:tasks.workunit.client.0.smithi026.stderr: 8450K .......... .......... .......... .......... .......... 81% 12.9M 0s 2024-04-21T09:28:42.107 INFO:tasks.workunit.client.0.smithi026.stderr: 8500K .......... .......... .......... .......... .......... 81% 14.6M 0s 2024-04-21T09:28:42.110 INFO:tasks.workunit.client.0.smithi026.stderr: 8550K .......... .......... .......... .......... .......... 81% 13.3M 0s 2024-04-21T09:28:42.113 INFO:tasks.workunit.client.0.smithi026.stderr: 8600K .......... .......... .......... .......... .......... 82% 13.8M 0s 2024-04-21T09:28:42.117 INFO:tasks.workunit.client.0.smithi026.stderr: 8650K .......... .......... .......... .......... .......... 82% 13.9M 0s 2024-04-21T09:28:42.121 INFO:tasks.workunit.client.0.smithi026.stderr: 8700K .......... .......... .......... .......... .......... 83% 14.9M 0s 2024-04-21T09:28:42.125 INFO:tasks.workunit.client.0.smithi026.stderr: 8750K .......... .......... .......... .......... .......... 83% 10.2M 0s 2024-04-21T09:28:42.127 INFO:tasks.workunit.client.0.smithi026.stderr: 8800K .......... .......... .......... .......... .......... 84% 19.3M 0s 2024-04-21T09:28:42.130 INFO:tasks.workunit.client.0.smithi026.stderr: 8850K .......... .......... .......... .......... .......... 84% 18.0M 0s 2024-04-21T09:28:42.133 INFO:tasks.workunit.client.0.smithi026.stderr: 8900K .......... .......... .......... .......... .......... 85% 16.7M 0s 2024-04-21T09:28:42.136 INFO:tasks.workunit.client.0.smithi026.stderr: 8950K .......... .......... .......... .......... .......... 85% 14.8M 0s 2024-04-21T09:28:42.139 INFO:tasks.workunit.client.0.smithi026.stderr: 9000K .......... .......... .......... .......... .......... 86% 17.1M 0s 2024-04-21T09:28:42.142 INFO:tasks.workunit.client.0.smithi026.stderr: 9050K .......... .......... .......... .......... .......... 86% 16.9M 0s 2024-04-21T09:28:42.146 INFO:tasks.workunit.client.0.smithi026.stderr: 9100K .......... .......... .......... .......... .......... 87% 16.0M 0s 2024-04-21T09:28:42.149 INFO:tasks.workunit.client.0.smithi026.stderr: 9150K .......... .......... .......... .......... .......... 87% 12.5M 0s 2024-04-21T09:28:42.154 INFO:tasks.workunit.client.0.smithi026.stderr: 9200K .......... .......... .......... .......... .......... 88% 11.1M 0s 2024-04-21T09:28:42.160 INFO:tasks.workunit.client.0.smithi026.stderr: 9250K .......... .......... .......... .......... .......... 88% 8.36M 0s 2024-04-21T09:28:42.163 INFO:tasks.workunit.client.0.smithi026.stderr: 9300K .......... .......... .......... .......... .......... 89% 13.2M 0s 2024-04-21T09:28:42.167 INFO:tasks.workunit.client.0.smithi026.stderr: 9350K .......... .......... .......... .......... .......... 89% 13.7M 0s 2024-04-21T09:28:42.170 INFO:tasks.workunit.client.0.smithi026.stderr: 9400K .......... .......... .......... .......... .......... 90% 14.0M 0s 2024-04-21T09:28:42.173 INFO:tasks.workunit.client.0.smithi026.stderr: 9450K .......... .......... .......... .......... .......... 90% 14.3M 0s 2024-04-21T09:28:42.178 INFO:tasks.workunit.client.0.smithi026.stderr: 9500K .......... .......... .......... .......... .......... 91% 13.3M 0s 2024-04-21T09:28:42.182 INFO:tasks.workunit.client.0.smithi026.stderr: 9550K .......... .......... .......... .......... .......... 91% 9.79M 0s 2024-04-21T09:28:42.186 INFO:tasks.workunit.client.0.smithi026.stderr: 9600K .......... .......... .......... .......... .......... 92% 12.7M 0s 2024-04-21T09:28:42.190 INFO:tasks.workunit.client.0.smithi026.stderr: 9650K .......... .......... .......... .......... .......... 92% 12.6M 0s 2024-04-21T09:28:42.194 INFO:tasks.workunit.client.0.smithi026.stderr: 9700K .......... .......... .......... .......... .......... 92% 12.5M 0s 2024-04-21T09:28:42.199 INFO:tasks.workunit.client.0.smithi026.stderr: 9750K .......... .......... .......... .......... .......... 93% 10.3M 0s 2024-04-21T09:28:42.203 INFO:tasks.workunit.client.0.smithi026.stderr: 9800K .......... .......... .......... .......... .......... 93% 11.6M 0s 2024-04-21T09:28:42.207 INFO:tasks.workunit.client.0.smithi026.stderr: 9850K .......... .......... .......... .......... .......... 94% 11.7M 0s 2024-04-21T09:28:42.212 INFO:tasks.workunit.client.0.smithi026.stderr: 9900K .......... .......... .......... .......... .......... 94% 11.7M 0s 2024-04-21T09:28:42.216 INFO:tasks.workunit.client.0.smithi026.stderr: 9950K .......... .......... .......... .......... .......... 95% 10.3M 0s 2024-04-21T09:28:42.220 INFO:tasks.workunit.client.0.smithi026.stderr: 10000K .......... .......... .......... .......... .......... 95% 12.0M 0s 2024-04-21T09:28:42.224 INFO:tasks.workunit.client.0.smithi026.stderr: 10050K .......... .......... .......... .......... .......... 96% 12.3M 0s 2024-04-21T09:28:42.229 INFO:tasks.workunit.client.0.smithi026.stderr: 10100K .......... .......... .......... .......... .......... 96% 11.7M 0s 2024-04-21T09:28:42.233 INFO:tasks.workunit.client.0.smithi026.stderr: 10150K .......... .......... .......... .......... .......... 97% 10.1M 0s 2024-04-21T09:28:42.237 INFO:tasks.workunit.client.0.smithi026.stderr: 10200K .......... .......... .......... .......... .......... 97% 11.2M 0s 2024-04-21T09:28:42.242 INFO:tasks.workunit.client.0.smithi026.stderr: 10250K .......... .......... .......... .......... .......... 98% 10.4M 0s 2024-04-21T09:28:42.248 INFO:tasks.workunit.client.0.smithi026.stderr: 10300K .......... .......... .......... .......... .......... 98% 10.5M 0s 2024-04-21T09:28:42.252 INFO:tasks.workunit.client.0.smithi026.stderr: 10350K .......... .......... .......... .......... .......... 99% 9.45M 0s 2024-04-21T09:28:42.257 INFO:tasks.workunit.client.0.smithi026.stderr: 10400K .......... .......... .......... .......... .......... 99% 10.4M 0s 2024-04-21T09:28:42.260 INFO:tasks.workunit.client.0.smithi026.stderr: 10450K .......... .......... .......... ......... 100% 10.8M=1.3s 2024-04-21T09:28:42.260 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T09:28:42.262 INFO:tasks.workunit.client.0.smithi026.stderr:2024-04-21 09:28:42 (8.03 MB/s) - 'coreutils_8.5.orig.tar.gz' saved [10740866/10740866] 2024-04-21T09:28:42.262 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-21T09:28:42.263 INFO:tasks.workunit.client.0.smithi026.stderr:+ tar xvfz coreutils_8.5.orig.tar.gz 2024-04-21T09:28:42.269 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/ 2024-04-21T09:28:42.273 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/maint.mk 2024-04-21T09:28:42.280 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/THANKS 2024-04-21T09:28:42.285 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/ABOUT-NLS 2024-04-21T09:28:42.291 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/ 2024-04-21T09:28:42.293 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/textutils/ 2024-04-21T09:28:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/textutils/ChangeLog 2024-04-21T09:28:42.311 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/textutils/NEWS 2024-04-21T09:28:42.316 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/fileutils/ 2024-04-21T09:28:42.320 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/fileutils/ChangeLog 2024-04-21T09:28:42.337 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/fileutils/ChangeLog-1997 2024-04-21T09:28:42.351 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/fileutils/NEWS 2024-04-21T09:28:42.358 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/sh-utils/ 2024-04-21T09:28:42.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/sh-utils/ChangeLog 2024-04-21T09:28:42.370 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/sh-utils/NEWS 2024-04-21T09:28:42.376 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/old/sh-utils/ChangeLog.0 2024-04-21T09:28:42.383 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_prohibit_strcmp 2024-04-21T09:28:42.388 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/ 2024-04-21T09:28:42.391 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/config.rpath 2024-04-21T09:28:42.396 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/cvsu 2024-04-21T09:28:42.400 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/mdate-sh 2024-04-21T09:28:42.404 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/gitlog-to-changelog 2024-04-21T09:28:42.408 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/gnu-web-doc-update 2024-04-21T09:28:42.412 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/useless-if-before-free 2024-04-21T09:28:42.416 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/config.sub 2024-04-21T09:28:42.422 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/missing 2024-04-21T09:28:42.426 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/compile 2024-04-21T09:28:42.431 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/install-sh 2024-04-21T09:28:42.435 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/gendocs.sh 2024-04-21T09:28:42.439 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/update-copyright 2024-04-21T09:28:42.443 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/texinfo.tex 2024-04-21T09:28:42.459 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/unused-parameter.h 2024-04-21T09:28:42.463 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/c++defs.h 2024-04-21T09:28:42.468 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/config.guess 2024-04-21T09:28:42.473 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/do-release-commit-and-tag 2024-04-21T09:28:42.477 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/git-version-gen 2024-04-21T09:28:42.483 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/arg-nonnull.h 2024-04-21T09:28:42.487 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/gnupload 2024-04-21T09:28:42.493 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/warn-on-use.h 2024-04-21T09:28:42.498 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/vc-list-files 2024-04-21T09:28:42.502 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/ylwrap 2024-04-21T09:28:42.505 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/ChangeLog-2007 2024-04-21T09:28:42.509 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/announce-gen 2024-04-21T09:28:42.514 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/build-aux/depcomp 2024-04-21T09:28:42.519 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_error_message_uppercase 2024-04-21T09:28:42.523 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_obsolete_symbols 2024-04-21T09:28:42.527 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/INSTALL 2024-04-21T09:28:42.532 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gl/ 2024-04-21T09:28:42.535 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gl/modules/ 2024-04-21T09:28:42.540 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gl/modules/getloadavg.diff 2024-04-21T09:28:42.546 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/configure.ac 2024-04-21T09:28:42.551 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_prohibit_tab_based_indentation 2024-04-21T09:28:42.555 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/GNUmakefile 2024-04-21T09:28:42.559 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/ChangeLog 2024-04-21T09:28:42.582 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/COPYING 2024-04-21T09:28:42.588 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ 2024-04-21T09:28:42.590 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/closeout.m4 2024-04-21T09:28:42.596 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/dirent-safer.m4 2024-04-21T09:28:42.599 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/settime.m4 2024-04-21T09:28:42.603 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/readtokens.m4 2024-04-21T09:28:42.607 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/clock_time.m4 2024-04-21T09:28:42.611 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/config-h.m4 2024-04-21T09:28:42.614 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/euidaccess.m4 2024-04-21T09:28:42.617 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/printf-frexpl.m4 2024-04-21T09:28:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/posix-shell.m4 2024-04-21T09:28:42.625 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/servent.m4 2024-04-21T09:28:42.629 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xstrtol.m4 2024-04-21T09:28:42.633 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mkdir-p.m4 2024-04-21T09:28:42.637 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/00gnulib.m4 2024-04-21T09:28:42.646 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbsinit.m4 2024-04-21T09:28:42.646 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/dup2.m4 2024-04-21T09:28:42.650 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/eealloc.m4 2024-04-21T09:28:42.654 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/savewd.m4 2024-04-21T09:28:42.657 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memrchr.m4 2024-04-21T09:28:42.661 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/d-ino.m4 2024-04-21T09:28:42.665 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/bison.m4 2024-04-21T09:28:42.669 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/isnanl.m4 2024-04-21T09:28:42.674 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lib-ld.m4 2024-04-21T09:28:42.678 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stpcpy.m4 2024-04-21T09:28:42.682 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/progtest.m4 2024-04-21T09:28:42.686 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/unistd_h.m4 2024-04-21T09:28:42.690 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/time_h.m4 2024-04-21T09:28:42.694 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mkancesdirs.m4 2024-04-21T09:28:42.699 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/signalblocking.m4 2024-04-21T09:28:42.702 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/unlink.m4 2024-04-21T09:28:42.706 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/backupfile.m4 2024-04-21T09:28:42.710 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/remove.m4 2024-04-21T09:28:42.714 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fts.m4 2024-04-21T09:28:42.718 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xalloc.m4 2024-04-21T09:28:42.721 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/inet_ntop.m4 2024-04-21T09:28:42.725 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/iconv_open.m4 2024-04-21T09:28:42.729 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/extensions.m4 2024-04-21T09:28:42.734 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbrtowc.m4 2024-04-21T09:28:42.741 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/check-decl.m4 2024-04-21T09:28:42.755 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/cycle-check.m4 2024-04-21T09:28:42.759 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/signal_h.m4 2024-04-21T09:28:42.765 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sys_socket_h.m4 2024-04-21T09:28:42.771 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fprintftime.m4 2024-04-21T09:28:42.775 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lib-check.m4 2024-04-21T09:28:42.780 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/isblank.m4 2024-04-21T09:28:42.786 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xstrtod.m4 2024-04-21T09:28:42.821 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdarg.m4 2024-04-21T09:28:42.847 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/selinux-selinux-h.m4 2024-04-21T09:28:42.850 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fstypename.m4 2024-04-21T09:28:42.853 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/link.m4 2024-04-21T09:28:42.856 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/md5.m4 2024-04-21T09:28:42.859 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/multiarch.m4 2024-04-21T09:28:42.862 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ioctl.m4 2024-04-21T09:28:42.867 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/flexmember.m4 2024-04-21T09:28:42.871 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/locale-fr.m4 2024-04-21T09:28:42.876 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fdopendir.m4 2024-04-21T09:28:42.878 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/exponentf.m4 2024-04-21T09:28:42.881 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/utimecmp.m4 2024-04-21T09:28:42.886 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/human.m4 2024-04-21T09:28:42.895 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strerror.m4 2024-04-21T09:28:42.898 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/socklen.m4 2024-04-21T09:28:42.914 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/dirent_h.m4 2024-04-21T09:28:42.916 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/locale-zh.m4 2024-04-21T09:28:42.920 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getdate.m4 2024-04-21T09:28:42.923 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/cloexec.m4 2024-04-21T09:28:42.928 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/i-ring.m4 2024-04-21T09:28:42.934 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/group-member.m4 2024-04-21T09:28:42.939 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strtod.m4 2024-04-21T09:28:42.947 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/chdir-long.m4 2024-04-21T09:28:42.950 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strnlen.m4 2024-04-21T09:28:42.959 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strtoimax.m4 2024-04-21T09:28:42.971 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getgroups.m4 2024-04-21T09:28:42.974 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/yield.m4 2024-04-21T09:28:42.977 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/write.m4 2024-04-21T09:28:42.980 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/localcharset.m4 2024-04-21T09:28:42.984 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/usleep.m4 2024-04-21T09:28:42.987 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memmove.m4 2024-04-21T09:28:42.990 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/close.m4 2024-04-21T09:28:42.993 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memcmp.m4 2024-04-21T09:28:42.996 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/autobuild.m4 2024-04-21T09:28:43.000 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fchdir.m4 2024-04-21T09:28:43.003 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fd-reopen.m4 2024-04-21T09:28:43.006 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/jm-winsz2.m4 2024-04-21T09:28:43.010 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/posixver.m4 2024-04-21T09:28:43.013 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/locale-ja.m4 2024-04-21T09:28:43.016 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stat-prog.m4 2024-04-21T09:28:43.036 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/wint_t.m4 2024-04-21T09:28:43.039 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/st_dm_mode.m4 2024-04-21T09:28:43.043 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/tempname.m4 2024-04-21T09:28:43.046 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/frexp.m4 2024-04-21T09:28:43.050 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/dirfd.m4 2024-04-21T09:28:43.053 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sys_select_h.m4 2024-04-21T09:28:43.062 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/btowc.m4 2024-04-21T09:28:43.065 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/filenamecat.m4 2024-04-21T09:28:43.068 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gmp.m4 2024-04-21T09:28:43.071 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/isapipe.m4 2024-04-21T09:28:43.074 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/wctype_h.m4 2024-04-21T09:28:43.077 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ldexpl.m4 2024-04-21T09:28:43.087 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getloadavg.m4 2024-04-21T09:28:43.090 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbchar.m4 2024-04-21T09:28:43.095 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/version-etc.m4 2024-04-21T09:28:43.103 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fcntl_h.m4 2024-04-21T09:28:43.105 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gettime.m4 2024-04-21T09:28:43.108 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/wchar_h.m4 2024-04-21T09:28:43.112 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/vasprintf-posix.m4 2024-04-21T09:28:43.115 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/selinux-context-h.m4 2024-04-21T09:28:43.118 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getpass.m4 2024-04-21T09:28:43.122 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mempcpy.m4 2024-04-21T09:28:43.135 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/save-cwd.m4 2024-04-21T09:28:43.139 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fclose.m4 2024-04-21T09:28:43.142 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/modechange.m4 2024-04-21T09:28:43.146 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strstr.m4 2024-04-21T09:28:43.159 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getdtablesize.m4 2024-04-21T09:28:43.163 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/wchar_t.m4 2024-04-21T09:28:43.175 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mkdir.m4 2024-04-21T09:28:43.178 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/idcache.m4 2024-04-21T09:28:43.181 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/tm_gmtoff.m4 2024-04-21T09:28:43.184 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/dirname.m4 2024-04-21T09:28:43.193 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbiter.m4 2024-04-21T09:28:43.200 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fcntl-safer.m4 2024-04-21T09:28:43.205 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/manywarnings.m4 2024-04-21T09:28:43.208 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/same.m4 2024-04-21T09:28:43.211 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getdelim.m4 2024-04-21T09:28:43.214 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mountlist.m4 2024-04-21T09:28:43.218 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lchmod.m4 2024-04-21T09:28:43.220 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/readlink.m4 2024-04-21T09:28:43.224 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gnu-make.m4 2024-04-21T09:28:43.227 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/thread.m4 2024-04-21T09:28:43.232 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/hostent.m4 2024-04-21T09:28:43.243 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/math_h.m4 2024-04-21T09:28:43.248 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fpending.m4 2024-04-21T09:28:43.250 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xgetcwd.m4 2024-04-21T09:28:43.253 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/utimens.m4 2024-04-21T09:28:43.257 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/exponentd.m4 2024-04-21T09:28:43.259 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getaddrinfo.m4 2024-04-21T09:28:43.262 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sys_ioctl_h.m4 2024-04-21T09:28:43.265 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdlib_h.m4 2024-04-21T09:28:43.268 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mgetgroups.m4 2024-04-21T09:28:43.271 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/open.m4 2024-04-21T09:28:43.274 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strpbrk.m4 2024-04-21T09:28:43.277 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ssize_t.m4 2024-04-21T09:28:43.280 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/priv-set.m4 2024-04-21T09:28:43.284 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fcntl-o.m4 2024-04-21T09:28:43.287 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/inttostr.m4 2024-04-21T09:28:43.290 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/malloca.m4 2024-04-21T09:28:43.293 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/unlocked-io.m4 2024-04-21T09:28:43.296 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getugroups.m4 2024-04-21T09:28:43.299 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sha1.m4 2024-04-21T09:28:43.307 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fpurge.m4 2024-04-21T09:28:43.310 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gnulib-comp.m4 2024-04-21T09:28:43.315 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/wcrtomb.m4 2024-04-21T09:28:43.323 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/putenv.m4 2024-04-21T09:28:43.326 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lstat.m4 2024-04-21T09:28:47.273 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strsignal.m4 2024-04-21T09:28:47.277 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbslen.m4 2024-04-21T09:28:47.282 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/inttypes.m4 2024-04-21T09:28:47.287 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdlib-safer.m4 2024-04-21T09:28:47.292 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strtol.m4 2024-04-21T09:28:47.296 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lib-ignore.m4 2024-04-21T09:28:47.301 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/readutmp.m4 2024-04-21T09:28:47.305 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strtoll.m4 2024-04-21T09:28:47.309 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdbool.m4 2024-04-21T09:28:47.313 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/setenv.m4 2024-04-21T09:28:47.320 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/alloca.m4 2024-04-21T09:28:47.324 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/size_max.m4 2024-04-21T09:28:47.329 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/include_next.m4 2024-04-21T09:28:47.333 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sys_stat_h.m4 2024-04-21T09:28:47.338 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strndup.m4 2024-04-21T09:28:47.342 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/link-follow.m4 2024-04-21T09:28:47.347 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ctype.m4 2024-04-21T09:28:47.351 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/timespec.m4 2024-04-21T09:28:47.355 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getline.m4 2024-04-21T09:28:47.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/calloc.m4 2024-04-21T09:28:47.366 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strftime.m4 2024-04-21T09:28:47.371 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/arpa_inet_h.m4 2024-04-21T09:28:47.378 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sig2str.m4 2024-04-21T09:28:47.384 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/printf.m4 2024-04-21T09:28:47.394 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/environ.m4 2024-04-21T09:28:47.400 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/vprintf-posix.m4 2024-04-21T09:28:47.407 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/intlmacosx.m4 2024-04-21T09:28:47.413 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/locale-tr.m4 2024-04-21T09:28:47.419 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mktime.m4 2024-04-21T09:28:47.424 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/iconv.m4 2024-04-21T09:28:47.429 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/pathmax.m4 2024-04-21T09:28:47.433 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/printf-frexp.m4 2024-04-21T09:28:47.437 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/userspec.m4 2024-04-21T09:28:47.441 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/host-os.m4 2024-04-21T09:28:47.446 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/file-type.m4 2024-04-21T09:28:47.451 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ls-mntd-fs.m4 2024-04-21T09:28:47.455 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sha512.m4 2024-04-21T09:28:47.461 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdio-safer.m4 2024-04-21T09:28:47.467 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lock.m4 2024-04-21T09:28:47.472 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/c-strtod.m4 2024-04-21T09:28:47.477 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/closein.m4 2024-04-21T09:28:47.481 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/frexpl.m4 2024-04-21T09:28:47.486 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/posixtm.m4 2024-04-21T09:28:47.490 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/rmdir.m4 2024-04-21T09:28:47.495 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/chown.m4 2024-04-21T09:28:47.500 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdint.m4 2024-04-21T09:28:47.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stddef_h.m4 2024-04-21T09:28:47.521 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sigaction.m4 2024-04-21T09:28:47.549 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/error.m4 2024-04-21T09:28:47.554 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/vasnprintf.m4 2024-04-21T09:28:47.559 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/utimbuf.m4 2024-04-21T09:28:47.564 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sockets.m4 2024-04-21T09:28:47.569 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/canonicalize.m4 2024-04-21T09:28:47.574 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sys_time_h.m4 2024-04-21T09:28:47.579 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/unlink-busy.m4 2024-04-21T09:28:47.584 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gettimeofday.m4 2024-04-21T09:28:47.589 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/write-any-file.m4 2024-04-21T09:28:47.596 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strdup.m4 2024-04-21T09:28:47.600 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/regex.m4 2024-04-21T09:28:47.606 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sleep.m4 2024-04-21T09:28:47.611 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/float_h.m4 2024-04-21T09:28:47.616 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/warn-on-use.m4 2024-04-21T09:28:47.622 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/atexit.m4 2024-04-21T09:28:47.627 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getcwd-path-max.m4 2024-04-21T09:28:47.633 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fnmatch.m4 2024-04-21T09:28:47.638 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strnumcmp.m4 2024-04-21T09:28:47.644 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gnulib-common.m4 2024-04-21T09:28:47.650 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/codeset.m4 2024-04-21T09:28:47.655 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/time_r.m4 2024-04-21T09:28:47.660 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memcoll.m4 2024-04-21T09:28:47.665 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/string_h.m4 2024-04-21T09:28:47.670 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sys_utsname_h.m4 2024-04-21T09:28:47.676 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdint_h.m4 2024-04-21T09:28:47.681 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/nproc.m4 2024-04-21T09:28:47.687 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/symlink.m4 2024-04-21T09:28:47.692 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/rename.m4 2024-04-21T09:28:47.698 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/read-file.m4 2024-04-21T09:28:47.703 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strtoumax.m4 2024-04-21T09:28:47.708 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getopt.m4 2024-04-21T09:28:47.714 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fopen.m4 2024-04-21T09:28:47.720 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ungetc.m4 2024-04-21T09:28:47.725 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xsize.m4 2024-04-21T09:28:47.730 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fflush.m4 2024-04-21T09:28:47.736 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/acl.m4 2024-04-21T09:28:47.742 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fsusage.m4 2024-04-21T09:28:47.748 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gethrxtime.m4 2024-04-21T09:28:47.754 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/nls.m4 2024-04-21T09:28:47.759 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lib-link.m4 2024-04-21T09:28:47.767 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mpsort.m4 2024-04-21T09:28:47.773 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/netinet_in_h.m4 2024-04-21T09:28:47.778 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fseeko.m4 2024-04-21T09:28:47.784 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/inet_pton.m4 2024-04-21T09:28:47.790 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/yesno.m4 2024-04-21T09:28:47.795 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/physmem.m4 2024-04-21T09:28:47.801 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/intmax_t.m4 2024-04-21T09:28:47.806 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/inttypes-pri.m4 2024-04-21T09:28:47.811 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/malloc.m4 2024-04-21T09:28:47.817 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/jm-winsz1.m4 2024-04-21T09:28:47.823 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/close-stream.m4 2024-04-21T09:28:47.828 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/nocrash.m4 2024-04-21T09:28:47.834 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/realloc.m4 2024-04-21T09:28:47.839 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/canon-host.m4 2024-04-21T09:28:47.844 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memcpy.m4 2024-04-21T09:28:47.849 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/tls.m4 2024-04-21T09:28:47.855 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/perl.m4 2024-04-21T09:28:47.861 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/signbit.m4 2024-04-21T09:28:47.868 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memchr.m4 2024-04-21T09:28:47.874 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/d-type.m4 2024-04-21T09:28:47.880 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lchown.m4 2024-04-21T09:28:47.887 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lib-prefix.m4 2024-04-21T09:28:47.894 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getcwd.m4 2024-04-21T09:28:47.901 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/locale_h.m4 2024-04-21T09:28:47.908 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memxfrm.m4 2024-04-21T09:28:47.914 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbstate_t.m4 2024-04-21T09:28:47.919 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/filemode.m4 2024-04-21T09:28:47.924 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memset.m4 2024-04-21T09:28:47.930 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gethostname.m4 2024-04-21T09:28:47.936 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/vasprintf.m4 2024-04-21T09:28:47.941 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/unistd-safer.m4 2024-04-21T09:28:47.946 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xfts.m4 2024-04-21T09:28:47.952 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/uptime.m4 2024-04-21T09:28:47.957 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/prereq.m4 2024-04-21T09:28:47.963 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/symlinkat.m4 2024-04-21T09:28:47.969 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getusershell.m4 2024-04-21T09:28:47.975 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/isnand.m4 2024-04-21T09:28:47.981 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/select.m4 2024-04-21T09:28:47.986 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/wctob.m4 2024-04-21T09:28:47.991 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/double-slash-root.m4 2024-04-21T09:28:47.997 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/long-options.m4 2024-04-21T09:28:48.003 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/glibc21.m4 2024-04-21T09:28:48.008 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stat-time.m4 2024-04-21T09:28:48.014 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/rpmatch.m4 2024-04-21T09:28:48.019 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xattr.m4 2024-04-21T09:28:48.025 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/gettext.m4 2024-04-21T09:28:48.031 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fsync.m4 2024-04-21T09:28:48.037 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/exclude.m4 2024-04-21T09:28:48.042 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/freopen.m4 2024-04-21T09:28:48.048 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strtoul.m4 2024-04-21T09:28:48.054 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/netdb_h.m4 2024-04-21T09:28:48.059 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/snprintf.m4 2024-04-21T09:28:48.064 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stpncpy.m4 2024-04-21T09:28:48.070 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xnanosleep.m4 2024-04-21T09:28:48.075 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/warnings.m4 2024-04-21T09:28:48.080 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/lseek.m4 2024-04-21T09:28:48.086 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/hard-locale.m4 2024-04-21T09:28:48.092 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/include-exclude-prog.m4 2024-04-21T09:28:48.098 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mmap-anon.m4 2024-04-21T09:28:48.103 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mkstemp.m4 2024-04-21T09:28:48.109 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/openat.m4 2024-04-21T09:28:48.116 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbrlen.m4 2024-04-21T09:28:48.121 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/jm-macros.m4 2024-04-21T09:28:48.126 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ftello.m4 2024-04-21T09:28:48.132 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stdio_h.m4 2024-04-21T09:28:48.138 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/exponentl.m4 2024-04-21T09:28:48.144 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getpagesize.m4 2024-04-21T09:28:48.150 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/argmatch.m4 2024-04-21T09:28:48.155 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/perror.m4 2024-04-21T09:28:48.161 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/inline.m4 2024-04-21T09:28:48.167 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/inttypes_h.m4 2024-04-21T09:28:48.173 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/iconv_h.m4 2024-04-21T09:28:48.179 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/base64.m4 2024-04-21T09:28:48.185 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/stat.m4 2024-04-21T09:28:48.190 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/tzset.m4 2024-04-21T09:28:48.195 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/unicodeio.m4 2024-04-21T09:28:48.201 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sha256.m4 2024-04-21T09:28:48.206 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/errno_h.m4 2024-04-21T09:28:48.212 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/unlinkdir.m4 2024-04-21T09:28:48.218 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/boottime.m4 2024-04-21T09:28:48.223 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/freading.m4 2024-04-21T09:28:48.228 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mode_t.m4 2024-04-21T09:28:48.234 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getndelim2.m4 2024-04-21T09:28:48.240 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xvasprintf.m4 2024-04-21T09:28:48.245 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbsrtowcs.m4 2024-04-21T09:28:48.250 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/hash.m4 2024-04-21T09:28:48.256 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/safe-write.m4 2024-04-21T09:28:48.262 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/po.m4 2024-04-21T09:28:48.268 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/isnanf.m4 2024-04-21T09:28:48.274 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/longlong.m4 2024-04-21T09:28:48.280 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/xstrndup.m4 2024-04-21T09:28:48.287 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/euidaccess-stat.m4 2024-04-21T09:28:48.293 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/getcwd-abort-bug.m4 2024-04-21T09:28:48.299 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/faccessat.m4 2024-04-21T09:28:48.305 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/nanosleep.m4 2024-04-21T09:28:48.312 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/ChangeLog-2007 2024-04-21T09:28:48.326 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/utimes.m4 2024-04-21T09:28:48.332 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fileblocks.m4 2024-04-21T09:28:48.337 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/sockpfaf.m4 2024-04-21T09:28:48.342 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strtoull.m4 2024-04-21T09:28:48.349 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/assert.m4 2024-04-21T09:28:48.355 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/quotearg.m4 2024-04-21T09:28:48.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/uname.m4 2024-04-21T09:28:48.367 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/savedir.m4 2024-04-21T09:28:48.372 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/threadlib.m4 2024-04-21T09:28:48.380 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/langinfo_h.m4 2024-04-21T09:28:48.386 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/linkat.m4 2024-04-21T09:28:48.391 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fpieee.m4 2024-04-21T09:28:48.397 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/memcasecmp.m4 2024-04-21T09:28:48.402 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/vfprintf-posix.m4 2024-04-21T09:28:48.409 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/dos.m4 2024-04-21T09:28:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/root-dev-ino.m4 2024-04-21T09:28:48.420 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/quote.m4 2024-04-21T09:28:48.426 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/mbswidth.m4 2024-04-21T09:28:48.431 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/nl_langinfo.m4 2024-04-21T09:28:48.436 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/fcntl.m4 2024-04-21T09:28:48.442 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/strcspn.m4 2024-04-21T09:28:48.448 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/safe-read.m4 2024-04-21T09:28:48.454 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/m4/wcwidth.m4 2024-04-21T09:28:48.460 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/Makefile.am 2024-04-21T09:28:48.469 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_po_check 2024-04-21T09:28:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/dist-check.mk 2024-04-21T09:28:48.481 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_GPL_version 2024-04-21T09:28:48.487 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_unmarked_diagnostics 2024-04-21T09:28:48.492 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.prev-version 2024-04-21T09:28:48.496 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/bootstrap.conf 2024-04-21T09:28:48.503 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/ChangeLog-2005 2024-04-21T09:28:48.572 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/aclocal.m4 2024-04-21T09:28:48.648 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/AUTHORS 2024-04-21T09:28:48.653 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/cfg.mk 2024-04-21T09:28:48.659 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_file_system 2024-04-21T09:28:48.664 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.version 2024-04-21T09:28:48.669 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/TODO 2024-04-21T09:28:48.674 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_space_tab 2024-04-21T09:28:48.678 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_prohibit_empty_lines_at_EOF 2024-04-21T09:28:48.684 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/Makefile.in 2024-04-21T09:28:48.693 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/ 2024-04-21T09:28:48.696 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cat.x 2024-04-21T09:28:48.702 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/date.x 2024-04-21T09:28:48.708 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/basename.1 2024-04-21T09:28:48.713 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pathchk.x 2024-04-21T09:28:48.719 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tail.x 2024-04-21T09:28:48.724 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/yes.x 2024-04-21T09:28:48.729 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pinky.1 2024-04-21T09:28:48.735 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/kill.x 2024-04-21T09:28:48.740 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pathchk.1 2024-04-21T09:28:48.745 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sync.1 2024-04-21T09:28:48.751 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dir.1 2024-04-21T09:28:48.756 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mv.1 2024-04-21T09:28:48.762 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/rm.1 2024-04-21T09:28:48.768 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dircolors.x 2024-04-21T09:28:48.773 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/rmdir.1 2024-04-21T09:28:48.781 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tty.1 2024-04-21T09:28:48.785 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/fold.x 2024-04-21T09:28:48.790 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/fold.1 2024-04-21T09:28:48.796 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dir.x 2024-04-21T09:28:48.801 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/fmt.x 2024-04-21T09:28:48.806 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/paste.1 2024-04-21T09:28:48.811 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chmod.x 2024-04-21T09:28:48.817 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/od.1 2024-04-21T09:28:48.822 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/ptx.x 2024-04-21T09:28:48.827 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nice.1 2024-04-21T09:28:48.833 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/install.1 2024-04-21T09:28:48.839 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dd.x 2024-04-21T09:28:48.844 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cksum.1 2024-04-21T09:28:48.850 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/test.1 2024-04-21T09:28:48.855 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chgrp.1 2024-04-21T09:28:48.862 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/unlink.1 2024-04-21T09:28:48.866 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chmod.1 2024-04-21T09:28:48.871 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dd.1 2024-04-21T09:28:48.877 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/du.1 2024-04-21T09:28:48.886 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tsort.1 2024-04-21T09:28:48.891 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/ls.1 2024-04-21T09:28:48.897 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/split.x 2024-04-21T09:28:48.904 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nohup.x 2024-04-21T09:28:48.909 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha1sum.1 2024-04-21T09:28:48.914 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tr.1 2024-04-21T09:28:48.920 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/head.x 2024-04-21T09:28:48.925 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/false.1 2024-04-21T09:28:48.931 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pwd.x 2024-04-21T09:28:48.936 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/logname.x 2024-04-21T09:28:48.941 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/paste.x 2024-04-21T09:28:48.947 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nl.x 2024-04-21T09:28:48.952 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha224sum.1 2024-04-21T09:28:48.958 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mkdir.1 2024-04-21T09:28:48.963 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nl.1 2024-04-21T09:28:48.970 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha256sum.1 2024-04-21T09:28:48.977 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/printf.x 2024-04-21T09:28:48.982 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/md5sum.1 2024-04-21T09:28:48.988 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/Makefile.am 2024-04-21T09:28:48.994 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dirname.1 2024-04-21T09:28:49.000 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/shuf.x 2024-04-21T09:28:49.005 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/echo.1 2024-04-21T09:28:49.009 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chcon.x 2024-04-21T09:28:49.014 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chroot.1 2024-04-21T09:28:49.019 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha384sum.x 2024-04-21T09:28:49.024 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/stdbuf.1 2024-04-21T09:28:49.028 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/users.1 2024-04-21T09:28:49.033 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/readlink.x 2024-04-21T09:28:49.038 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cut.x 2024-04-21T09:28:49.045 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/groups.1 2024-04-21T09:28:49.049 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/seq.1 2024-04-21T09:28:49.054 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/help2man 2024-04-21T09:28:49.061 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dirname.x 2024-04-21T09:28:49.065 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/uname.x 2024-04-21T09:28:49.071 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/uptime.x 2024-04-21T09:28:49.075 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cut.1 2024-04-21T09:28:49.079 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cksum.x 2024-04-21T09:28:49.085 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nohup.1 2024-04-21T09:28:49.090 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mv.x 2024-04-21T09:28:49.096 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sort.1 2024-04-21T09:28:49.102 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chown.1 2024-04-21T09:28:49.108 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pr.x 2024-04-21T09:28:49.113 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/true.x 2024-04-21T09:28:49.119 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/base64.1 2024-04-21T09:28:49.125 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/factor.1 2024-04-21T09:28:49.130 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/ln.x 2024-04-21T09:28:49.135 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/head.1 2024-04-21T09:28:49.140 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/unexpand.1 2024-04-21T09:28:49.144 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/df.x 2024-04-21T09:28:49.148 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/join.x 2024-04-21T09:28:49.153 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/du.x 2024-04-21T09:28:49.157 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/dircolors.1 2024-04-21T09:28:49.162 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/uniq.x 2024-04-21T09:28:49.166 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/split.1 2024-04-21T09:28:49.171 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tty.x 2024-04-21T09:28:49.176 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/uname.1 2024-04-21T09:28:49.180 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/uptime.1 2024-04-21T09:28:49.186 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sort.x 2024-04-21T09:28:49.190 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha256sum.x 2024-04-21T09:28:49.195 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha512sum.x 2024-04-21T09:28:49.200 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nice.x 2024-04-21T09:28:49.205 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pinky.x 2024-04-21T09:28:49.208 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/fmt.1 2024-04-21T09:28:49.213 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/expr.1 2024-04-21T09:28:49.220 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/wc.1 2024-04-21T09:28:49.224 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/true.1 2024-04-21T09:28:49.229 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/comm.x 2024-04-21T09:28:49.233 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/truncate.x 2024-04-21T09:28:49.238 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/install.x 2024-04-21T09:28:49.243 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/wc.x 2024-04-21T09:28:49.248 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/uniq.1 2024-04-21T09:28:49.254 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/arch.x 2024-04-21T09:28:49.260 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sum.x 2024-04-21T09:28:49.265 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/timeout.x 2024-04-21T09:28:49.271 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/link.x 2024-04-21T09:28:49.277 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tac.1 2024-04-21T09:28:49.284 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sync.x 2024-04-21T09:28:49.289 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/Makefile.in 2024-04-21T09:28:49.300 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mkfifo.1 2024-04-21T09:28:49.305 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/od.x 2024-04-21T09:28:49.311 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/vdir.1 2024-04-21T09:28:49.318 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/timeout.1 2024-04-21T09:28:49.323 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mkfifo.x 2024-04-21T09:28:49.327 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/basename.x 2024-04-21T09:28:49.333 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/expr.x 2024-04-21T09:28:49.339 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mktemp.x 2024-04-21T09:28:49.344 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/vdir.x 2024-04-21T09:28:49.349 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/su.x 2024-04-21T09:28:49.355 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/env.1 2024-04-21T09:28:49.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/who.x 2024-04-21T09:28:49.366 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/hostid.1 2024-04-21T09:28:49.371 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tee.x 2024-04-21T09:28:49.378 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/rmdir.x 2024-04-21T09:28:49.384 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/hostid.x 2024-04-21T09:28:49.389 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/id.x 2024-04-21T09:28:49.395 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/unexpand.x 2024-04-21T09:28:49.399 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pr.1 2024-04-21T09:28:49.405 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/csplit.1 2024-04-21T09:28:49.410 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/truncate.1 2024-04-21T09:28:49.416 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tee.1 2024-04-21T09:28:49.421 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/env.x 2024-04-21T09:28:49.427 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chroot.x 2024-04-21T09:28:49.432 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cp.x 2024-04-21T09:28:49.438 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/whoami.x 2024-04-21T09:28:49.443 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/logname.1 2024-04-21T09:28:49.448 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mknod.1 2024-04-21T09:28:49.454 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/groups.x 2024-04-21T09:28:49.460 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cp.1 2024-04-21T09:28:49.467 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/runcon.x 2024-04-21T09:28:49.472 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/yes.1 2024-04-21T09:28:49.478 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/stat.1 2024-04-21T09:28:49.483 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nproc.x 2024-04-21T09:28:49.489 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/unlink.x 2024-04-21T09:28:49.494 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha384sum.1 2024-04-21T09:28:49.500 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/nproc.1 2024-04-21T09:28:49.505 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/seq.x 2024-04-21T09:28:49.510 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha512sum.1 2024-04-21T09:28:49.516 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/stat.x 2024-04-21T09:28:52.370 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sleep.x 2024-04-21T09:28:52.374 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/printenv.1 2024-04-21T09:28:52.379 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tr.x 2024-04-21T09:28:52.383 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tail.1 2024-04-21T09:28:52.388 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/md5sum.x 2024-04-21T09:28:52.392 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/link.1 2024-04-21T09:28:52.398 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/echo.x 2024-04-21T09:28:52.403 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/ptx.1 2024-04-21T09:28:52.409 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/factor.x 2024-04-21T09:28:52.414 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/who.1 2024-04-21T09:28:52.420 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mktemp.1 2024-04-21T09:28:52.426 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/shred.1 2024-04-21T09:28:52.431 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/runcon.1 2024-04-21T09:28:52.436 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/stty.x 2024-04-21T09:28:52.441 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/comm.1 2024-04-21T09:28:52.446 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/shuf.1 2024-04-21T09:28:52.453 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/stty.1 2024-04-21T09:28:52.459 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/printenv.x 2024-04-21T09:28:52.465 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/join.1 2024-04-21T09:28:52.469 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/hostname.x 2024-04-21T09:28:52.474 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/ln.1 2024-04-21T09:28:52.478 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/false.x 2024-04-21T09:28:52.483 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/cat.1 2024-04-21T09:28:52.487 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/users.x 2024-04-21T09:28:52.492 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/printf.1 2024-04-21T09:28:52.498 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/ls.x 2024-04-21T09:28:52.503 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha224sum.x 2024-04-21T09:28:52.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/whoami.1 2024-04-21T09:28:52.512 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/expand.1 2024-04-21T09:28:52.517 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chgrp.x 2024-04-21T09:28:52.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sleep.1 2024-04-21T09:28:52.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/csplit.x 2024-04-21T09:28:52.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/pwd.1 2024-04-21T09:28:52.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/kill.1 2024-04-21T09:28:52.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/touch.x 2024-04-21T09:28:52.551 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/df.1 2024-04-21T09:28:52.552 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/stdbuf.x 2024-04-21T09:28:52.573 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mkdir.x 2024-04-21T09:28:52.586 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/id.1 2024-04-21T09:28:52.591 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/mknod.x 2024-04-21T09:28:52.596 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sum.1 2024-04-21T09:28:52.601 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/rm.x 2024-04-21T09:28:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/date.1 2024-04-21T09:28:52.611 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chown.x 2024-04-21T09:28:52.616 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/touch.1 2024-04-21T09:28:52.621 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tac.x 2024-04-21T09:28:52.625 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/base64.x 2024-04-21T09:28:52.630 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/tsort.x 2024-04-21T09:28:52.635 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/shred.x 2024-04-21T09:28:52.639 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/readlink.1 2024-04-21T09:28:52.644 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/sha1sum.x 2024-04-21T09:28:52.649 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/expand.x 2024-04-21T09:28:52.653 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/test.x 2024-04-21T09:28:52.658 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/man/chcon.1 2024-04-21T09:28:52.662 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.tarball-version 2024-04-21T09:28:52.669 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/NEWS 2024-04-21T09:28:52.679 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_sun_os_names 2024-04-21T09:28:52.683 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/bootstrap 2024-04-21T09:28:52.690 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/ 2024-04-21T09:28:52.693 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbsalign.h 2024-04-21T09:28:52.697 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/streq.h 2024-04-21T09:28:52.702 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/asprintf.c 2024-04-21T09:28:52.706 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strnlen1.c 2024-04-21T09:28:52.712 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirfd.c 2024-04-21T09:28:52.717 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/safe-write.h 2024-04-21T09:28:52.722 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/snprintf.c 2024-04-21T09:28:52.726 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbiter.h 2024-04-21T09:28:52.731 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mountlist.c 2024-04-21T09:28:52.738 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/propername.h 2024-04-21T09:28:52.743 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memset.c 2024-04-21T09:28:52.747 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/nproc.c 2024-04-21T09:28:52.753 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getdelim.c 2024-04-21T09:28:52.758 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/signbitl.c 2024-04-21T09:28:52.763 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/group-member.h 2024-04-21T09:28:52.768 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/long-options.c 2024-04-21T09:28:52.773 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fts_.h 2024-04-21T09:28:52.778 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fts.c 2024-04-21T09:28:52.788 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/verify.h 2024-04-21T09:28:52.794 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/str-two-way.h 2024-04-21T09:28:52.798 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/areadlink.c 2024-04-21T09:28:52.804 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-strtod.h 2024-04-21T09:28:52.808 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sha256.h 2024-04-21T09:28:52.813 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stddef.in.h 2024-04-21T09:28:52.817 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/randint.c 2024-04-21T09:28:52.822 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dup-safer.c 2024-04-21T09:28:52.827 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getpass.h 2024-04-21T09:28:52.832 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gettext.h 2024-04-21T09:28:52.837 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/randint.h 2024-04-21T09:28:52.841 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdio-write.c 2024-04-21T09:28:52.847 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xgethostname.h 2024-04-21T09:28:52.852 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/asnprintf.c 2024-04-21T09:28:52.857 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-solaris.gperf 2024-04-21T09:28:52.861 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdio-impl.h 2024-04-21T09:28:52.866 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mpsort.h 2024-04-21T09:28:52.871 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/closein.c 2024-04-21T09:28:52.877 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hard-locale.c 2024-04-21T09:28:52.882 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/utimecmp.c 2024-04-21T09:28:52.888 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/vasnprintf.c 2024-04-21T09:28:52.906 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/chown.c 2024-04-21T09:28:52.911 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-args.c 2024-04-21T09:28:52.917 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/netdb.in.h 2024-04-21T09:28:52.923 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strnlen.c 2024-04-21T09:28:52.927 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/errno.in.h 2024-04-21T09:28:52.932 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbslen.c 2024-04-21T09:28:52.937 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/obstack.h 2024-04-21T09:28:52.943 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/file-type.h 2024-04-21T09:28:52.947 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbsrtowcs.c 2024-04-21T09:28:52.952 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fnmatch_loop.c 2024-04-21T09:28:52.959 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/safe-write.c 2024-04-21T09:28:52.963 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mpsort.c 2024-04-21T09:28:52.968 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/netinet_in.in.h 2024-04-21T09:28:52.973 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xfreopen.h 2024-04-21T09:28:52.977 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/wctype.in.h 2024-04-21T09:28:52.983 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stripslash.c 2024-04-21T09:28:52.988 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/closein.h 2024-04-21T09:28:52.993 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memchr2.c 2024-04-21T09:28:52.997 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcoll.c 2024-04-21T09:28:53.002 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/malloca.h 2024-04-21T09:28:53.006 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stpcpy.c 2024-04-21T09:28:53.011 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/striconv.c 2024-04-21T09:28:53.018 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/basename.c 2024-04-21T09:28:53.024 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sha256.c 2024-04-21T09:28:53.030 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdint.in.h 2024-04-21T09:28:53.036 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/acl-internal.h 2024-04-21T09:28:53.041 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/atexit.c 2024-04-21T09:28:53.046 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/size_max.h 2024-04-21T09:28:53.050 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/buffer-lcm.h 2024-04-21T09:28:53.055 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/idcache.h 2024-04-21T09:28:53.060 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/root-dev-ino.c 2024-04-21T09:28:53.064 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/physmem.c 2024-04-21T09:28:53.070 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/glthread/ 2024-04-21T09:28:53.073 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/glthread/lock.h 2024-04-21T09:28:53.080 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/glthread/threadlib.c 2024-04-21T09:28:53.086 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/glthread/lock.c 2024-04-21T09:28:53.091 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/glthread/tls.h 2024-04-21T09:28:53.097 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/glthread/tls.c 2024-04-21T09:28:53.102 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unistr/ 2024-04-21T09:28:53.106 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unistr/u8-uctomb.c 2024-04-21T09:28:53.112 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unistr/u8-uctomb-aux.c 2024-04-21T09:28:53.117 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkancesdirs.c 2024-04-21T09:28:53.124 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/readtokens0.c 2024-04-21T09:28:53.129 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fnmatch.in.h 2024-04-21T09:28:53.136 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirname.h 2024-04-21T09:28:53.142 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/regex_internal.c 2024-04-21T09:28:53.150 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strcspn.c 2024-04-21T09:28:53.155 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getugroups.h 2024-04-21T09:28:53.160 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/file-set.c 2024-04-21T09:28:53.166 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sys_socket.in.h 2024-04-21T09:28:53.173 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/inttostr.h 2024-04-21T09:28:53.179 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkdirat.c 2024-04-21T09:28:53.185 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/readtokens.h 2024-04-21T09:28:53.190 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fd-reopen.h 2024-04-21T09:28:53.196 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/w32sock.h 2024-04-21T09:28:53.202 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcasecmp.c 2024-04-21T09:28:53.208 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/at-func.c 2024-04-21T09:28:53.213 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unistd-safer.h 2024-04-21T09:28:53.218 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/filevercmp.h 2024-04-21T09:28:53.223 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-strcasecmp.c 2024-04-21T09:28:53.227 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fopen-safer.c 2024-04-21T09:28:53.231 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/modechange.h 2024-04-21T09:28:53.235 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sys_stat.in.h 2024-04-21T09:28:53.240 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freading.c 2024-04-21T09:28:53.245 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/utimens.h 2024-04-21T09:28:53.249 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/md5.h 2024-04-21T09:28:53.253 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isnanf.c 2024-04-21T09:28:53.257 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sha1.c 2024-04-21T09:28:53.261 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/filenamecat-lgpl.c 2024-04-21T09:28:53.264 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/config.hin 2024-04-21T09:28:53.274 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/ignore-value.h 2024-04-21T09:28:53.278 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strstr.c 2024-04-21T09:28:53.282 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/verror.c 2024-04-21T09:28:53.286 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/randperm.h 2024-04-21T09:28:53.290 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/vasprintf.c 2024-04-21T09:28:53.293 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-strncasecmp.c 2024-04-21T09:28:53.298 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/basename-lgpl.c 2024-04-21T09:28:53.302 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/human.h 2024-04-21T09:28:53.307 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/regex.h 2024-04-21T09:28:53.313 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/regcomp.c 2024-04-21T09:28:53.324 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freadahead.c 2024-04-21T09:28:53.329 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/trim.h 2024-04-21T09:28:53.335 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getgroups.c 2024-04-21T09:28:53.340 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xprintf.c 2024-04-21T09:28:53.345 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/euidaccess-stat.h 2024-04-21T09:28:53.351 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/rand-isaac.h 2024-04-21T09:28:53.356 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mgetgroups.h 2024-04-21T09:28:53.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/selinux-at.h 2024-04-21T09:28:53.366 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-solaris.h 2024-04-21T09:28:53.373 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/setenv.c 2024-04-21T09:28:53.380 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/locale.in.h 2024-04-21T09:28:53.386 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/base64.h 2024-04-21T09:28:53.392 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/open-safer.c 2024-04-21T09:28:53.396 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/exitfail.c 2024-04-21T09:28:53.400 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/closeout.h 2024-04-21T09:28:53.404 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/idcache.c 2024-04-21T09:28:53.409 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unlink.c 2024-04-21T09:28:53.413 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xfts.c 2024-04-21T09:28:53.418 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memrchr.c 2024-04-21T09:28:53.421 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/Makefile.am 2024-04-21T09:28:53.426 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtol.h 2024-04-21T09:28:53.430 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gettimeofday.c 2024-04-21T09:28:53.434 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isnanf-nolibm.h 2024-04-21T09:28:53.438 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/chdir-long.c 2024-04-21T09:28:53.444 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbchar.c 2024-04-21T09:28:53.448 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/canon-host.h 2024-04-21T09:28:53.453 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unsetenv.c 2024-04-21T09:28:53.458 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freadseek.c 2024-04-21T09:28:53.463 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xnanosleep.c 2024-04-21T09:28:53.468 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/nanosleep.c 2024-04-21T09:28:53.475 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/ctype.in.h 2024-04-21T09:28:53.480 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xmalloc.c 2024-04-21T09:28:53.484 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strtoul.c 2024-04-21T09:28:53.490 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sha512.h 2024-04-21T09:28:53.495 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirchownmod.h 2024-04-21T09:28:53.500 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freadptr.h 2024-04-21T09:28:53.505 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getfilecon.c 2024-04-21T09:28:53.510 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/alignof.h 2024-04-21T09:28:53.516 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mempcpy.c 2024-04-21T09:28:53.521 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/savedir.h 2024-04-21T09:28:53.604 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/areadlink-with-size.c 2024-04-21T09:28:53.693 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/inttypes.in.h 2024-04-21T09:28:53.697 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/config.charset 2024-04-21T09:28:53.703 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtold.c 2024-04-21T09:28:53.707 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fcntl-safer.h 2024-04-21T09:28:53.712 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrndup.c 2024-04-21T09:28:53.716 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/write.c 2024-04-21T09:28:53.720 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/math.in.h 2024-04-21T09:28:53.726 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/openat-priv.h 2024-04-21T09:28:53.731 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/vasnprintf.h 2024-04-21T09:28:53.735 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getcwd.c 2024-04-21T09:28:53.740 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdbool.in.h 2024-04-21T09:28:53.746 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strtol.c 2024-04-21T09:28:53.751 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/argmatch.c 2024-04-21T09:28:53.756 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/acl_entries.c 2024-04-21T09:28:53.761 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/progname.c 2024-04-21T09:28:53.767 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mktime-internal.h 2024-04-21T09:28:53.772 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-frexpl.c 2024-04-21T09:28:53.777 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/offtostr.c 2024-04-21T09:28:53.784 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memchr2.h 2024-04-21T09:28:53.790 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtoumax.c 2024-04-21T09:28:53.795 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getdate.y 2024-04-21T09:28:53.805 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/close-hook.h 2024-04-21T09:28:53.810 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-parse.c 2024-04-21T09:28:53.817 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isnand.c 2024-04-21T09:28:53.823 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/timespec.h 2024-04-21T09:28:53.829 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getusershell.c 2024-04-21T09:28:53.835 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtod.c 2024-04-21T09:28:53.840 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/verror.h 2024-04-21T09:28:53.846 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/same.c 2024-04-21T09:28:53.851 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/quote.c 2024-04-21T09:28:53.857 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/raise.c 2024-04-21T09:28:53.862 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/link.c 2024-04-21T09:28:53.867 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/cloexec.h 2024-04-21T09:28:53.874 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sys_utsname.in.h 2024-04-21T09:28:53.881 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/cloexec.c 2024-04-21T09:28:53.886 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/vfprintf.c 2024-04-21T09:28:53.892 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/uniwidth/ 2024-04-21T09:28:53.897 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/uniwidth/cjk.h 2024-04-21T09:28:53.901 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/uniwidth/width.c 2024-04-21T09:28:53.908 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strtoull.c 2024-04-21T09:28:53.915 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/opendir-safer.c 2024-04-21T09:28:53.919 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hash-pjw.h 2024-04-21T09:28:53.926 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/uname.c 2024-04-21T09:28:53.932 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/full-read.c 2024-04-21T09:28:53.937 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/priv-set.h 2024-04-21T09:28:53.943 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/close.c 2024-04-21T09:28:53.949 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fpending.h 2024-04-21T09:28:53.955 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/i-ring.h 2024-04-21T09:28:53.961 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/nl_langinfo.c 2024-04-21T09:28:53.966 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xmemxfrm.h 2024-04-21T09:28:53.972 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-strcase.h 2024-04-21T09:28:53.978 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fchdir.c 2024-04-21T09:28:53.984 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/canon-host.c 2024-04-21T09:28:53.990 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/signbitf.c 2024-04-21T09:28:53.997 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xnanosleep.h 2024-04-21T09:28:54.004 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/tempname.c 2024-04-21T09:28:54.010 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xreadlink.c 2024-04-21T09:28:54.016 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xgetcwd.h 2024-04-21T09:28:54.022 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/regex.c 2024-04-21T09:28:54.028 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/diacrit.h 2024-04-21T09:28:54.033 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/posixver.c 2024-04-21T09:28:54.039 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getugroups.c 2024-04-21T09:28:54.045 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/readutmp.h 2024-04-21T09:28:54.050 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/quote.h 2024-04-21T09:28:54.055 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/quotearg.c 2024-04-21T09:28:54.063 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/filevercmp.c 2024-04-21T09:28:54.070 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-args.h 2024-04-21T09:28:54.077 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mountlist.h 2024-04-21T09:28:54.082 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtol-error.c 2024-04-21T09:28:54.089 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/rename.c 2024-04-21T09:28:54.095 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sha1.h 2024-04-21T09:28:54.101 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strndup.c 2024-04-21T09:28:54.108 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/priv-set.c 2024-04-21T09:28:54.113 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xfts.h 2024-04-21T09:28:54.119 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/argv-iter.c 2024-04-21T09:28:54.127 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdio--.h 2024-04-21T09:28:54.133 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/yesno.c 2024-04-21T09:28:54.139 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getopt.c 2024-04-21T09:28:54.147 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strpbrk.c 2024-04-21T09:28:54.153 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirname-lgpl.c 2024-04-21T09:28:54.158 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/filemode.h 2024-04-21T09:28:54.163 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbrtowc.c 2024-04-21T09:28:54.170 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open.c 2024-04-21T09:28:54.176 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/euidaccess-stat.c 2024-04-21T09:28:54.182 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stat-time.h 2024-04-21T09:28:54.188 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/frexpl.c 2024-04-21T09:28:54.193 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sys_select.in.h 2024-04-21T09:28:54.199 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strftime.h 2024-04-21T09:28:54.204 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strftime.c 2024-04-21T09:28:54.213 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-aix.gperf 2024-04-21T09:28:54.218 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/buffer-lcm.c 2024-04-21T09:28:54.224 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unistr.h 2024-04-21T09:28:54.232 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/modechange.c 2024-04-21T09:28:54.238 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/tempname.h 2024-04-21T09:28:54.243 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/faccessat.c 2024-04-21T09:28:54.250 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unicodeio.h 2024-04-21T09:28:54.255 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/filemode.c 2024-04-21T09:28:54.261 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strdup.c 2024-04-21T09:28:54.267 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strsignal.c 2024-04-21T09:28:54.273 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/euidaccess.c 2024-04-21T09:28:54.279 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/select.c 2024-04-21T09:28:54.285 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcoll.h 2024-04-21T09:28:54.291 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fseeko.c 2024-04-21T09:28:54.297 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/langinfo.in.h 2024-04-21T09:28:54.302 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getopt.in.h 2024-04-21T09:28:54.309 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/localcharset.c 2024-04-21T09:28:54.316 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isapipe.c 2024-04-21T09:28:54.322 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/settime.c 2024-04-21T09:28:54.328 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/bitrotate.h 2024-04-21T09:28:54.333 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isnanl-nolibm.h 2024-04-21T09:28:54.339 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fcntl.c 2024-04-21T09:28:54.345 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/exclude.h 2024-04-21T09:28:54.351 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/symlinkat.c 2024-04-21T09:28:54.357 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fpending.c 2024-04-21T09:28:54.363 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/savewd.c 2024-04-21T09:28:54.369 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fchownat.c 2024-04-21T09:28:54.376 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/root-dev-ino.h 2024-04-21T09:28:54.382 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/randread.h 2024-04-21T09:28:54.388 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freadseek.h 2024-04-21T09:28:54.395 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strtoll.c 2024-04-21T09:28:54.401 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdio-safer.h 2024-04-21T09:28:54.408 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strtoumax.c 2024-04-21T09:28:54.413 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/argv-iter.h 2024-04-21T09:28:54.418 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirent-safer.h 2024-04-21T09:28:54.424 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirent.in.h 2024-04-21T09:28:54.430 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/malloca.valgrind 2024-04-21T09:28:54.435 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/savewd.h 2024-04-21T09:28:54.441 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/uinttostr.c 2024-04-21T09:28:54.447 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getline.c 2024-04-21T09:28:54.454 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/chdir-long.h 2024-04-21T09:28:54.460 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/cycle-check.h 2024-04-21T09:28:54.465 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fts-cycle.c 2024-04-21T09:28:54.471 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/file-has-acl.c 2024-04-21T09:28:54.478 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/areadlink.h 2024-04-21T09:28:54.484 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sig2str.h 2024-04-21T09:28:54.489 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcpy.c 2024-04-21T09:28:54.495 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freading.h 2024-04-21T09:28:54.501 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/full-write.h 2024-04-21T09:28:54.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unistd.in.h 2024-04-21T09:28:54.515 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/symlink.c 2024-04-21T09:28:54.520 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/se-selinux.in.h 2024-04-21T09:28:54.526 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/write-any-file.h 2024-04-21T09:28:54.531 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-frexpl.h 2024-04-21T09:28:54.538 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/Makefile.in 2024-04-21T09:28:54.555 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/filenamecat.h 2024-04-21T09:28:54.561 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/malloca.c 2024-04-21T09:28:54.566 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/utimecmp.h 2024-04-21T09:28:54.572 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdlib.in.h 2024-04-21T09:28:54.579 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdio.in.h 2024-04-21T09:28:54.587 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbsinit.c 2024-04-21T09:28:54.607 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/diacrit.c 2024-04-21T09:28:54.724 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/se-context.in.h 2024-04-21T09:28:54.729 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xvasprintf.c 2024-04-21T09:28:54.733 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xgetcwd.c 2024-04-21T09:28:54.738 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sockets.h 2024-04-21T09:28:54.742 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/striconv.h 2024-04-21T09:28:54.746 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkstemp-safer.c 2024-04-21T09:28:54.751 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/u64.h 2024-04-21T09:28:54.756 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtoimax.c 2024-04-21T09:28:54.761 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/time_r.c 2024-04-21T09:28:54.767 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbchar.h 2024-04-21T09:28:54.772 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xtime.h 2024-04-21T09:28:54.778 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/set-mode-acl.c 2024-04-21T09:28:54.784 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/version-etc.c 2024-04-21T09:28:54.790 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dup2.c 2024-04-21T09:28:54.796 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unlinkat.c 2024-04-21T09:28:54.801 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sigprocmask.c 2024-04-21T09:28:54.808 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hash-triple.h 2024-04-21T09:28:54.814 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fprintftime.c 2024-04-21T09:28:54.820 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unistd--.h 2024-04-21T09:28:54.826 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/umaxtostr.c 2024-04-21T09:28:54.831 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/i-ring.c 2024-04-21T09:28:54.837 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/signbitd.c 2024-04-21T09:28:54.842 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/ftello.c 2024-04-21T09:28:54.849 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/lchown.c 2024-04-21T09:28:54.855 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/lstat.c 2024-04-21T09:28:54.860 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fpurge.c 2024-04-21T09:28:54.866 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fstatat.c 2024-04-21T09:28:54.872 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/lseek.c 2024-04-21T09:28:54.879 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fchmodat.c 2024-04-21T09:28:54.885 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/alloca.c 2024-04-21T09:28:54.893 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcmp.c 2024-04-21T09:28:54.899 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrndup.h 2024-04-21T09:28:54.904 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/frexp.c 2024-04-21T09:28:54.908 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/nproc.h 2024-04-21T09:28:54.913 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fsusage.h 2024-04-21T09:28:54.917 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fd-safer-flag.c 2024-04-21T09:28:54.923 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getdtablesize.c 2024-04-21T09:28:54.927 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/savedir.c 2024-04-21T09:28:54.932 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/wcwidth.c 2024-04-21T09:28:54.937 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbsstr.c 2024-04-21T09:28:54.944 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fpucw.h 2024-04-21T09:28:54.949 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-hpux.h 2024-04-21T09:28:54.956 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/readtokens0.h 2024-04-21T09:28:54.962 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getdate.c 2024-04-21T09:28:54.975 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/utimens.c 2024-04-21T09:28:54.982 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getndelim2.c 2024-04-21T09:28:54.989 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fflush.c 2024-04-21T09:28:54.996 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/version-etc-fsf.c 2024-04-21T09:28:55.003 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xsize.h 2024-04-21T09:28:55.010 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xgethostname.c 2024-04-21T09:28:55.015 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strnlen1.h 2024-04-21T09:28:55.020 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isnanl.c 2024-04-21T09:28:55.026 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/same-inode.h 2024-04-21T09:28:55.033 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/regex_internal.h 2024-04-21T09:28:55.040 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/full-read.h 2024-04-21T09:28:55.046 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/intprops.h 2024-04-21T09:28:55.052 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fsusage.c 2024-04-21T09:28:55.058 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/save-cwd.c 2024-04-21T09:28:55.064 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memchr.valgrind 2024-04-21T09:28:55.071 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/exitfail.h 2024-04-21T09:28:55.077 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-frexp.h 2024-04-21T09:28:55.083 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isblank.c 2024-04-21T09:28:55.089 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/arpa_inet.in.h 2024-04-21T09:28:55.094 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strerror.c 2024-04-21T09:28:55.101 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freadptr.c 2024-04-21T09:28:55.106 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/openat.h 2024-04-21T09:28:55.112 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-irix.h 2024-04-21T09:28:55.117 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/open.c 2024-04-21T09:28:55.123 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/vprintf.c 2024-04-21T09:28:55.129 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/same.h 2024-04-21T09:28:55.134 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gai_strerror.c 2024-04-21T09:28:55.140 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/imaxtostr.c 2024-04-21T09:28:55.145 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcmp2.h 2024-04-21T09:28:55.151 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xfreopen.c 2024-04-21T09:28:55.156 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/rand-isaac.c 2024-04-21T09:28:55.163 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/full-write.c 2024-04-21T09:28:55.169 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/rmdir.c 2024-04-21T09:28:55.173 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/save-cwd.h 2024-04-21T09:28:55.179 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/at-func2.c 2024-04-21T09:28:55.185 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gethrxtime.c 2024-04-21T09:28:55.190 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strtod.c 2024-04-21T09:28:55.197 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbsalign.c 2024-04-21T09:28:55.203 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-osf.gperf 2024-04-21T09:28:55.209 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/ref-add.sin 2024-04-21T09:28:55.214 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcmp2.c 2024-04-21T09:28:55.220 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gnulib.mk 2024-04-21T09:28:55.231 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/ref-del.sin 2024-04-21T09:28:55.238 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stpncpy.c 2024-04-21T09:28:55.244 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv.in.h 2024-04-21T09:28:55.250 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/posixtm.h 2024-04-21T09:28:55.257 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtol.c 2024-04-21T09:28:55.264 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getopt1.c 2024-04-21T09:28:55.268 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/quotearg.h 2024-04-21T09:28:55.274 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/cycle-check.c 2024-04-21T09:28:55.279 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/calloc.c 2024-04-21T09:28:55.285 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/areadlinkat.c 2024-04-21T09:28:55.290 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hash-triple.c 2024-04-21T09:28:55.296 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getpass.c 2024-04-21T09:28:55.301 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstriconv.c 2024-04-21T09:28:55.306 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirent--.h 2024-04-21T09:28:55.313 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sigaction.c 2024-04-21T09:28:55.320 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/linkat.c 2024-04-21T09:28:55.327 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unitypes.h 2024-04-21T09:28:55.331 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/linebuffer.c 2024-04-21T09:28:55.337 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fnmatch.c 2024-04-21T09:28:55.343 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xasprintf.c 2024-04-21T09:28:55.347 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-parse.h 2024-04-21T09:28:55.353 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/string.in.h 2024-04-21T09:28:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkdir.c 2024-04-21T09:28:55.367 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fchown-stub.c 2024-04-21T09:28:55.373 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/human.c 2024-04-21T09:28:55.379 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sockets.c 2024-04-21T09:28:55.385 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/canonicalize.h 2024-04-21T09:28:55.391 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getopt_int.h 2024-04-21T09:28:55.397 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/version-etc.h 2024-04-21T09:28:55.403 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdlib--.h 2024-04-21T09:28:55.408 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/backupfile.h 2024-04-21T09:28:55.414 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/file-type.c 2024-04-21T09:28:55.420 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/file-set.h 2024-04-21T09:28:55.426 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbuiter.h 2024-04-21T09:28:55.432 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fcntl.in.h 2024-04-21T09:28:55.439 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/inet_ntop.c 2024-04-21T09:28:55.445 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fseterr.c 2024-04-21T09:28:55.450 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/close-stream.h 2024-04-21T09:28:55.457 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freopen-safer.c 2024-04-21T09:28:55.462 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stat-macros.h 2024-04-21T09:28:55.468 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirname.c 2024-04-21T09:28:55.474 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dev-ino.h 2024-04-21T09:28:55.479 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xalloc.h 2024-04-21T09:28:55.485 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memcasecmp.h 2024-04-21T09:28:55.491 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hash.c 2024-04-21T09:28:55.499 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/userspec.c 2024-04-21T09:28:55.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hard-locale.h 2024-04-21T09:28:55.512 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xvasprintf.h 2024-04-21T09:28:55.519 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/wcrtomb.c 2024-04-21T09:28:55.524 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gethrxtime.h 2024-04-21T09:28:55.530 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fprintftime.h 2024-04-21T09:28:55.536 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mgetgroups.c 2024-04-21T09:28:55.540 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/randread.c 2024-04-21T09:28:55.546 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstriconv.h 2024-04-21T09:28:55.552 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dup-safer-flag.c 2024-04-21T09:28:55.558 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/yesno.h 2024-04-21T09:28:55.562 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbscasecmp.c 2024-04-21T09:28:55.567 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strtoimax.c 2024-04-21T09:28:55.574 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbsrtowcs-state.c 2024-04-21T09:28:55.579 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkstemp.c 2024-04-21T09:28:55.584 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xmemcoll.c 2024-04-21T09:28:55.589 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strintcmp.c 2024-04-21T09:28:55.595 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fclose.c 2024-04-21T09:28:55.600 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fd-reopen.c 2024-04-21T09:28:55.610 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/inttostr.c 2024-04-21T09:28:55.619 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-ctype.c 2024-04-21T09:28:55.626 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/openat-die.c 2024-04-21T09:28:55.632 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/error.c 2024-04-21T09:28:55.638 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sig2str.c 2024-04-21T09:28:55.644 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unlocked-io.h 2024-04-21T09:28:55.650 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memxfrm.c 2024-04-21T09:28:55.656 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/pipe-safer.c 2024-04-21T09:28:55.662 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/backupfile.c 2024-04-21T09:28:55.668 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-osf.h 2024-04-21T09:28:55.675 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/linebuffer.h 2024-04-21T09:28:55.681 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xprintf.h 2024-04-21T09:28:55.687 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/exclude.c 2024-04-21T09:28:55.694 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/userspec.h 2024-04-21T09:28:55.700 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkancesdirs.h 2024-04-21T09:28:55.705 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hash-pjw.c 2024-04-21T09:28:55.710 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fd-safer.c 2024-04-21T09:28:55.716 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/long-options.h 2024-04-21T09:28:55.721 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freadahead.h 2024-04-21T09:28:55.727 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gethostname.c 2024-04-21T09:28:55.734 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/putenv.c 2024-04-21T09:28:55.739 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbrlen.c 2024-04-21T09:28:55.745 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/group-member.c 2024-04-21T09:28:55.751 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sha512.c 2024-04-21T09:28:55.758 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/signal.in.h 2024-04-21T09:28:55.765 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mktime.c 2024-04-21T09:28:55.774 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/readlink.c 2024-04-21T09:28:55.780 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkdir-p.c 2024-04-21T09:28:55.787 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getndelim2.h 2024-04-21T09:28:55.793 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memxfrm.h 2024-04-21T09:28:55.798 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-strtod.c 2024-04-21T09:28:55.803 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fseterr.h 2024-04-21T09:28:55.810 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-hpux.gperf 2024-04-21T09:28:55.816 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/filenamecat.c 2024-04-21T09:28:55.821 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memmove.c 2024-04-21T09:28:55.827 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/str-kmp.h 2024-04-21T09:28:55.834 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/base64.c 2024-04-21T09:28:55.841 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/close-hook.c 2024-04-21T09:28:55.846 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/dirchownmod.c 2024-04-21T09:28:55.852 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/openat-safer.c 2024-04-21T09:28:55.858 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/posixtm.c 2024-04-21T09:28:55.863 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/printf-frexp.c 2024-04-21T09:28:55.870 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/safe-read.h 2024-04-21T09:28:55.875 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/regexec.c 2024-04-21T09:28:55.890 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/uniwidth.h 2024-04-21T09:28:55.896 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/write-any-file.c 2024-04-21T09:28:55.902 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-aix.h 2024-04-21T09:28:55.909 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/unicodeio.c 2024-04-21T09:28:55.915 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/gettime.c 2024-04-21T09:28:55.922 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strnumcmp.h 2024-04-21T09:28:55.928 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/btowc.c 2024-04-21T09:28:55.934 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sys_time.in.h 2024-04-21T09:28:55.939 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isnan.c 2024-04-21T09:28:55.945 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getaddrinfo.c 2024-04-21T09:28:55.952 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getpagesize.c 2024-04-21T09:28:55.958 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/posixver.h 2024-04-21T09:28:55.963 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/openat.c 2024-04-21T09:28:55.970 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/closeout.c 2024-04-21T09:28:55.976 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fopen.c 2024-04-21T09:28:55.982 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memchr2.valgrind 2024-04-21T09:28:55.988 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/time.in.h 2024-04-21T09:28:55.994 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/physmem.h 2024-04-21T09:28:55.999 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/iconv_open-irix.gperf 2024-04-21T09:28:56.005 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stat.c 2024-04-21T09:28:56.011 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/siglist.h 2024-04-21T09:28:56.016 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbswidth.h 2024-04-21T09:28:56.021 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtod.h 2024-04-21T09:28:56.027 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/md5.c 2024-04-21T09:28:56.034 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getloadavg.c 2024-04-21T09:28:56.042 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/getdate.h 2024-04-21T09:28:56.048 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdlib-safer.h 2024-04-21T09:28:56.053 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/remove.c 2024-04-21T09:28:56.059 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/malloc.c 2024-04-21T09:28:56.065 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/progname.h 2024-04-21T09:28:56.070 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/argmatch.h 2024-04-21T09:28:56.076 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/ChangeLog-2007 2024-04-21T09:28:56.103 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mbswidth.c 2024-04-21T09:28:56.108 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/error.h 2024-04-21T09:28:56.114 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/obstack.c 2024-04-21T09:28:56.121 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/acl.h 2024-04-21T09:28:56.127 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strnumcmp-in.h 2024-04-21T09:28:56.133 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xstrtoul.c 2024-04-21T09:28:56.138 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/float+.h 2024-04-21T09:28:56.145 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/canonicalize.c 2024-04-21T09:28:56.150 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fcntl--.h 2024-04-21T09:28:56.157 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/wchar.in.h 2024-04-21T09:28:56.163 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/trim.c 2024-04-21T09:28:56.169 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/rpmatch.c 2024-04-21T09:28:56.174 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isapipe.h 2024-04-21T09:28:56.180 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/memchr.c 2024-04-21T09:28:56.187 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/localcharset.h 2024-04-21T09:28:56.193 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/sig-handler.h 2024-04-21T09:28:56.198 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/openat-proc.c 2024-04-21T09:28:56.204 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/pathmax.h 2024-04-21T09:28:56.210 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/close-stream.c 2024-04-21T09:28:56.216 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/readutmp.c 2024-04-21T09:28:56.222 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/float.in.h 2024-04-21T09:28:56.228 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/creat-safer.c 2024-04-21T09:28:56.234 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/randperm.c 2024-04-21T09:28:56.240 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/readtokens.c 2024-04-21T09:28:56.245 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/safe-read.c 2024-04-21T09:28:56.251 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xreadlink.h 2024-04-21T09:28:56.257 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/stdarg.in.h 2024-04-21T09:28:56.262 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xalloc-die.c 2024-04-21T09:28:56.268 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/copy-acl.c 2024-04-21T09:28:56.275 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fsync.c 2024-04-21T09:28:56.281 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/strnumcmp.c 2024-04-21T09:28:56.287 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/selinux-at.c 2024-04-21T09:28:56.293 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/realloc.c 2024-04-21T09:28:56.299 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fdopendir.c 2024-04-21T09:28:56.305 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/alloca.in.h 2024-04-21T09:28:56.310 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/freopen.c 2024-04-21T09:28:56.316 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/mkdir-p.h 2024-04-21T09:28:56.322 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/isnand-nolibm.h 2024-04-21T09:28:56.329 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/propername.c 2024-04-21T09:28:56.337 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/fileblocks.c 2024-04-21T09:28:56.343 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xmemcoll.h 2024-04-21T09:28:56.350 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/hash.h 2024-04-21T09:28:56.356 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-strtold.c 2024-04-21T09:28:56.363 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/c-ctype.h 2024-04-21T09:28:56.369 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/lib/xmemxfrm.c 2024-04-21T09:28:56.375 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_require_config_h_first 2024-04-21T09:28:56.383 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ 2024-04-21T09:28:56.387 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/pt.po 2024-04-21T09:28:56.419 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/sl.po 2024-04-21T09:28:56.452 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/zh_TW.po 2024-04-21T09:28:56.475 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/sk.po 2024-04-21T09:28:56.511 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/el.gmo 2024-04-21T09:28:56.519 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/en.gmo 2024-04-21T09:28:56.524 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/lg.po 2024-04-21T09:28:56.563 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/sv.gmo 2024-04-21T09:28:56.593 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/pl.gmo 2024-04-21T09:28:56.624 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/insert-header.sin 2024-04-21T09:28:56.629 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/sk.gmo 2024-04-21T09:28:56.641 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ja.gmo 2024-04-21T09:28:56.651 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ko.po 2024-04-21T09:28:56.681 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/da.gmo 2024-04-21T09:28:56.699 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/LINGUAS 2024-04-21T09:28:56.704 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/zh_TW.gmo 2024-04-21T09:28:56.713 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/tr.gmo 2024-04-21T09:28:56.726 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/gl.gmo 2024-04-21T09:28:56.735 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/fi.po 2024-04-21T09:28:56.763 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/da.po 2024-04-21T09:28:56.788 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/fi.gmo 2024-04-21T09:28:56.808 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/quot.sed 2024-04-21T09:28:56.814 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/stamp-po 2024-04-21T09:28:56.820 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ms.gmo 2024-04-21T09:28:56.829 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/pt_BR.po 2024-04-21T09:28:56.862 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/Makevars 2024-04-21T09:28:56.869 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/boldquot.sed 2024-04-21T09:28:56.876 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/coreutils.pot 2024-04-21T09:28:56.893 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/de.po 2024-04-21T09:28:56.925 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/pt.gmo 2024-04-21T09:28:56.942 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/Makefile.in.in 2024-04-21T09:28:56.950 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/nl.gmo 2024-04-21T09:28:56.971 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/fr.gmo 2024-04-21T09:28:56.997 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ga.gmo 2024-04-21T09:28:57.016 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/cs.po 2024-04-21T09:28:57.056 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ru.po 2024-04-21T09:28:57.092 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/hu.po 2024-04-21T09:28:57.126 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/id.po 2024-04-21T09:28:57.159 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ru.gmo 2024-04-21T09:28:57.191 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/sl.gmo 2024-04-21T09:28:57.220 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/remove-potcdate.sin 2024-04-21T09:28:57.225 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/hu.gmo 2024-04-21T09:28:57.245 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/et.po 2024-04-21T09:28:57.276 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/gl.po 2024-04-21T09:28:57.317 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/vi.gmo 2024-04-21T09:28:57.343 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/bg.po 2024-04-21T09:28:57.377 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/pl.po 2024-04-21T09:28:57.401 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/nl.po 2024-04-21T09:28:57.421 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/pt_BR.gmo 2024-04-21T09:28:57.433 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ko.gmo 2024-04-21T09:28:57.442 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/de.gmo 2024-04-21T09:28:57.455 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/POTFILES.in 2024-04-21T09:28:57.459 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/sv.po 2024-04-21T09:28:57.475 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/it.po 2024-04-21T09:28:57.493 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/eu.gmo 2024-04-21T09:28:57.499 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/en.po 2024-04-21T09:28:57.510 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/it.gmo 2024-04-21T09:28:57.527 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/en@boldquot.header 2024-04-21T09:28:57.531 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/et.gmo 2024-04-21T09:28:57.540 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ja.po 2024-04-21T09:28:57.561 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/zh_CN.gmo 2024-04-21T09:28:57.578 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/uk.po 2024-04-21T09:28:57.596 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ca.gmo 2024-04-21T09:28:57.625 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/Rules-quot 2024-04-21T09:28:57.636 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ro.po 2024-04-21T09:28:57.651 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/nb.gmo 2024-04-21T09:28:57.656 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/bg.gmo 2024-04-21T09:28:57.669 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/be.po 2024-04-21T09:28:57.685 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/vi.po 2024-04-21T09:28:57.710 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/lt.gmo 2024-04-21T09:28:57.716 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/uk.gmo 2024-04-21T09:28:57.733 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/id.gmo 2024-04-21T09:28:57.752 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/af.po 2024-04-21T09:28:57.766 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/eu.po 2024-04-21T09:28:57.782 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ms.po 2024-04-21T09:28:57.799 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/en@quot.header 2024-04-21T09:28:57.804 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/af.gmo 2024-04-21T09:28:57.810 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/es.gmo 2024-04-21T09:28:57.818 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ga.po 2024-04-21T09:28:57.834 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ro.gmo 2024-04-21T09:28:57.840 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ca.po 2024-04-21T09:28:57.861 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/lg.gmo 2024-04-21T09:28:57.881 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/zh_CN.po 2024-04-21T09:28:57.902 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/cs.gmo 2024-04-21T09:28:57.918 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/nb.po 2024-04-21T09:28:57.934 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/ChangeLog-2007 2024-04-21T09:28:57.937 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/tr.po 2024-04-21T09:28:57.954 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/be.gmo 2024-04-21T09:28:57.960 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/fr.po 2024-04-21T09:28:57.979 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/el.po 2024-04-21T09:28:58.003 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/lt.po 2024-04-21T09:28:58.015 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/po/es.po 2024-04-21T09:28:58.034 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ 2024-04-21T09:28:58.038 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/ 2024-04-21T09:28:58.043 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/skip-seek 2024-04-21T09:28:58.047 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/unblock-sync 2024-04-21T09:28:58.051 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/skip-seek2 2024-04-21T09:28:58.053 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/unblock 2024-04-21T09:28:58.057 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/stderr 2024-04-21T09:28:58.061 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/direct 2024-04-21T09:28:58.064 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/skip-seek-past-file 2024-04-21T09:28:58.068 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/not-rewound 2024-04-21T09:28:58.072 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/skip-seek-past-dev 2024-04-21T09:28:58.075 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/misc 2024-04-21T09:28:58.077 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/dd/reblock 2024-04-21T09:28:58.082 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ 2024-04-21T09:28:58.085 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tt-FF 2024-04-21T09:28:58.090 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/t_tab_ 2024-04-21T09:28:58.094 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/FF 2024-04-21T09:28:58.098 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/FnFn 2024-04-21T09:28:58.101 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3ml24f-bl-tn 2024-04-21T09:28:58.105 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+5-8b3l17f-FF 2024-04-21T09:28:58.109 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+3ml24f-bl-tn 2024-04-21T09:28:58.113 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/FFtn 2024-04-21T09:28:58.117 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a2l15-FF 2024-04-21T09:28:58.122 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tFnFt 2024-04-21T09:28:58.125 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tn2e5o3-t_tab 2024-04-21T09:28:58.128 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3ml24f-t 2024-04-21T09:28:58.131 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nSml20-t-tFFFF 2024-04-21T09:28:58.133 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tn2e8-t_tab 2024-04-21T09:28:58.137 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b3f-FF 2024-04-21T09:28:58.140 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2w60f-t_notab 2024-04-21T09:28:58.143 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/FFn 2024-04-21T09:28:58.147 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/t_tab 2024-04-21T09:28:58.150 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b3-0F 2024-04-21T09:28:58.153 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+4-8a2l17-FF 2024-04-21T09:28:58.157 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+4b2l17f-0FF 2024-04-21T09:28:58.159 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3a3l15-t 2024-04-21T09:28:58.162 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tFFn 2024-04-21T09:28:58.165 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3l24f-t 2024-04-21T09:28:58.168 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0FnFt 2024-04-21T09:28:58.172 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3-FF 2024-04-21T09:28:58.175 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/t-FF 2024-04-21T09:28:58.179 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nSml24-bl-FF 2024-04-21T09:28:58.182 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+3l24f-bl 2024-04-21T09:28:58.186 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b3l15-t 2024-04-21T09:28:58.190 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3b3f-FF 2024-04-21T09:28:58.195 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3b3f-0F 2024-04-21T09:28:58.199 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W35b3l24f-lm 2024-04-21T09:28:58.204 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0Ft 2024-04-21T09:28:58.209 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tt-bl 2024-04-21T09:28:58.214 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3ml24-t-FF 2024-04-21T09:28:58.218 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tFFt-lm 2024-04-21T09:28:58.222 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nSml20-bl-FF 2024-04-21T09:28:58.226 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tn2e8o3-t_tab 2024-04-21T09:28:58.230 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W28l24f-ll 2024-04-21T09:28:58.233 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nSml24-t-tFFFF 2024-04-21T09:28:58.237 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/t-0FF 2024-04-21T09:28:58.242 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tb3-FF 2024-04-21T09:28:58.247 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3b3Sl24f-tn 2024-04-21T09:28:58.252 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3mSl24f-bl-tn 2024-04-21T09:28:58.257 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3b2l17-FF 2024-04-21T09:28:58.262 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2f-t_notab 2024-04-21T09:28:58.266 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b2l15-FF 2024-04-21T09:28:58.270 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3b3f-0FF 2024-04-21T09:28:58.274 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a3l15-t 2024-04-21T09:28:58.278 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3Jml24f-lm-lo 2024-04-21T09:28:58.281 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tb3-0FF 2024-04-21T09:28:58.285 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/l24-t 2024-04-21T09:28:58.289 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W35ml24f-lm-lo 2024-04-21T09:28:58.293 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a3-0F 2024-04-21T09:28:58.298 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml24f-0F 2024-04-21T09:28:58.302 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/loli 2024-04-21T09:28:58.306 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3ml24-t 2024-04-21T09:28:58.310 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a3l24f-lm 2024-04-21T09:28:58.315 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/Jb3l24f-lm 2024-04-21T09:28:58.318 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/t-t 2024-04-21T09:28:58.322 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0F 2024-04-21T09:28:58.326 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/w72l24f-ll 2024-04-21T09:28:58.329 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml24f-t 2024-04-21T09:28:58.333 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b3l15f-t 2024-04-21T09:28:58.337 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0FnFnt 2024-04-21T09:28:58.341 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b3l24f-lm 2024-04-21T09:28:58.345 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3mSnl24fbltn 2024-04-21T09:28:58.349 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nJml24f-lmlolm 2024-04-21T09:28:58.353 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3a3Sl24f-tn 2024-04-21T09:28:58.357 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tne8-t_tab 2024-04-21T09:28:58.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3ml24-FF 2024-04-21T09:28:58.365 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a3f-0FF 2024-04-21T09:28:58.369 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml20-FF-t 2024-04-21T09:28:58.373 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/pr-tests 2024-04-21T09:28:58.378 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W35Jb3l24f-lm 2024-04-21T09:28:58.384 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ttb3-0FF 2024-04-21T09:28:58.389 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nl24f-bl 2024-04-21T09:28:58.394 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nSml24-t-t-FF 2024-04-21T09:28:58.399 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3b3l15f-t 2024-04-21T09:28:58.404 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0FF 2024-04-21T09:28:58.409 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3f-0F 2024-04-21T09:28:58.413 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/Ja3l24f-lm 2024-04-21T09:28:58.417 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3a2l17-FF 2024-04-21T09:28:58.421 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml24f-t-0F 2024-04-21T09:28:58.425 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tn_2e8-t_tab 2024-04-21T09:28:58.429 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3a3Snl24f-tn 2024-04-21T09:28:58.433 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2s_w60f-t_nota 2024-04-21T09:28:58.437 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/t-bl 2024-04-21T09:28:58.440 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml24-t-FF 2024-04-21T09:28:58.444 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+3-7l24-FF 2024-04-21T09:28:58.448 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/t_notab 2024-04-21T09:28:58.452 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W72Jl24f-ll 2024-04-21T09:28:58.456 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a2l17-FF 2024-04-21T09:28:58.459 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml24-FF 2024-04-21T09:28:58.463 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b3f-0F 2024-04-21T09:28:58.467 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+3l24f-0FF 2024-04-21T09:28:58.471 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+3ml20f-bl-FF 2024-04-21T09:28:58.475 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a3f-0F 2024-04-21T09:28:58.479 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W35Jml24f-lmlo 2024-04-21T09:28:58.483 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W27l24f-ll 2024-04-21T09:28:58.486 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml24-t 2024-04-21T09:28:58.492 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a3f-FF 2024-04-21T09:28:58.497 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tFFt-bl 2024-04-21T09:28:58.502 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tta3-FF 2024-04-21T09:28:58.507 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3-0F 2024-04-21T09:28:58.511 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2sf-t_notab 2024-04-21T09:28:58.515 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3a3l15f-t 2024-04-21T09:28:58.518 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W26l24f-ll 2024-04-21T09:28:58.522 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+7l24-FF 2024-04-21T09:28:58.526 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ml24f-lm-lo 2024-04-21T09:28:58.530 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/l24-FF 2024-04-21T09:28:58.534 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+2-5l24f-0FF 2024-04-21T09:28:58.538 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3f-FF 2024-04-21T09:28:58.542 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+3ml24f-tn-bl 2024-04-21T09:28:58.546 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ta3-0FF 2024-04-21T09:28:58.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3b3l15-t 2024-04-21T09:28:58.554 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+2l24f-0FF 2024-04-21T09:28:58.558 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tn_2e8S-t_tab 2024-04-21T09:28:58.562 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ta3-FF 2024-04-21T09:28:58.566 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tFFt-ll 2024-04-21T09:28:58.570 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+6b3l13f-FF 2024-04-21T09:28:58.575 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2-Sf-t_notab 2024-04-21T09:28:58.580 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0FFnt 2024-04-21T09:28:58.584 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W20l24f-ll 2024-04-21T09:28:58.588 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/Jml24f-lm-lo 2024-04-21T09:28:58.592 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3l24-t 2024-04-21T09:28:58.597 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3b3l24f-tn 2024-04-21T09:28:58.600 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W35a3l24f-lm 2024-04-21T09:28:58.603 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2-S_f-t_notab 2024-04-21T09:28:58.609 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3-5l24f-t 2024-04-21T09:28:58.612 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3b3Snl24f-tn 2024-04-21T09:28:58.616 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+2l24f-bl 2024-04-21T09:28:58.628 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W35Ja3l24f-lm 2024-04-21T09:28:58.836 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+8l20-FF 2024-04-21T09:28:58.842 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0FFt 2024-04-21T09:28:58.848 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/o3a3l24f-tn 2024-04-21T09:28:58.853 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2s_f-t_notab 2024-04-21T09:28:58.859 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nN15l24f-bl 2024-04-21T09:28:58.865 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/0Fnt 2024-04-21T09:28:58.870 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/4-7l24-FF 2024-04-21T09:28:58.875 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tn 2024-04-21T09:28:58.880 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b2l17-FF 2024-04-21T09:28:58.884 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nJml24f-lmlmlo 2024-04-21T09:28:58.890 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tta3-0FF 2024-04-21T09:28:58.895 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+5a3l13f-0FF 2024-04-21T09:28:58.899 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nN1+3l24f-bl 2024-04-21T09:28:58.904 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/2sw60f-t_notab 2024-04-21T09:28:58.908 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/W-72l24f-ll 2024-04-21T09:28:58.912 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tt-0FF 2024-04-21T09:28:58.917 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/4l24-FF 2024-04-21T09:28:58.923 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/3a3f-0F 2024-04-21T09:28:59.009 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tFFt 2024-04-21T09:28:59.013 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/n+6a2l17-FF 2024-04-21T09:28:59.018 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/a3l15f-t 2024-04-21T09:28:59.023 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/l24f-t 2024-04-21T09:28:59.029 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/b3f-0FF 2024-04-21T09:28:59.034 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tt-t 2024-04-21T09:28:59.040 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/ttb3-FF 2024-04-21T09:28:59.045 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/nSml20-t-t-FF 2024-04-21T09:28:59.051 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/pr/tne8o3-t_tab 2024-04-21T09:28:59.056 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/Coreutils.pm 2024-04-21T09:28:59.063 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rmdir/ 2024-04-21T09:28:59.066 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rmdir/t-slash 2024-04-21T09:28:59.070 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rmdir/ignore 2024-04-21T09:28:59.075 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rmdir/fail-perm 2024-04-21T09:28:59.080 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/ 2024-04-21T09:28:59.086 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/ignorable 2024-04-21T09:28:59.091 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/r-2 2024-04-21T09:28:59.096 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/fail-2eperm 2024-04-21T09:28:59.101 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/empty-inacc 2024-04-21T09:28:59.106 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/cycle 2024-04-21T09:28:59.111 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/sunos-1 2024-04-21T09:28:59.117 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/v-slash 2024-04-21T09:28:59.123 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/no-give-up 2024-04-21T09:28:59.128 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/dot-rel 2024-04-21T09:28:59.133 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/one-file-system 2024-04-21T09:28:59.140 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/i-never 2024-04-21T09:28:59.147 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/rm1 2024-04-21T09:28:59.154 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/unread2 2024-04-21T09:28:59.163 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/read-only 2024-04-21T09:28:59.169 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/deep-2 2024-04-21T09:28:59.175 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/r-4 2024-04-21T09:28:59.181 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/dir-no-w 2024-04-21T09:28:59.186 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/interactive-always 2024-04-21T09:28:59.193 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/one-file-system2 2024-04-21T09:28:59.198 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/unreadable 2024-04-21T09:28:59.203 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/r-1 2024-04-21T09:28:59.209 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/fail-eacces 2024-04-21T09:28:59.214 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/inaccessible 2024-04-21T09:28:59.220 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/unread3 2024-04-21T09:28:59.225 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/ir-1 2024-04-21T09:28:59.230 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/rm3 2024-04-21T09:28:59.236 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/rm5 2024-04-21T09:28:59.242 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/deep-1 2024-04-21T09:28:59.248 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/ext3-perf 2024-04-21T09:28:59.253 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/dangling-symlink 2024-04-21T09:28:59.259 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/isatty 2024-04-21T09:28:59.265 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/i-1 2024-04-21T09:28:59.270 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/dir-nonrecur 2024-04-21T09:28:59.275 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/interactive-once 2024-04-21T09:28:59.281 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/f-1 2024-04-21T09:28:59.287 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/fail-eperm 2024-04-21T09:28:59.293 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/empty-name 2024-04-21T09:28:59.299 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/hash 2024-04-21T09:28:59.305 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/i-no-r 2024-04-21T09:28:59.311 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/r-3 2024-04-21T09:28:59.316 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/readdir-bug 2024-04-21T09:28:59.322 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/rm2 2024-04-21T09:28:59.328 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/rm/rm4 2024-04-21T09:28:59.334 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/test-lib.sh 2024-04-21T09:28:59.341 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/sample-test 2024-04-21T09:28:59.347 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chown/ 2024-04-21T09:28:59.351 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chown/basic 2024-04-21T09:28:59.357 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chown/separator 2024-04-21T09:28:59.363 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chown/deref 2024-04-21T09:28:59.368 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chown/preserve-root 2024-04-21T09:28:59.374 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/id/ 2024-04-21T09:28:59.379 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/id/no-context 2024-04-21T09:28:59.385 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/CuTmpdir.pm 2024-04-21T09:28:59.391 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/Makefile.am 2024-04-21T09:28:59.398 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/ 2024-04-21T09:28:59.402 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/dir-slash 2024-04-21T09:28:59.408 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/preserve-2 2024-04-21T09:28:59.414 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/dir-vs-file 2024-04-21T09:28:59.419 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/preserve-slink-time 2024-04-21T09:28:59.425 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/same-file 2024-04-21T09:28:59.432 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/src-base-dot 2024-04-21T09:28:59.438 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/cp-a-selinux 2024-04-21T09:28:59.444 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/r-vs-symlink 2024-04-21T09:28:59.449 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/capability 2024-04-21T09:28:59.455 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/existing-perm-race 2024-04-21T09:28:59.460 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/parent-perm-race 2024-04-21T09:28:59.467 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/reflink-auto 2024-04-21T09:28:59.472 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/cp-mv-enotsup-xattr 2024-04-21T09:28:59.478 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/no-deref-link2 2024-04-21T09:28:59.484 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/cp-mv-backup 2024-04-21T09:28:59.489 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/link-no-deref 2024-04-21T09:28:59.494 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/file-perm-race 2024-04-21T09:28:59.498 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/abuse 2024-04-21T09:28:59.504 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/link-heap 2024-04-21T09:28:59.511 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/backup-dir 2024-04-21T09:28:59.518 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/preserve-gid 2024-04-21T09:28:59.525 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/link 2024-04-21T09:28:59.532 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/cp-parents 2024-04-21T09:28:59.538 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/no-deref-link1 2024-04-21T09:28:59.544 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/into-self 2024-04-21T09:28:59.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/parent-perm 2024-04-21T09:28:59.556 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/cp-deref 2024-04-21T09:28:59.561 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/proc-short-read 2024-04-21T09:28:59.567 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/backup-is-src 2024-04-21T09:28:59.572 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/cp-i 2024-04-21T09:28:59.578 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/special-f 2024-04-21T09:28:59.582 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/proc-zero-len 2024-04-21T09:28:59.587 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/slink-2-slink 2024-04-21T09:28:59.592 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/special-bits 2024-04-21T09:28:59.597 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/fail-perm 2024-04-21T09:28:59.602 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/link-preserve 2024-04-21T09:28:59.607 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/dir-rm-dest 2024-04-21T09:28:59.612 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/backup-1 2024-04-21T09:28:59.617 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/cp-HL 2024-04-21T09:28:59.622 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/thru-dangling 2024-04-21T09:28:59.628 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/sparse 2024-04-21T09:28:59.691 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/deref-slink 2024-04-21T09:28:59.696 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/symlink-slash 2024-04-21T09:28:59.700 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/acl 2024-04-21T09:28:59.705 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/perm 2024-04-21T09:28:59.710 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/reflink-perm 2024-04-21T09:28:59.714 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/cp/no-deref-link3 2024-04-21T09:28:59.719 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/ 2024-04-21T09:28:59.724 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/t-slash 2024-04-21T09:28:59.728 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/p-v 2024-04-21T09:28:59.734 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/p-3 2024-04-21T09:28:59.739 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/writable-under-readonly 2024-04-21T09:28:59.743 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/p-slashdot 2024-04-21T09:28:59.748 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/selinux 2024-04-21T09:28:59.753 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/p-1 2024-04-21T09:28:59.758 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/p-2 2024-04-21T09:28:59.764 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/parents 2024-04-21T09:28:59.769 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/special-1 2024-04-21T09:28:59.774 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/perm 2024-04-21T09:28:59.779 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mkdir/p-thru-slink 2024-04-21T09:28:59.784 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/require-perl 2024-04-21T09:28:59.790 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/ 2024-04-21T09:28:59.793 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/target-1 2024-04-21T09:28:59.798 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/hard-to-sym 2024-04-21T09:28:59.803 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/hard-backup 2024-04-21T09:28:59.809 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/sf-1 2024-04-21T09:28:59.813 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/backup-1 2024-04-21T09:28:59.819 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/slash-decorated-nonexistent-dest 2024-04-21T09:28:59.825 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ln/misc 2024-04-21T09:28:59.830 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/lang-default 2024-04-21T09:28:59.837 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/check.mk 2024-04-21T09:28:59.842 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/Makefile.in 2024-04-21T09:28:59.857 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/ 2024-04-21T09:28:59.861 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/create-leading 2024-04-21T09:28:59.867 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/install-C-selinux 2024-04-21T09:28:59.873 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/trap 2024-04-21T09:28:59.880 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/basic-1 2024-04-21T09:28:59.886 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/strip-program 2024-04-21T09:28:59.893 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/d-slashdot 2024-04-21T09:28:59.899 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/install-C 2024-04-21T09:28:59.906 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/install/install-C-root 2024-04-21T09:28:59.913 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/ 2024-04-21T09:28:59.919 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/c-option 2024-04-21T09:28:59.924 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/octal 2024-04-21T09:28:59.930 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/umask-x 2024-04-21T09:28:59.935 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/inaccessible 2024-04-21T09:28:59.941 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/equal-x 2024-04-21T09:28:59.946 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/silent 2024-04-21T09:28:59.952 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/equals 2024-04-21T09:28:59.958 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/usage 2024-04-21T09:28:59.964 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/thru-dangling 2024-04-21T09:28:59.969 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/setgid 2024-04-21T09:28:59.975 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chmod/no-x 2024-04-21T09:28:59.981 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/df/ 2024-04-21T09:28:59.986 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/df/unreadable 2024-04-21T09:28:59.992 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/df/total-verify 2024-04-21T09:28:59.998 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/other-fs-tmpdir 2024-04-21T09:29:00.005 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/ 2024-04-21T09:29:00.010 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/basic 2024-04-21T09:29:00.016 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/exclude 2024-04-21T09:29:00.023 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/one-file-system 2024-04-21T09:29:00.029 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/long-sloop 2024-04-21T09:29:00.037 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/slink 2024-04-21T09:29:00.043 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/inacc-dir 2024-04-21T09:29:00.049 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/inaccessible-cwd 2024-04-21T09:29:00.056 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/inacc-dest 2024-04-21T09:29:00.063 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/deref-args 2024-04-21T09:29:00.069 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/deref 2024-04-21T09:29:00.076 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/trailing-slash 2024-04-21T09:29:00.082 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/files0-from 2024-04-21T09:29:00.088 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/two-args 2024-04-21T09:29:00.093 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/hard-link 2024-04-21T09:29:00.099 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/long-from-unreadable 2024-04-21T09:29:00.104 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/8gb 2024-04-21T09:29:00.109 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/2g 2024-04-21T09:29:00.114 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/restore-wd 2024-04-21T09:29:00.119 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/slash 2024-04-21T09:29:00.125 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/no-x 2024-04-21T09:29:00.129 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/fd-leak 2024-04-21T09:29:00.135 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/du/no-deref 2024-04-21T09:29:00.140 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/ 2024-04-21T09:29:00.144 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/recursive 2024-04-21T09:29:00.150 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/readdir-mountpoint-inode 2024-04-21T09:29:00.155 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/multihardlink 2024-04-21T09:29:00.160 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/color-dtype-dir 2024-04-21T09:29:00.166 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/file-type 2024-04-21T09:29:00.172 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/rt-1 2024-04-21T09:29:00.177 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/stat-free-symlinks 2024-04-21T09:29:00.182 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/no-cap 2024-04-21T09:29:00.187 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/capability 2024-04-21T09:29:00.192 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/inode 2024-04-21T09:29:00.196 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/color-norm 2024-04-21T09:29:00.201 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/abmon-align 2024-04-21T09:29:00.206 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/dangle 2024-04-21T09:29:00.211 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/dired 2024-04-21T09:29:00.216 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/m-option 2024-04-21T09:29:00.222 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/nameless-uid 2024-04-21T09:29:00.226 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/proc-selinux-segfault 2024-04-21T09:29:00.230 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/stat-vs-dirent 2024-04-21T09:29:00.234 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/color-clear-to-eol 2024-04-21T09:29:00.238 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/no-arg 2024-04-21T09:29:00.243 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/follow-slink 2024-04-21T09:29:00.247 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/symlink-slash 2024-04-21T09:29:00.251 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/stat-dtype 2024-04-21T09:29:00.255 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/x-option 2024-04-21T09:29:00.258 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/infloop 2024-04-21T09:29:00.261 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/ls/stat-failed 2024-04-21T09:29:00.264 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/ 2024-04-21T09:29:00.268 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/hard-3 2024-04-21T09:29:00.271 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/mv-n 2024-04-21T09:29:00.274 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/to-symlink 2024-04-21T09:29:00.278 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/part-fail 2024-04-21T09:29:00.281 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/hard-4 2024-04-21T09:29:00.283 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/leak-fd 2024-04-21T09:29:00.286 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/no-target-dir 2024-04-21T09:29:00.289 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/part-rename 2024-04-21T09:29:00.292 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/dir-file 2024-04-21T09:29:00.295 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/hard-2 2024-04-21T09:29:00.298 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/part-hardlink 2024-04-21T09:29:00.302 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/sticky-to-xpart 2024-04-21T09:29:00.305 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/mv-special-1 2024-04-21T09:29:00.308 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/trailing-slash 2024-04-21T09:29:00.311 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/dir2dir 2024-04-21T09:29:00.314 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/into-self-2 2024-04-21T09:29:00.317 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/backup-dir 2024-04-21T09:29:00.320 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/diag 2024-04-21T09:29:00.323 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/atomic 2024-04-21T09:29:00.327 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/force 2024-04-21T09:29:00.330 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/into-self-3 2024-04-21T09:29:00.333 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/into-self 2024-04-21T09:29:00.337 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/i-2 2024-04-21T09:29:00.340 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/childproof 2024-04-21T09:29:00.344 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/perm-1 2024-04-21T09:29:00.347 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/i-3 2024-04-21T09:29:00.350 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/partition-perm 2024-04-21T09:29:00.354 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/part-symlink 2024-04-21T09:29:00.358 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/backup-is-src 2024-04-21T09:29:00.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/i-1 2024-04-21T09:29:00.365 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/update 2024-04-21T09:29:00.368 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/i-4 2024-04-21T09:29:00.371 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/hard-verbose 2024-04-21T09:29:00.374 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/dup-source 2024-04-21T09:29:00.378 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/i-link-no 2024-04-21T09:29:00.382 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/atomic2 2024-04-21T09:29:00.385 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/into-self-4 2024-04-21T09:29:00.390 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/hard-link-1 2024-04-21T09:29:00.394 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/i-5 2024-04-21T09:29:00.398 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/mv/acl 2024-04-21T09:29:00.403 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/ 2024-04-21T09:29:00.407 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/fifo 2024-04-21T09:29:00.411 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/empty-file 2024-04-21T09:29:00.415 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/read-only 2024-04-21T09:29:00.419 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/fail-diag 2024-04-21T09:29:00.425 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/trailing-slash 2024-04-21T09:29:00.429 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/no-dereference 2024-04-21T09:29:00.434 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/dir-1 2024-04-21T09:29:00.437 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/dangling-symlink 2024-04-21T09:29:00.442 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/now-owned-by-other 2024-04-21T09:29:00.447 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/no-create-missing 2024-04-21T09:29:00.451 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/no-rights 2024-04-21T09:29:00.455 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/obsolescent 2024-04-21T09:29:00.460 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/60-seconds 2024-04-21T09:29:00.465 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/not-owner 2024-04-21T09:29:00.469 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/touch/relative 2024-04-21T09:29:00.474 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/ 2024-04-21T09:29:00.479 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-merge-fdlimit 2024-04-21T09:29:00.483 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/basename 2024-04-21T09:29:00.488 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stat-fmt 2024-04-21T09:29:00.492 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/pr 2024-04-21T09:29:00.497 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/dirname 2024-04-21T09:29:00.502 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/chcon-fail 2024-04-21T09:29:00.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/head-elide-tail 2024-04-21T09:29:00.511 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/chroot-credentials 2024-04-21T09:29:00.517 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/nl 2024-04-21T09:29:00.522 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tee-dash 2024-04-21T09:29:00.526 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stat-hyphen 2024-04-21T09:29:00.530 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-rand 2024-04-21T09:29:00.535 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/expr 2024-04-21T09:29:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/fmt-long-line 2024-04-21T09:29:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/split-fail 2024-04-21T09:29:00.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-relative 2024-04-21T09:29:00.556 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-dir-fail 2024-04-21T09:29:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/csplit 2024-04-21T09:29:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/od-N 2024-04-21T09:29:00.569 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/xattr 2024-04-21T09:29:00.574 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/mktemp 2024-04-21T09:29:00.578 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/cut 2024-04-21T09:29:00.583 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/cat-proc 2024-04-21T09:29:00.588 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/comm 2024-04-21T09:29:00.593 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/timeout-parameters 2024-04-21T09:29:00.597 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tac-continue 2024-04-21T09:29:00.601 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tty-eof 2024-04-21T09:29:00.606 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/df-P 2024-04-21T09:29:00.613 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/shuf 2024-04-21T09:29:00.617 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/env 2024-04-21T09:29:00.622 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/od 2024-04-21T09:29:00.626 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/split-a 2024-04-21T09:29:00.631 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tail 2024-04-21T09:29:00.635 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stat-slash 2024-04-21T09:29:00.639 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/timeout 2024-04-21T09:29:00.643 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/close-stdout 2024-04-21T09:29:00.648 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/wc-files0-from 2024-04-21T09:29:00.652 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sum 2024-04-21T09:29:00.681 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/expand 2024-04-21T09:29:00.780 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sum-sysv 2024-04-21T09:29:00.785 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/wc-parallel 2024-04-21T09:29:00.789 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/md5sum-newline 2024-04-21T09:29:00.794 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sha224sum 2024-04-21T09:29:00.798 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stty 2024-04-21T09:29:00.802 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/printf-hex 2024-04-21T09:29:00.807 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/id-context 2024-04-21T09:29:00.812 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stat-printf 2024-04-21T09:29:00.816 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/pwd-option 2024-04-21T09:29:00.821 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sha256sum 2024-04-21T09:29:00.825 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-version 2024-04-21T09:29:00.831 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/groups-dash 2024-04-21T09:29:00.836 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/printenv 2024-04-21T09:29:00.841 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/seq 2024-04-21T09:29:00.847 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/fmt 2024-04-21T09:29:00.853 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/cat-buf 2024-04-21T09:29:00.858 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/dircolors 2024-04-21T09:29:00.863 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/fold 2024-04-21T09:29:00.869 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/selinux 2024-04-21T09:29:00.875 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/md5sum-parallel 2024-04-21T09:29:00.881 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/md5sum 2024-04-21T09:29:00.887 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/nice-fail 2024-04-21T09:29:00.893 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/groups-version 2024-04-21T09:29:00.899 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/date-sec 2024-04-21T09:29:00.904 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/split-l 2024-04-21T09:29:00.910 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/false-status 2024-04-21T09:29:00.916 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sha384sum 2024-04-21T09:29:00.922 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-dangling-symlink 2024-04-21T09:29:00.928 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/od-multiple-t 2024-04-21T09:29:00.935 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/wc-files0 2024-04-21T09:29:00.940 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/nohup 2024-04-21T09:29:00.946 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-no-create-missing 2024-04-21T09:29:00.952 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/head-pos 2024-04-21T09:29:00.957 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/uniq 2024-04-21T09:29:00.964 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/test-diag 2024-04-21T09:29:00.970 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tac 2024-04-21T09:29:00.976 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-continue 2024-04-21T09:29:00.982 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/head 2024-04-21T09:29:00.987 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/ptx 2024-04-21T09:29:00.993 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/nproc-avail 2024-04-21T09:29:00.999 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/su-fail 2024-04-21T09:29:01.005 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/od-x8 2024-04-21T09:29:01.011 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/nice 2024-04-21T09:29:01.017 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/chcon 2024-04-21T09:29:01.024 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/head-c 2024-04-21T09:29:01.030 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-compress 2024-04-21T09:29:01.036 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/df 2024-04-21T09:29:01.041 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/chroot-fail 2024-04-21T09:29:01.047 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/date-next-dow 2024-04-21T09:29:01.054 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sha1sum 2024-04-21T09:29:01.060 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sha1sum-vec 2024-04-21T09:29:01.079 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/pathchk1 2024-04-21T09:29:01.085 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/arch 2024-04-21T09:29:01.092 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-month 2024-04-21T09:29:01.099 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/shred-passes 2024-04-21T09:29:01.104 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sha512sum 2024-04-21T09:29:01.110 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/paste 2024-04-21T09:29:01.116 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/wc 2024-04-21T09:29:01.122 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/ls-time 2024-04-21T09:29:01.129 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/pwd-unreadable-parent 2024-04-21T09:29:01.133 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/test 2024-04-21T09:29:01.139 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-parameters 2024-04-21T09:29:01.145 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-files0-from 2024-04-21T09:29:01.151 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/base64 2024-04-21T09:29:01.157 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/ptx-overrun 2024-04-21T09:29:01.164 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/printf-cov 2024-04-21T09:29:01.171 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tee 2024-04-21T09:29:01.178 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/mknod 2024-04-21T09:29:01.184 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/printf-surprise 2024-04-21T09:29:01.190 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/ls-misc 2024-04-21T09:29:01.197 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/nproc-positive 2024-04-21T09:29:01.202 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/join 2024-04-21T09:29:01.209 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort-merge 2024-04-21T09:29:01.216 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/factor 2024-04-21T09:29:01.223 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/sort 2024-04-21T09:29:01.230 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-fifo 2024-04-21T09:29:01.236 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-fail-diag 2024-04-21T09:29:01.242 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stty-invalid 2024-04-21T09:29:01.248 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/env-null 2024-04-21T09:29:01.254 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/printf 2024-04-21T09:29:01.260 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/seq-long-double 2024-04-21T09:29:01.266 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/pwd-long 2024-04-21T09:29:01.271 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tsort 2024-04-21T09:29:01.277 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/runcon-no-reorder 2024-04-21T09:29:01.282 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/date 2024-04-21T09:29:01.290 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/shred-exact 2024-04-21T09:29:01.295 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/shred-remove 2024-04-21T09:29:01.301 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stdbuf 2024-04-21T09:29:01.308 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-overflow 2024-04-21T09:29:01.313 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/stty-row-col 2024-04-21T09:29:01.320 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/truncate-owned-by-other 2024-04-21T09:29:01.326 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/xstrtol 2024-04-21T09:29:01.333 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/invalid-opt 2024-04-21T09:29:01.338 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/readlink-fp-loop 2024-04-21T09:29:01.344 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/tr 2024-04-21T09:29:01.350 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/help-version 2024-04-21T09:29:01.356 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/id-groups 2024-04-21T09:29:01.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/misc/unexpand 2024-04-21T09:29:01.368 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chgrp/ 2024-04-21T09:29:01.373 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chgrp/basic 2024-04-21T09:29:01.379 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chgrp/default-no-deref 2024-04-21T09:29:01.385 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chgrp/deref 2024-04-21T09:29:01.390 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chgrp/posix-H 2024-04-21T09:29:01.396 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chgrp/recurse 2024-04-21T09:29:01.403 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/chgrp/no-x 2024-04-21T09:29:01.408 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/ 2024-04-21T09:29:01.414 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/big-4gb 2024-04-21T09:29:01.419 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/follow-stdin 2024-04-21T09:29:01.425 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/F-vs-rename 2024-04-21T09:29:01.431 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/inotify-rotate 2024-04-21T09:29:01.437 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/pid 2024-04-21T09:29:01.443 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/infloop-1 2024-04-21T09:29:01.448 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/assert-2 2024-04-21T09:29:01.455 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/pipe-f 2024-04-21T09:29:01.461 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/pipe-f2 2024-04-21T09:29:01.466 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/start-middle 2024-04-21T09:29:01.472 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/inotify-hash-abuse2 2024-04-21T09:29:01.478 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/inotify-hash-abuse 2024-04-21T09:29:01.484 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/inotify-race 2024-04-21T09:29:01.489 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/append-only 2024-04-21T09:29:01.495 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/tail-n0f 2024-04-21T09:29:01.501 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/flush-initial 2024-04-21T09:29:01.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/assert 2024-04-21T09:29:01.513 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/wait 2024-04-21T09:29:01.519 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/tail-2/proc-ksyms 2024-04-21T09:29:01.525 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/envvar-check 2024-04-21T09:29:01.531 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/readlink/ 2024-04-21T09:29:01.536 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/readlink/can-f 2024-04-21T09:29:01.542 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/readlink/can-m 2024-04-21T09:29:01.547 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/readlink/rl-1 2024-04-21T09:29:01.553 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/tests/readlink/can-e 2024-04-21T09:29:01.559 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_trailing_blank 2024-04-21T09:29:01.566 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/ 2024-04-21T09:29:01.569 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/coreutils.texi 2024-04-21T09:29:01.607 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/perm.texi 2024-04-21T09:29:01.626 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/version.texi 2024-04-21T09:29:01.631 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/Makefile.am 2024-04-21T09:29:01.638 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/coreutils.info 2024-04-21T09:29:01.732 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/stamp-vti 2024-04-21T09:29:01.909 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/fdl.texi 2024-04-21T09:29:01.917 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/Makefile.in 2024-04-21T09:29:01.929 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/getdate.texi 2024-04-21T09:29:01.937 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/constants.texi 2024-04-21T09:29:01.943 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/doc/ChangeLog-2007 2024-04-21T09:29:01.954 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ 2024-04-21T09:29:01.959 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/split.c 2024-04-21T09:29:01.966 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/dircolors.hin 2024-04-21T09:29:01.972 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/test.c 2024-04-21T09:29:01.979 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/nproc.c 2024-04-21T09:29:01.985 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/cp-hash.c 2024-04-21T09:29:01.990 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/rm.c 2024-04-21T09:29:01.995 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/uname-arch.c 2024-04-21T09:29:01.999 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/chroot.c 2024-04-21T09:29:02.005 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/remove.h 2024-04-21T09:29:02.009 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/users.c 2024-04-21T09:29:02.014 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/dircolors.c 2024-04-21T09:29:02.020 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/join.c 2024-04-21T09:29:02.027 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/chown.c 2024-04-21T09:29:02.033 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/shuf.c 2024-04-21T09:29:02.039 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/sum.c 2024-04-21T09:29:02.045 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/csplit.c 2024-04-21T09:29:02.053 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/libstdbuf.c 2024-04-21T09:29:02.059 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/fold.c 2024-04-21T09:29:02.063 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/basename.c 2024-04-21T09:29:02.070 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/prog-fprintf.h 2024-04-21T09:29:02.074 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/sync.c 2024-04-21T09:29:02.080 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/lbracket.c 2024-04-21T09:29:02.086 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ln.c 2024-04-21T09:29:02.096 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/tsort.c 2024-04-21T09:29:02.103 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/wc.c 2024-04-21T09:29:02.112 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/extract-magic 2024-04-21T09:29:02.119 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/hostid.c 2024-04-21T09:29:02.124 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/dd.c 2024-04-21T09:29:02.134 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/shred.c 2024-04-21T09:29:02.142 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/uname.h 2024-04-21T09:29:02.147 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/unlink.c 2024-04-21T09:29:02.152 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/Makefile.am 2024-04-21T09:29:02.160 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/seq.c 2024-04-21T09:29:02.168 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/uname-uname.c 2024-04-21T09:29:02.174 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ptx.c 2024-04-21T09:29:02.185 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/wheel-size.h 2024-04-21T09:29:02.189 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/stty.c 2024-04-21T09:29:02.199 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/chcon.c 2024-04-21T09:29:02.207 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/dcgen 2024-04-21T09:29:02.212 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/uptime.c 2024-04-21T09:29:02.218 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/link.c 2024-04-21T09:29:02.223 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/install.c 2024-04-21T09:29:02.230 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/uname.c 2024-04-21T09:29:02.235 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/mknod.c 2024-04-21T09:29:02.240 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/su.c 2024-04-21T09:29:02.246 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/expand.c 2024-04-21T09:29:02.250 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/mv.c 2024-04-21T09:29:02.256 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ls.c 2024-04-21T09:29:02.270 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/whoami.c 2024-04-21T09:29:02.274 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ls-ls.c 2024-04-21T09:29:02.279 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ls.h 2024-04-21T09:29:02.284 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/id.c 2024-04-21T09:29:02.291 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/Makefile.in 2024-04-21T09:29:02.307 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/du.c 2024-04-21T09:29:02.315 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/cut.c 2024-04-21T09:29:02.322 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/comm.c 2024-04-21T09:29:02.329 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/od.c 2024-04-21T09:29:02.339 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/expr.c 2024-04-21T09:29:02.345 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/nohup.c 2024-04-21T09:29:02.351 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/system.h 2024-04-21T09:29:02.358 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/cat.c 2024-04-21T09:29:02.365 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/mktemp.c 2024-04-21T09:29:02.371 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/tac.c 2024-04-21T09:29:02.379 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ls-dir.c 2024-04-21T09:29:02.385 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/tac-pipe.c 2024-04-21T09:29:02.392 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/touch.c 2024-04-21T09:29:02.399 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/false.c 2024-04-21T09:29:02.405 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/echo.c 2024-04-21T09:29:02.411 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/printenv.c 2024-04-21T09:29:02.416 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/logname.c 2024-04-21T09:29:02.422 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/group-list.c 2024-04-21T09:29:02.428 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/pr.c 2024-04-21T09:29:02.440 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/chgrp.c 2024-04-21T09:29:02.447 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/cp-hash.h 2024-04-21T09:29:02.453 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/getlimits.c 2024-04-21T09:29:02.459 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/rmdir.c 2024-04-21T09:29:02.465 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/tail.c 2024-04-21T09:29:02.476 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/timeout.c 2024-04-21T09:29:02.483 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/sort.c 2024-04-21T09:29:02.495 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/operand2sig.c 2024-04-21T09:29:02.500 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/factor.c 2024-04-21T09:29:02.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/paste.c 2024-04-21T09:29:02.512 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/chmod.c 2024-04-21T09:29:02.518 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/pinky.c 2024-04-21T09:29:02.525 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/unexpand.c 2024-04-21T09:29:02.533 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/cksum.c 2024-04-21T09:29:02.539 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/date.c 2024-04-21T09:29:02.545 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/mkdir.c 2024-04-21T09:29:02.551 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/printf.c 2024-04-21T09:29:02.561 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/true.c 2024-04-21T09:29:02.567 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/c99-to-c89.diff 2024-04-21T09:29:02.573 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/groups.c 2024-04-21T09:29:02.578 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/dirname.c 2024-04-21T09:29:02.584 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/chown-core.h 2024-04-21T09:29:02.590 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/fs.h 2024-04-21T09:29:02.595 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/nl.c 2024-04-21T09:29:02.602 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/tee.c 2024-04-21T09:29:02.608 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/dircolors.h 2024-04-21T09:29:02.614 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/head.c 2024-04-21T09:29:02.622 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/uniq.c 2024-04-21T09:29:02.630 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/chown-core.c 2024-04-21T09:29:02.636 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/runcon.c 2024-04-21T09:29:02.641 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/sleep.c 2024-04-21T09:29:02.646 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/md5sum.c 2024-04-21T09:29:02.654 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/yes.c 2024-04-21T09:29:02.659 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/readlink.c 2024-04-21T09:29:02.664 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/env.c 2024-04-21T09:29:02.670 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/df.c 2024-04-21T09:29:02.678 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/nice.c 2024-04-21T09:29:02.682 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/fmt.c 2024-04-21T09:29:02.690 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/base64.c 2024-04-21T09:29:02.697 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/tty.c 2024-04-21T09:29:02.702 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/truncate.c 2024-04-21T09:29:02.719 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/mkfifo.c 2024-04-21T09:29:02.752 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/operand2sig.h 2024-04-21T09:29:02.757 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/copy.h 2024-04-21T09:29:02.763 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/kill.c 2024-04-21T09:29:02.769 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/who.c 2024-04-21T09:29:02.777 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/stat.c 2024-04-21T09:29:02.784 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/remove.c 2024-04-21T09:29:02.791 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/pwd.c 2024-04-21T09:29:02.797 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/prog-fprintf.c 2024-04-21T09:29:02.802 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/ls-vdir.c 2024-04-21T09:29:02.808 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/copy.c 2024-04-21T09:29:02.820 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/hostname.c 2024-04-21T09:29:02.825 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/wheel-gen.pl 2024-04-21T09:29:02.831 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/group-list.h 2024-04-21T09:29:02.837 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/cp.c 2024-04-21T09:29:02.845 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/setuidgid.c 2024-04-21T09:29:02.852 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/tr.c 2024-04-21T09:29:02.861 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/stdbuf.c 2024-04-21T09:29:02.867 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/pathchk.c 2024-04-21T09:29:02.873 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/src/wheel.h 2024-04-21T09:29:02.879 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/configure 2024-04-21T09:29:03.005 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/README 2024-04-21T09:29:03.011 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.vg-suppressions 2024-04-21T09:29:03.017 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_prohibit_atoi_atof 2024-04-21T09:29:03.023 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_prohibit_stat_st_blocks 2024-04-21T09:29:03.029 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/ChangeLog-2006 2024-04-21T09:29:03.043 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_program_name 2024-04-21T09:29:03.048 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/THANKStt.in 2024-04-21T09:29:03.054 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/ChangeLog-2008 2024-04-21T09:29:03.060 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/ChangeLog-2007 2024-04-21T09:29:03.078 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/ 2024-04-21T09:29:03.083 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-isnand.h 2024-04-21T09:29:03.090 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-ftello.sh 2024-04-21T09:29:03.096 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-snprintf.c 2024-04-21T09:29:03.102 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-openat.c 2024-04-21T09:29:03.108 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-dirent-safer.c 2024-04-21T09:29:03.113 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-cloexec.c 2024-04-21T09:29:03.119 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fstatat.c 2024-04-21T09:29:03.124 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fnmatch.c 2024-04-21T09:29:03.129 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getndelim2.c 2024-04-21T09:29:03.135 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-wcrtomb.sh 2024-04-21T09:29:03.141 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-filenamecat.c 2024-04-21T09:29:03.147 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fchownat.c 2024-04-21T09:29:03.152 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stdlib.c 2024-04-21T09:29:03.157 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-read-file.c 2024-04-21T09:29:03.164 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude7.sh 2024-04-21T09:29:03.170 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-closein.c 2024-04-21T09:29:03.175 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/connect.c 2024-04-21T09:29:03.180 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-rename.h 2024-04-21T09:29:03.186 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-memchr2.c 2024-04-21T09:29:03.192 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sys_time.c 2024-04-21T09:29:03.197 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/read-file.h 2024-04-21T09:29:03.202 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mkdirat.c 2024-04-21T09:29:03.207 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-isnand-nolibm.c 2024-04-21T09:29:03.212 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fopen-safer.c 2024-04-21T09:29:03.217 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stdio.c 2024-04-21T09:29:03.223 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fseeko.c 2024-04-21T09:29:03.228 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-arpa_inet.c 2024-04-21T09:29:03.233 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadahead.sh 2024-04-21T09:29:03.239 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-openat-safer.c 2024-04-21T09:29:03.245 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-unlink.c 2024-04-21T09:29:03.251 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsstr2.sh 2024-04-21T09:29:03.256 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lchown.c 2024-04-21T09:29:03.261 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-nl_langinfo.c 2024-04-21T09:29:03.267 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-open.h 2024-04-21T09:29:03.272 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-memcmp.c 2024-04-21T09:29:03.278 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vfprintf-posix.c 2024-04-21T09:29:03.284 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadahead.c 2024-04-21T09:29:03.289 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/ioctl.c 2024-04-21T09:29:03.294 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-iconv-h.c 2024-04-21T09:29:03.299 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mkdir.c 2024-04-21T09:29:03.306 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-posixtm.c 2024-04-21T09:29:03.312 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/wctob.c 2024-04-21T09:29:03.319 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/glthread/ 2024-04-21T09:29:03.324 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/glthread/thread.c 2024-04-21T09:29:03.330 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/glthread/yield.h 2024-04-21T09:29:03.336 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/glthread/thread.h 2024-04-21T09:29:03.342 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/unistr/ 2024-04-21T09:29:03.348 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/unistr/test-u8-uctomb.c 2024-04-21T09:29:03.354 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude5.sh 2024-04-21T09:29:03.361 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-rmdir.h 2024-04-21T09:29:03.366 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-symlink.h 2024-04-21T09:29:03.372 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-unsetenv.c 2024-04-21T09:29:03.377 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude4.sh 2024-04-21T09:29:03.382 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/listen.c 2024-04-21T09:29:03.387 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-printf-posix.output 2024-04-21T09:29:03.392 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbrtowc3.sh 2024-04-21T09:29:03.398 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-dirent.c 2024-04-21T09:29:03.404 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-utimens-common.h 2024-04-21T09:29:03.409 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsinit.c 2024-04-21T09:29:03.415 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/w32sock.h 2024-04-21T09:29:03.420 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-printf-posix.h 2024-04-21T09:29:03.427 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fchdir.c 2024-04-21T09:29:03.433 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/read-file.c 2024-04-21T09:29:03.438 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-ctype.c 2024-04-21T09:29:03.444 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/binary-io.h 2024-04-21T09:29:03.450 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/nap.h 2024-04-21T09:29:03.455 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/sys_ioctl.in.h 2024-04-21T09:29:03.461 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-ftello2.sh 2024-04-21T09:29:03.467 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-memchr.c 2024-04-21T09:29:03.472 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsrtowcs3.sh 2024-04-21T09:29:03.478 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fseeko.sh 2024-04-21T09:29:03.483 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-select-out.sh 2024-04-21T09:29:03.489 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/inet_pton.c 2024-04-21T09:29:03.495 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stdbool.c 2024-04-21T09:29:03.501 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-nanosleep.c 2024-04-21T09:29:03.507 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/bind.c 2024-04-21T09:29:03.512 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/unlinkdir.h 2024-04-21T09:29:03.518 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getline.c 2024-04-21T09:29:03.523 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-md5.c 2024-04-21T09:29:03.528 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/Makefile.am 2024-04-21T09:29:03.534 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-select-in.sh 2024-04-21T09:29:03.539 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-uname.c 2024-04-21T09:29:03.545 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-readlink.h 2024-04-21T09:29:03.550 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-string.c 2024-04-21T09:29:03.556 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-argmatch.c 2024-04-21T09:29:03.562 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-nl_langinfo.sh 2024-04-21T09:29:03.568 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sys_stat.c 2024-04-21T09:29:03.573 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-version-etc.c 2024-04-21T09:29:03.579 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-areadlink.h 2024-04-21T09:29:03.585 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-version-etc.sh 2024-04-21T09:29:03.591 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-binary-io.c 2024-04-21T09:29:03.596 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude2.sh 2024-04-21T09:29:03.602 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xfprintf-posix.c 2024-04-21T09:29:03.607 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-set-mode-acl.c 2024-04-21T09:29:03.613 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-wchar.c 2024-04-21T09:29:03.619 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vasprintf.c 2024-04-21T09:29:03.627 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xstrtoimax.sh 2024-04-21T09:29:03.634 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadseek.sh 2024-04-21T09:29:03.641 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-isblank.c 2024-04-21T09:29:03.646 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fpending.sh 2024-04-21T09:29:03.652 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lstat.h 2024-04-21T09:29:03.657 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-chown.c 2024-04-21T09:29:03.662 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xstrtoumax.sh 2024-04-21T09:29:03.668 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/nan.h 2024-04-21T09:29:03.673 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xprintf-posix.c 2024-04-21T09:29:03.680 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-inet_pton.c 2024-04-21T09:29:03.686 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-dup-safer.c 2024-04-21T09:29:03.692 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-closein.sh 2024-04-21T09:29:03.698 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-canonicalize.c 2024-04-21T09:29:03.704 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-isnanl-nolibm.c 2024-04-21T09:29:03.709 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xstrtol.c 2024-04-21T09:29:03.715 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-open.c 2024-04-21T09:29:03.735 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fprintf-posix.h 2024-04-21T09:29:03.840 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbrtowc1.sh 2024-04-21T09:29:03.844 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-errno.c 2024-04-21T09:29:03.849 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-netdb.c 2024-04-21T09:29:03.853 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-wctype.c 2024-04-21T09:29:03.858 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-strsignal.c 2024-04-21T09:29:03.863 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsstr3.sh 2024-04-21T09:29:03.867 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-yesno.c 2024-04-21T09:29:03.872 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-userspec.c 2024-04-21T09:29:03.877 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freopen.c 2024-04-21T09:29:03.882 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/uniwidth/ 2024-04-21T09:29:03.886 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/uniwidth/test-uc_width2.c 2024-04-21T09:29:03.890 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/uniwidth/test-uc_width.c 2024-04-21T09:29:03.897 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/uniwidth/test-uc_width2.sh 2024-04-21T09:29:03.904 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sockets.c 2024-04-21T09:29:03.910 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-link.h 2024-04-21T09:29:03.915 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-select-fd.c 2024-04-21T09:29:03.920 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xstrtoimax.c 2024-04-21T09:29:03.925 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xvasprintf.c 2024-04-21T09:29:03.931 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-yesno.sh 2024-04-21T09:29:03.936 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fflush.c 2024-04-21T09:29:03.941 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vc-list-files-cvs.sh 2024-04-21T09:29:03.947 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbscasecmp.sh 2024-04-21T09:29:03.951 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lseek.sh 2024-04-21T09:29:03.956 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/usleep.c 2024-04-21T09:29:03.962 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sleep.c 2024-04-21T09:29:03.967 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-link.c 2024-04-21T09:29:03.973 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-perror.c 2024-04-21T09:29:03.978 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsrtowcs.c 2024-04-21T09:29:03.984 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xalloc-die.sh 2024-04-21T09:29:03.989 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-i-ring.c 2024-04-21T09:29:03.996 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-priv-set.c 2024-04-21T09:29:04.002 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-btowc.c 2024-04-21T09:29:04.007 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sys_select.c 2024-04-21T09:29:04.012 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbrtowc.c 2024-04-21T09:29:04.019 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-strerror.c 2024-04-21T09:29:04.024 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-update-copyright.sh 2024-04-21T09:29:04.031 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-btowc2.sh 2024-04-21T09:29:04.036 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getcwd.c 2024-04-21T09:29:04.042 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/socket.c 2024-04-21T09:29:04.048 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-set-mode-acl.sh 2024-04-21T09:29:04.054 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-linkat.c 2024-04-21T09:29:04.060 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/perror.c 2024-04-21T09:29:04.066 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-wcrtomb.c 2024-04-21T09:29:04.072 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vasnprintf.c 2024-04-21T09:29:04.077 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-memrchr.c 2024-04-21T09:29:04.082 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-ftello.c 2024-04-21T09:29:04.731 INFO:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 33.3 2024-04-21T09:29:04.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:29:04.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe23660d640 1 Processor -- start 2024-04-21T09:29:04.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe23660d640 1 -- start start 2024-04-21T09:29:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe23660d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2300c7680 0x7fe23015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe23660d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300cb120 0x7fe2300d01e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe23660d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe23015b3a0 con 0x7fe230154eb0 2024-04-21T09:29:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe23660d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe23015e130 con 0x7fe2300c7680 2024-04-21T09:29:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe23660d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe23015f0c0 con 0x7fe2300cb120 2024-04-21T09:29:04.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe230154eb0 0x7fe23015ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48676/0 (socket says 172.21.15.26:48676) 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22ffff640 1 -- 172.21.15.26:0/1003568442 learned_addr learned my addr 172.21.15.26:0/1003568442 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22f7fe640 1 --2- 172.21.15.26:0/1003568442 >> v2:172.21.15.26:3300/0 conn(0x7fe2300c7680 0x7fe23015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe234baa640 1 --2- 172.21.15.26:0/1003568442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300cb120 0x7fe2300d01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22effd640 1 -- 172.21.15.26:0/1003568442 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427014997 0 0) 0x7fe23015b3a0 con 0x7fe230154eb0 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22effd640 1 -- 172.21.15.26:0/1003568442 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe21c003530 con 0x7fe230154eb0 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22f7fe640 1 -- 172.21.15.26:0/1003568442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300cb120 msgr2=0x7fe2300d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22f7fe640 1 --2- 172.21.15.26:0/1003568442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300cb120 0x7fe2300d01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22f7fe640 1 -- 172.21.15.26:0/1003568442 >> v1:172.21.15.26:6789/0 conn(0x7fe230154eb0 legacy=0x7fe23015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:04.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22f7fe640 1 -- 172.21.15.26:0/1003568442 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23015b680 con 0x7fe2300c7680 2024-04-21T09:29:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.858+0000 7fe22f7fe640 1 --2- 172.21.15.26:0/1003568442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2300c7680 0x7fe23015eb80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe220009d90 tx=0x7fe22001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619d3bc82d0c4c2f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22effd640 1 -- 172.21.15.26:0/1003568442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2200b2070 con 0x7fe2300c7680 2024-04-21T09:29:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22effd640 1 -- 172.21.15.26:0/1003568442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2200a5830 con 0x7fe2300c7680 2024-04-21T09:29:04.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22effd640 1 -- 172.21.15.26:0/1003568442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2200a5be0 con 0x7fe2300c7680 2024-04-21T09:29:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- 172.21.15.26:0/1003568442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2300c7680 msgr2=0x7fe23015eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 --2- 172.21.15.26:0/1003568442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2300c7680 0x7fe23015eb80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe220009d90 tx=0x7fe22001c970 comp rx=0 tx=0).stop 2024-04-21T09:29:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- 172.21.15.26:0/1003568442 shutdown_connections 2024-04-21T09:29:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 --2- 172.21.15.26:0/1003568442 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300cb120 0x7fe2300d01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:04.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 --2- 172.21.15.26:0/1003568442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2300c7680 0x7fe23015eb80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- 172.21.15.26:0/1003568442 >> 172.21.15.26:0/1003568442 conn(0x7fe23006dea0 msgr2=0x7fe23006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- 172.21.15.26:0/1003568442 shutdown_connections 2024-04-21T09:29:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- 172.21.15.26:0/1003568442 wait complete. 2024-04-21T09:29:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 Processor -- start 2024-04-21T09:29:04.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- start start 2024-04-21T09:29:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300c7680 0x7fe2301f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2300cb120 0x7fe2300cf950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe230154eb0 0x7fe230148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe2300cb970 con 0x7fe230154eb0 2024-04-21T09:29:04.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fe230155290 con 0x7fe2300cb120 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fe2300cbaf0 con 0x7fe2300c7680 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe230154eb0 0x7fe230148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe230154eb0 0x7fe230148cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58738/0 (socket says 172.21.15.26:58738) 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 -- 172.21.15.26:0/872145283 learned_addr learned my addr 172.21.15.26:0/872145283 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22f7fe640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2300cb120 0x7fe2300cf950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22ffff640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300c7680 0x7fe2301f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 -- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300c7680 msgr2=0x7fe2301f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300c7680 0x7fe2301f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 -- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2300cb120 msgr2=0x7fe2300cf950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2300cb120 0x7fe2300cf950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 -- 172.21.15.26:0/872145283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe23014ea10 con 0x7fe230154eb0 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22ffff640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300c7680 0x7fe2301f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe234baa640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe230154eb0 0x7fe230148cb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe22800d590 tx=0x7fe22800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:04.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22cff9640 1 -- 172.21.15.26:0/872145283 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2280125f0 con 0x7fe230154eb0 2024-04-21T09:29:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22cff9640 1 -- 172.21.15.26:0/872145283 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe228019070 con 0x7fe230154eb0 2024-04-21T09:29:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe23014ecd0 con 0x7fe230154eb0 2024-04-21T09:29:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe22cff9640 1 -- 172.21.15.26:0/872145283 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2280129f0 con 0x7fe230154eb0 2024-04-21T09:29:04.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.862+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe23015bf10 con 0x7fe230154eb0 2024-04-21T09:29:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.866+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23015bd00 con 0x7fe230154eb0 2024-04-21T09:29:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.866+0000 7fe22cff9640 1 -- 172.21.15.26:0/872145283 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe228012b90 con 0x7fe230154eb0 2024-04-21T09:29:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.866+0000 7fe22cff9640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe210068380 0x7fe21006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.866+0000 7fe22cff9640 1 -- 172.21.15.26:0/872145283 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fe228086ef0 con 0x7fe230154eb0 2024-04-21T09:29:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.866+0000 7fe22ffff640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe210068380 0x7fe21006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:04.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.866+0000 7fe22ffff640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe210068380 0x7fe21006a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe218005890 tx=0x7fe218009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:04.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:04.870+0000 7fe22cff9640 1 -- 172.21.15.26:0/872145283 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe228057360 con 0x7fe230154eb0 2024-04-21T09:29:05.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.070+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe230075ef0 con 0x7fe230154eb0 2024-04-21T09:29:05.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.070+0000 7fe22cff9640 1 -- 172.21.15.26:0/872145283 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fe228056c60 con 0x7fe230154eb0 2024-04-21T09:29:05.073 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:05.073 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:29:05.073 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:29:05.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe210068380 msgr2=0x7fe21006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe210068380 0x7fe21006a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe218005890 tx=0x7fe218009040 comp rx=0 tx=0).stop 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe230154eb0 msgr2=0x7fe230148cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe230154eb0 0x7fe230148cb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe22800d590 tx=0x7fe22800da50 comp rx=0 tx=0).stop 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 shutdown_connections 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fe210068380 0x7fe21006a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe230154eb0 0x7fe230148cb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe2300cb120 0x7fe2300cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 --2- 172.21.15.26:0/872145283 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe2300c7680 0x7fe2301f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 >> 172.21.15.26:0/872145283 conn(0x7fe23006dea0 msgr2=0x7fe2300c8790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 shutdown_connections 2024-04-21T09:29:05.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.074+0000 7fe23660d640 1 -- 172.21.15.26:0/872145283 wait complete. 2024-04-21T09:29:05.092 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db / --timeout 30 --expiration 93.3 --await' 2024-04-21T09:29:05.092 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db / --timeout 30 --expiration 93.3 --await 2024-04-21T09:29:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.226+0000 7f1795fc2640 1 Processor -- start 2024-04-21T09:29:05.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.226+0000 7f1795fc2640 1 -- start start 2024-04-21T09:29:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f1795fc2640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f179015aac0 0x7f179015af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f1795fc2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179006bde0 0x7f179006d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f1795fc2640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17901572a0 con 0x7f1790150df0 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f1795fc2640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f179006e830 con 0x7f179015aac0 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f1795fc2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1790157e20 con 0x7f179006bde0 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179006bde0 0x7f179006d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178effd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f179015aac0 0x7f179015af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178effd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f179015aac0 0x7f179015af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.26:59458/0 (socket says 172.21.15.26:59458) 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178effd640 1 -- 172.21.15.26:0/1526536237 learned_addr learned my addr 172.21.15.26:0/1526536237 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178f7fe640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f1790150df0 0x7f17900c6bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:40338/0 (socket says 172.21.15.26:40338) 2024-04-21T09:29:05.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178ffff640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179006bde0 0x7f179006d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:48754/0 (socket says 172.21.15.26:48754) 2024-04-21T09:29:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178effd640 1 -- 172.21.15.26:0/1526536237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179006bde0 msgr2=0x7f179006d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178effd640 1 --2- 172.21.15.26:0/1526536237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179006bde0 0x7f179006d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178effd640 1 -- 172.21.15.26:0/1526536237 >> v1:172.21.15.169:6789/0 conn(0x7f1790150df0 legacy=0x7f17900c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.230+0000 7f178effd640 1 -- 172.21.15.26:0/1526536237 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1790157580 con 0x7f179015aac0 2024-04-21T09:29:05.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f178effd640 1 --2- 172.21.15.26:0/1526536237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f179015aac0 0x7f179015af30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f178400bb10 tx=0x7f178401ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfc599f24ce90d9f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:05.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f178e7fc640 1 -- 172.21.15.26:0/1526536237 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840b4070 con 0x7f179015aac0 2024-04-21T09:29:05.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f178e7fc640 1 -- 172.21.15.26:0/1526536237 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17840a7af0 con 0x7f179015aac0 2024-04-21T09:29:05.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f178e7fc640 1 -- 172.21.15.26:0/1526536237 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840af440 con 0x7f179015aac0 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- 172.21.15.26:0/1526536237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f179015aac0 msgr2=0x7f179015af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 --2- 172.21.15.26:0/1526536237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f179015aac0 0x7f179015af30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f178400bb10 tx=0x7f178401ec30 comp rx=0 tx=0).stop 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- 172.21.15.26:0/1526536237 shutdown_connections 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 --2- 172.21.15.26:0/1526536237 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179006bde0 0x7f179006d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 --2- 172.21.15.26:0/1526536237 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f179015aac0 0x7f179015af30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- 172.21.15.26:0/1526536237 >> 172.21.15.26:0/1526536237 conn(0x7f17900c8d40 msgr2=0x7f17900c9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- 172.21.15.26:0/1526536237 shutdown_connections 2024-04-21T09:29:05.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- 172.21.15.26:0/1526536237 wait complete. 2024-04-21T09:29:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 Processor -- start 2024-04-21T09:29:05.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- start start 2024-04-21T09:29:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179006bde0 0x7f1790148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1790150df0 0x7f1790148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179015aac0 0x7f17900cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f17901511d0 con 0x7f179006bde0 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f179015a5a0 con 0x7f1790150df0 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.234+0000 7f1795fc2640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1790151350 con 0x7f179015aac0 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179006bde0 0x7f1790148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179006bde0 0x7f1790148510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58746/0 (socket says 172.21.15.26:58746) 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 -- 172.21.15.26:0/4056854440 learned_addr learned my addr 172.21.15.26:0/4056854440 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178effd640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1790150df0 0x7f1790148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178ffff640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179015aac0 0x7f17900cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 -- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179015aac0 msgr2=0x7f17900cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f179015aac0 0x7f17900cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 -- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1790150df0 msgr2=0x7f1790148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1790150df0 0x7f1790148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 -- 172.21.15.26:0/4056854440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179014f880 con 0x7f179006bde0 2024-04-21T09:29:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178f7fe640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f179006bde0 0x7f1790148510 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f178000c460 tx=0x7f178000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1777fff640 1 -- 172.21.15.26:0/4056854440 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780018070 con 0x7f179006bde0 2024-04-21T09:29:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1777fff640 1 -- 172.21.15.26:0/4056854440 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17800074a0 con 0x7f179006bde0 2024-04-21T09:29:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1795fc2640 1 -- 172.21.15.26:0/4056854440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179014fb60 con 0x7f179006bde0 2024-04-21T09:29:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1777fff640 1 -- 172.21.15.26:0/4056854440 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780004a30 con 0x7f179006bde0 2024-04-21T09:29:05.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1795fc2640 1 -- 172.21.15.26:0/4056854440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f179014fe40 con 0x7f179006bde0 2024-04-21T09:29:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1777fff640 1 -- 172.21.15.26:0/4056854440 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f178001b070 con 0x7f179006bde0 2024-04-21T09:29:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1777fff640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f177c0683b0 0x7f177c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1777fff640 1 -- 172.21.15.26:0/4056854440 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f1780085b50 con 0x7f179006bde0 2024-04-21T09:29:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f178effd640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f177c0683b0 0x7f177c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.238+0000 7f1799144000 1 Processor -- start 2024-04-21T09:29:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- start start 2024-04-21T09:29:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 --2- 172.21.15.26:0/4056854440 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f177c0683b0 0x7f177c06a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f17840b1000 tx=0x7f17840a9070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b901bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9057450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b9057990 0x5574b9057d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5574b8efd650 con 0x5574b901c500 2024-04-21T09:29:05.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5574b8e65bf0 con 0x5574b90525a0 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5574b8e0b0c0 con 0x5574b9057990 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9057450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58750/0 (socket says 172.21.15.26:58750) 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 -- 172.21.15.26:0/2699640367 learned_addr learned my addr 172.21.15.26:0/2699640367 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178ffff640 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b9057990 0x5574b9057d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b901bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 -- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b9057990 msgr2=0x5574b9057d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b9057990 0x5574b9057d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 -- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 msgr2=0x5574b901bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b901bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 -- 172.21.15.26:0/2699640367 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b8e27fe0 con 0x5574b901c500 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b901bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f178effd640 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9057450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f178400bb10 tx=0x7f1784004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a154849b624c587a server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f17757fa640 1 -- 172.21.15.26:0/2699640367 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840c9070 con 0x5574b901c500 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f17757fa640 1 -- 172.21.15.26:0/2699640367 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17840b9700 con 0x5574b901c500 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f17757fa640 1 -- 172.21.15.26:0/2699640367 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840b4040 con 0x5574b901c500 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- 172.21.15.26:0/2699640367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 msgr2=0x5574b9057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9057450 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f178400bb10 tx=0x7f1784004740 comp rx=0 tx=0).stop 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- 172.21.15.26:0/2699640367 shutdown_connections 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b9057990 0x5574b9057d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9057450 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- 172.21.15.26:0/2699640367 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b901bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- 172.21.15.26:0/2699640367 >> 172.21.15.26:0/2699640367 conn(0x5574b9053200 msgr2=0x5574b90555f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- 172.21.15.26:0/2699640367 shutdown_connections 2024-04-21T09:29:05.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- 172.21.15.26:0/2699640367 wait complete. 2024-04-21T09:29:05.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 -- start start 2024-04-21T09:29:05.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 Processor -- start 2024-04-21T09:29:05.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b9013c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.242+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b9014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b9057990 0x5574b90146d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5574b8e21540 con 0x5574b9057990 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5574b8e64f00 con 0x5574b90525a0 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5574b8e6a220 con 0x5574b901c500 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 10 client.0 _ll_register_callbacks cb 0x5574b90019a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b9057990 0x5574b90146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b9057990 0x5574b90146d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58754/0 (socket says 172.21.15.26:58754) 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 -- 172.21.15.26:0/2440317140 learned_addr learned my addr 172.21.15.26:0/2440317140 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178effd640 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b9014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b9013c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 -- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 msgr2=0x5574b9013c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b9013c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 -- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 msgr2=0x5574b9014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b9014190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 -- 172.21.15.26:0/2440317140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b8e72570 con 0x5574b9057990 2024-04-21T09:29:05.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178ffff640 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b9057990 0x5574b90146d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f17880070b0 tx=0x7f1788013680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf5a755d3a52948 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 1 -- 172.21.15.26:0/2440317140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178801c070 con 0x5574b9057990 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17840b9700 con 0x5574b9057990 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 1 -- 172.21.15.26:0/2440317140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f1788016630 con 0x5574b9057990 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 1 -- 172.21.15.26:0/2440317140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f1788027050 con 0x5574b9057990 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 10 client.5223 fetch_fsmap learned FSMap version 8 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5574b8e0b310 con 0x5574b9057990 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 1 -- 172.21.15.26:0/2440317140 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17840b9700 con 0x5574b9057990 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 1 -- 172.21.15.26:0/2440317140 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f178802a020 con 0x5574b9057990 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 10 client.5223 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 10 client.5223 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 20 client.5223 populate_metadata read hostname 'smithi026' 2024-04-21T09:29:05.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b906b150 0x5574b906d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 4 client.5223 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574b8dff880 con 0x5574b906b150 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b906b150 0x5574b906d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b906b150 0x5574b906d540 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec4e63d7ebc428f7 server_cookie=d5419c853812fa54 in_seq=0 out_seq=0 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 10 client.5223 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 1 -- 172.21.15.26:0/2440317140 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5574b8dff880 con 0x5574b906b150 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.246+0000 7f176e7fc640 10 client.5223 handle_command_reply: tid=0 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 client.5223 shutdown 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b9057990 msgr2=0x5574b90146d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b9057990 0x5574b90146d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f17880070b0 tx=0x7f1788013680 comp rx=0 tx=0).stop 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 shutdown_connections 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b906b150 0x5574b906d540 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b9057990 0x5574b90146d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b90525a0 0x5574b9014190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 --2- 172.21.15.26:0/2440317140 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b9013c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 >> 172.21.15.26:0/2440317140 conn(0x5574b9053200 msgr2=0x5574b9051bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f176e7fc640 0 client.5223 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 shutdown_connections 2024-04-21T09:29:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 1 -- 172.21.15.26:0/2440317140 wait complete. 2024-04-21T09:29:05.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.250+0000 7f1799144000 20 client.5223 trim_cache size 0 max 16384 2024-04-21T09:29:05.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 Processor -- start 2024-04-21T09:29:05.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 -- start start 2024-04-21T09:29:05.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9017480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b90525a0 0x5574b90179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b9017f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f179014ef30 con 0x5574b901c500 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f17901fb810 con 0x5574b9057990 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f1790072300 con 0x5574b90525a0 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9017480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9017480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58766/0 (socket says 172.21.15.26:58766) 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 -- 172.21.15.26:0/2827272533 learned_addr learned my addr 172.21.15.26:0/2827272533 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178ffff640 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b9017f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178effd640 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b90525a0 0x5574b90179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 -- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b90525a0 msgr2=0x5574b90179c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b90525a0 0x5574b90179c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 -- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 msgr2=0x5574b9017f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b9017f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 -- 172.21.15.26:0/2827272533 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574b8e31ab0 con 0x5574b901c500 2024-04-21T09:29:05.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f178f7fe640 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9017480 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f17800559f0 tx=0x7f178005c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d8e10d4bdc550f server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:05.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1774ff9640 1 -- 172.21.15.26:0/2827272533 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1780082070 con 0x5574b901c500 2024-04-21T09:29:05.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1774ff9640 1 -- 172.21.15.26:0/2827272533 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780053d60 con 0x5574b901c500 2024-04-21T09:29:05.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1774ff9640 1 -- 172.21.15.26:0/2827272533 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178005c0b0 con 0x5574b901c500 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 -- 172.21.15.26:0/2827272533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 msgr2=0x5574b9017480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.266+0000 7f1799144000 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9017480 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f17800559f0 tx=0x7f178005c040 comp rx=0 tx=0).stop 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- 172.21.15.26:0/2827272533 shutdown_connections 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b9017f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b90525a0 0x5574b90179c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 --2- 172.21.15.26:0/2827272533 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b901c500 0x5574b9017480 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- 172.21.15.26:0/2827272533 >> 172.21.15.26:0/2827272533 conn(0x5574b9053200 msgr2=0x5574b904d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- 172.21.15.26:0/2827272533 shutdown_connections 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- 172.21.15.26:0/2827272533 wait complete. 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- start start 2024-04-21T09:29:05.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 Processor -- start 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b901b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b90525a0 0x5574b908d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b908d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5574b8dfc470 con 0x5574b90525a0 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x5574b8e72e00 con 0x5574b9057990 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x5574b8e29b70 con 0x5574b901c500 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 10 client.0 _ll_register_callbacks cb 0x7f1788009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b90525a0 0x5574b908d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b90525a0 0x5574b908d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58768/0 (socket says 172.21.15.26:58768) 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 -- 172.21.15.26:0/4120965656 learned_addr learned my addr 172.21.15.26:0/4120965656 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178f7fe640 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b901b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178ffff640 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b908d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 -- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 msgr2=0x5574b901b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.276 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b901b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 -- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 msgr2=0x5574b908d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b908d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 -- 172.21.15.26:0/4120965656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574b8ee6660 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178effd640 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b90525a0 0x5574b908d100 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f17840a7c70 tx=0x7f178401d470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260422f01b1393ab server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f176e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f176e7fc640 1 -- 172.21.15.26:0/4120965656 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17840b4040 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f176e7fc640 1 -- 172.21.15.26:0/4120965656 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f17840d8b30 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1780053d60 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f176e7fc640 1 -- 172.21.15.26:0/4120965656 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f17840c9040 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 10 client.5229 fetch_fsmap learned FSMap version 8 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5574b8dfb6a0 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f176e7fc640 1 -- 172.21.15.26:0/4120965656 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1780053d60 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f176e7fc640 1 -- 172.21.15.26:0/4120965656 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7f17840d5020 con 0x5574b90525a0 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 10 client.5229 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:29:05.277 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 10 client.5229 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:29:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 20 client.5229 populate_metadata read hostname 'smithi026' 2024-04-21T09:29:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b90cc4f0 0x5574b90cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 4 client.5229 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 93.3, "await": true}] 2024-04-21T09:29:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 30.0, "expiration": 93.3, "await": true}) -- 0x5574b8e73610 con 0x5574b90cc4f0 2024-04-21T09:29:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178f7fe640 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b90cc4f0 0x5574b90cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f178f7fe640 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b90cc4f0 0x5574b90cc900 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeff88e8d8ef8f0c server_cookie=11ef789639ee330e in_seq=0 out_seq=0 2024-04-21T09:29:05.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:05.270+0000 7f176e7fc640 10 client.5229 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f176e7fc640 1 -- 172.21.15.26:0/4120965656 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: -110 ) ==== 8+0+590 (crc 0 0 0) 0x5574b8e73610 con 0x5574b90cc4f0 2024-04-21T09:29:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f176e7fc640 10 client.5229 handle_command_reply: tid=0 2024-04-21T09:29:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 client.5229 shutdown 2024-04-21T09:29:35.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b90525a0 msgr2=0x5574b908d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b90525a0 0x5574b908d100 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f17840a7c70 tx=0x7f178401d470 comp rx=0 tx=0).stop 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 shutdown_connections 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x5574b90cc4f0 0x5574b90cc900 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x5574b9057990 0x5574b908d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5574b90525a0 0x5574b908d100 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 --2- 172.21.15.26:0/4120965656 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x5574b901c500 0x5574b901b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 >> 172.21.15.26:0/4120965656 conn(0x5574b9053200 msgr2=0x5574b9071560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f176e7fc640 0 client.5229 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 shutdown_connections 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 1 -- 172.21.15.26:0/4120965656 wait complete. 2024-04-21T09:29:35.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:35.278+0000 7f1799144000 20 client.5229 trim_cache size 0 max 16384 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 34, 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "2d588798": { 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 34, 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:29:35.282 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "TIMEDOUT", 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 30.0, 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 93.3, 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCING", 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 30.0 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:29:35.283 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:29:35.284 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-21T09:29:35.284 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:29:35.284 INFO:teuthology.orchestra.run.smithi026.stderr:Error ETIMEDOUT: 2024-04-21T09:29:35.285 DEBUG:teuthology.orchestra.run:got remote process result: 110 2024-04-21T09:29:35.286 ERROR:tasks.quiescer.fs.[cephfs]:Couldn't quiesce root with rc: -110 (ETIMEDOUT), stdout: { "epoch": 8, "leader": 4279, "set_version": 34, "sets": { "2d588798": { "version": 34, "age_ref": 0.0, "state": { "name": "TIMEDOUT", "age": 0.0 }, "timeout": 30.0, "expiration": 93.3, "members": { "file:/": { "excluded": false, "state": { "name": "QUIESCING", "age": 30.0 } } } } } } 2024-04-21T09:29:35.286 ERROR:tasks.quiescer.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 240, in _run self.do_quiesce(d) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 198, in do_quiesce raise RuntimeError(f"Error quiescing root: {rcinfo}") RuntimeError: Error quiescing root: -110 (ETIMEDOUT) 2024-04-21T09:29:35.494 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-chown.h 2024-04-21T09:29:35.591 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stat.h 2024-04-21T09:29:35.600 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/Makefile.in 2024-04-21T09:29:35.625 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getdelim.c 2024-04-21T09:29:35.633 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vprintf-posix.sh 2024-04-21T09:29:35.642 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fseeko2.sh 2024-04-21T09:29:35.650 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-c-strcase.sh 2024-04-21T09:29:35.658 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsalign.c 2024-04-21T09:29:35.666 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fcntl-h.c 2024-04-21T09:29:35.674 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vprintf-posix.c 2024-04-21T09:29:35.681 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-rename.c 2024-04-21T09:29:35.689 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lstat.c 2024-04-21T09:29:35.697 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-malloca.c 2024-04-21T09:29:35.704 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xstrtoul.c 2024-04-21T09:29:35.712 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-perror.sh 2024-04-21T09:29:35.719 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vasprintf-posix.c 2024-04-21T09:29:35.734 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-frexp.c 2024-04-21T09:29:35.743 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-environ.c 2024-04-21T09:29:35.750 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stdint.c 2024-04-21T09:29:35.759 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-isnanl.h 2024-04-21T09:29:35.768 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fcntl-safer.c 2024-04-21T09:29:35.775 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-locale.c 2024-04-21T09:29:35.782 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbrtowc4.sh 2024-04-21T09:29:35.790 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-argv-iter.c 2024-04-21T09:29:35.797 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-utimens.h 2024-04-21T09:29:35.805 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xalloc-die.c 2024-04-21T09:29:35.813 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fcntl.c 2024-04-21T09:29:35.825 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-alloca-opt.c 2024-04-21T09:29:35.833 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-dirname.c 2024-04-21T09:29:35.841 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-setenv.c 2024-04-21T09:29:35.848 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-printf-frexpl.c 2024-04-21T09:29:35.856 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-atexit.sh 2024-04-21T09:29:35.864 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stddef.c 2024-04-21T09:29:35.873 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-c-ctype.c 2024-04-21T09:29:35.881 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xstrtol.sh 2024-04-21T09:29:35.888 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getopt_long.h 2024-04-21T09:29:35.901 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-quotearg.sh 2024-04-21T09:29:35.908 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-langinfo.c 2024-04-21T09:29:35.915 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-inttypes.c 2024-04-21T09:29:35.922 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-filevercmp.c 2024-04-21T09:29:35.930 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-rmdir.c 2024-04-21T09:29:35.938 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-futimens.h 2024-04-21T09:29:35.946 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/setsockopt.c 2024-04-21T09:29:35.953 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude1.sh 2024-04-21T09:29:35.960 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freopen-safer.c 2024-04-21T09:29:35.967 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getaddrinfo.c 2024-04-21T09:29:35.975 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-iconv.c 2024-04-21T09:29:35.983 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/zerosize-ptr.h 2024-04-21T09:29:35.990 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lseek.c 2024-04-21T09:29:35.998 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-usleep.c 2024-04-21T09:29:36.006 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/gnulib.mk 2024-04-21T09:29:36.017 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-unlinkat.c 2024-04-21T09:29:36.025 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-quotearg.c 2024-04-21T09:29:36.034 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-base64.c 2024-04-21T09:29:36.041 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-frexpl.c 2024-04-21T09:29:36.049 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-gethostname.c 2024-04-21T09:29:36.056 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mkdir.h 2024-04-21T09:29:36.064 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-binary-io.sh 2024-04-21T09:29:36.071 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sys_ioctl.c 2024-04-21T09:29:36.078 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-time.c 2024-04-21T09:29:36.085 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/signature.h 2024-04-21T09:29:36.093 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-isnanf.h 2024-04-21T09:29:36.102 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-isnanf-nolibm.c 2024-04-21T09:29:36.110 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-wcwidth.c 2024-04-21T09:29:36.117 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadseek.c 2024-04-21T09:29:36.125 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-areadlink-with-size.c 2024-04-21T09:29:36.133 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-select-stdin.c 2024-04-21T09:29:36.141 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsstr1.c 2024-04-21T09:29:36.149 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude3.sh 2024-04-21T09:29:36.157 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fopen.c 2024-04-21T09:29:36.164 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lock.c 2024-04-21T09:29:36.173 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/locale/ 2024-04-21T09:29:36.179 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/locale/fr/ 2024-04-21T09:29:36.184 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/locale/fr/LC_MESSAGES/ 2024-04-21T09:29:36.189 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/locale/fr/LC_MESSAGES/test-quotearg.mo 2024-04-21T09:29:36.195 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/locale/fr/LC_MESSAGES/test-quotearg.po 2024-04-21T09:29:36.202 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fpending.c 2024-04-21T09:29:36.213 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-netinet_in.c 2024-04-21T09:29:36.220 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-bitrotate.c 2024-04-21T09:29:36.227 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-c-strcasecmp.c 2024-04-21T09:29:36.235 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsstr3.c 2024-04-21T09:29:36.243 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-hash.c 2024-04-21T09:29:36.251 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-copy-acl.c 2024-04-21T09:29:36.258 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sigaction.c 2024-04-21T09:29:36.266 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xstrtoumax.c 2024-04-21T09:29:36.273 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fseterr.c 2024-04-21T09:29:36.282 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-areadlink.c 2024-04-21T09:29:36.289 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-signbit.c 2024-04-21T09:29:36.297 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-btowc1.sh 2024-04-21T09:29:36.304 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-strtod.c 2024-04-21T09:29:36.314 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-atexit.c 2024-04-21T09:29:36.322 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getdate.c 2024-04-21T09:29:36.331 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fpurge.c 2024-04-21T09:29:36.338 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-select.c 2024-04-21T09:29:36.346 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-tls.c 2024-04-21T09:29:36.355 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/sleep.c 2024-04-21T09:29:36.362 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbrtowc2.sh 2024-04-21T09:29:36.370 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stat.c 2024-04-21T09:29:36.378 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadptr.sh 2024-04-21T09:29:36.387 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/accept.c 2024-04-21T09:29:36.396 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-unistd.c 2024-04-21T09:29:36.403 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fopen.h 2024-04-21T09:29:36.410 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-math.c 2024-04-21T09:29:36.417 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-printf-frexp.c 2024-04-21T09:29:36.425 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vfprintf-posix.sh 2024-04-21T09:29:36.432 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude.c 2024-04-21T09:29:36.439 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freading.c 2024-04-21T09:29:36.447 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getdtablesize.c 2024-04-21T09:29:36.454 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/unlinkdir.c 2024-04-21T09:29:36.461 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fflush2.c 2024-04-21T09:29:36.469 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-stat-time.c 2024-04-21T09:29:36.478 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-inet_ntop.c 2024-04-21T09:29:36.487 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-vc-list-files-git.sh 2024-04-21T09:29:36.496 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getopt.c 2024-04-21T09:29:36.506 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-alignof.c 2024-04-21T09:29:36.513 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/macros.h 2024-04-21T09:29:36.521 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-symlinkat.c 2024-04-21T09:29:36.529 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getgroups.c 2024-04-21T09:29:36.537 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-xprintf-posix.sh 2024-04-21T09:29:36.544 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fdopendir.c 2024-04-21T09:29:36.552 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sys_socket.c 2024-04-21T09:29:36.559 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbscasecmp.c 2024-04-21T09:29:36.566 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-getopt.h 2024-04-21T09:29:36.578 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsrtowcs1.sh 2024-04-21T09:29:36.585 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsinit.sh 2024-04-21T09:29:36.593 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-gettimeofday.c 2024-04-21T09:29:36.601 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsstr2.c 2024-04-21T09:29:36.609 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/init.sh 2024-04-21T09:29:36.617 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-symlink.c 2024-04-21T09:29:36.624 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-utimens.c 2024-04-21T09:29:36.632 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-readlink.c 2024-04-21T09:29:36.639 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lchown.h 2024-04-21T09:29:36.648 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-c-strncasecmp.c 2024-04-21T09:29:36.656 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-lutimens.h 2024-04-21T09:29:36.664 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-copy-acl.sh 2024-04-21T09:29:36.674 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-exclude6.sh 2024-04-21T09:29:36.681 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadptr2.c 2024-04-21T09:29:36.689 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fflush2.sh 2024-04-21T09:29:36.696 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sys_utsname.c 2024-04-21T09:29:36.704 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsrtowcs2.sh 2024-04-21T09:29:36.712 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-file-has-acl.c 2024-04-21T09:29:36.719 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-signal.c 2024-04-21T09:29:36.727 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sha1.c 2024-04-21T09:29:36.737 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadptr2.sh 2024-04-21T09:29:36.747 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-areadlinkat.c 2024-04-21T09:29:36.757 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-unlink.h 2024-04-21T09:29:36.765 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-dup2.c 2024-04-21T09:29:36.774 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-freadptr.c 2024-04-21T09:29:36.781 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-file-has-acl.sh 2024-04-21T09:29:36.790 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-u64.c 2024-04-21T09:29:36.797 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-striconv.c 2024-04-21T09:29:36.806 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-sameacls.c 2024-04-21T09:29:36.816 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-remove.c 2024-04-21T09:29:36.827 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-fsync.c 2024-04-21T09:29:36.837 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/gnulib-tests/test-mbsrtowcs4.sh 2024-04-21T09:29:36.845 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_require_config_h 2024-04-21T09:29:36.853 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_system_h_headers 2024-04-21T09:29:36.859 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_prohibit_fail_0 2024-04-21T09:29:36.867 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_prohibit_magic_number_exit 2024-04-21T09:29:36.874 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/THANKS-to-translators 2024-04-21T09:29:36.882 INFO:tasks.workunit.client.0.smithi026.stdout:coreutils-8.5/.x-sc_useless_cpp_parens 2024-04-21T09:29:36.891 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir .snap/k 2024-04-21T09:29:37.159 INFO:tasks.workunit.client.0.smithi026.stderr:+ sync 2024-04-21T09:29:37.484 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -rv coreutils-8.5 2024-04-21T09:29:38.511 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/.x-sc_prohibit_strcmp' 2024-04-21T09:29:38.511 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/.x-sc_GPL_version' 2024-04-21T09:29:38.511 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/.prev-version' 2024-04-21T09:29:38.511 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/.x-sc_program_name' 2024-04-21T09:29:38.511 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/expr.x' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/hostid.1' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/seq.x' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/yes.1' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tee.x' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cat.x' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/true.x' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dirname.1' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tail.1' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/timeout.1' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/uname.1' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/unlink.1' 2024-04-21T09:29:38.512 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/expr.1' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/printf.1' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/logname.x' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/expand.1' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sum.x' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/md5sum.x' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/env.x' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nice.x' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/date.1' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tr.1' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/join.x' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/stty.1' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/seq.1' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pinky.x' 2024-04-21T09:29:38.513 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/hostname.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/install.1' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha512sum.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/install.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tail.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dircolors.1' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/hostid.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/md5sum.1' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/split.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mv.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/users.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/od.1' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/ln.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/kill.x' 2024-04-21T09:29:38.514 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/date.x' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chown.1' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/paste.x' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/expand.x' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/rm.x' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha384sum.1' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sleep.1' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha512sum.1' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/shuf.x' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/join.1' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cp.x' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mktemp.1' 2024-04-21T09:29:38.515 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tsort.x' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/factor.1' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/ptx.x' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/who.x' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/touch.x' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/logname.1' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dd.1' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sleep.x' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/base64.1' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/vdir.x' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/printenv.x' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha224sum.1' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chcon.1' 2024-04-21T09:29:38.516 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/whoami.1' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/unlink.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/runcon.1' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tty.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/id.1' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/printf.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/rmdir.1' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/od.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/rmdir.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pathchk.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sort.1' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chown.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/df.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mkfifo.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/test.x' 2024-04-21T09:29:38.517 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/vdir.1' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mknod.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/who.1' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/arch.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/stty.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pr.1' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/test.1' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/uniq.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/stat.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/paste.1' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cksum.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/ptx.1' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/Makefile.in' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dircolors.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/uptime.x' 2024-04-21T09:29:38.518 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chgrp.x' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/basename.1' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mktemp.x' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sum.1' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha1sum.x' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/groups.x' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mknod.1' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/help2man' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/uname.x' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/ls.1' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/du.1' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/timeout.x' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/groups.1' 2024-04-21T09:29:38.519 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dir.1' 2024-04-21T09:29:39.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sync.x' 2024-04-21T09:29:39.571 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cat.1' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/comm.x' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha256sum.1' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/comm.1' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chroot.1' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/csplit.x' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sync.1' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sort.x' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chmod.x' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/Makefile.am' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/readlink.1' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/uptime.1' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pwd.x' 2024-04-21T09:29:39.572 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tac.1' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dir.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mkdir.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/split.1' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chroot.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/false.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/df.1' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tac.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/du.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/rm.1' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/head.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mv.1' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha384sum.x' 2024-04-21T09:29:39.573 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/echo.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/su.x' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pwd.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/shred.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/fold.x' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/touch.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/printenv.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/uniq.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/id.x' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chmod.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/link.x' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dirname.x' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nproc.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nice.1' 2024-04-21T09:29:39.574 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/shred.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/fold.1' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha224sum.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pinky.1' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/runcon.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/unexpand.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/readlink.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/stdbuf.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pr.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/whoami.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nl.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/base64.x' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tsort.1' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tty.1' 2024-04-21T09:29:39.575 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/kill.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/shuf.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/csplit.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/users.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/basename.x' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/stat.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha1sum.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/fmt.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/unexpand.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mkfifo.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/truncate.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/wc.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/dd.x' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cp.1' 2024-04-21T09:29:39.576 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chcon.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/sha256sum.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nproc.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/wc.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/yes.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/true.1' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/mkdir.1' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/factor.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cksum.1' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/pathchk.1' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nohup.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/echo.x' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tee.1' 2024-04-21T09:29:39.577 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nohup.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/false.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/chgrp.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cut.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/cut.x' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/fmt.x' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/stdbuf.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/nl.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/env.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/truncate.x' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/ls.x' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/ln.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/link.1' 2024-04-21T09:29:39.578 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/head.1' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/man/tr.x' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed directory 'coreutils-8.5/man' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/TODO' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/.x-sc_prohibit_magic_number_exit' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/who.c' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/chown-core.h' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/expr.c' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/ls-ls.c' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/cp-hash.h' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/chgrp.c' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/ptx.c' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/nohup.c' 2024-04-21T09:29:39.579 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/ls.h' 2024-04-21T09:29:39.580 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/chroot.c' 2024-04-21T09:29:39.580 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/tail.c' 2024-04-21T09:29:39.580 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/nice.c' 2024-04-21T09:29:39.580 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/fold.c' 2024-04-21T09:29:39.580 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/comm.c' 2024-04-21T09:29:39.918 INFO:tasks.daemonwatchdog.daemon_watchdog:quiescer.fs.[cephfs] failed 2024-04-21T09:29:39.919 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-04-21T09:29:39.919 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T09:29:39.919 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T09:29:39.927 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T09:29:40.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/chown-core.c' 2024-04-21T09:29:40.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/tac.c' 2024-04-21T09:29:40.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/prog-fprintf.c' 2024-04-21T09:29:40.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/tr.c' 2024-04-21T09:29:40.051 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/tac-pipe.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/groups.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/nproc.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/operand2sig.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/libstdbuf.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/nl.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/env.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/dcgen' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/stat.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/base64.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/chown.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/od.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/mkdir.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/logname.c' 2024-04-21T09:29:40.052 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/extract-magic' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/wheel-gen.pl' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/chcon.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/printenv.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/copy.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/ls-dir.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/cut.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/uptime.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/hostname.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/dirname.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/sleep.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/stdbuf.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/true.c' 2024-04-21T09:29:40.053 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/df.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/rmdir.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/copy.h' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/group-list.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/unexpand.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/stty.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/chmod.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/fmt.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/csplit.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/expand.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/kill.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/factor.c' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/wheel-size.h' 2024-04-21T09:29:40.054 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/pinky.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/yes.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/remove.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/Makefile.in' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/uname-uname.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/md5sum.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/ln.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/su.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/cksum.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/dircolors.h' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/group-list.h' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/false.c' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/operand2sig.h' 2024-04-21T09:29:40.055 INFO:tasks.workunit.client.0.smithi026.stdout:removed 'coreutils-8.5/src/id.c' 2024-04-21T09:29:40.063 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/rm.c': Software caused connection abort 2024-04-21T09:29:40.063 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/shred.c': Transport endpoint is not connected 2024-04-21T09:29:40.063 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/printf.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/cp.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/uname-arch.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/dircolors.hin': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/setuidgid.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/cp-hash.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/tee.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/Makefile.am': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/head.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/users.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/runcon.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/du.c': Transport endpoint is not connected 2024-04-21T09:29:40.064 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/date.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/unlink.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/echo.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/pathchk.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/tsort.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/touch.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/c99-to-c89.diff': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/join.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/cat.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/sync.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/shuf.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/truncate.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/ls-vdir.c': Transport endpoint is not connected 2024-04-21T09:29:40.065 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/test.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/remove.h': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/seq.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/readlink.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/uname.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/sum.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/paste.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/uname.h': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/tty.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/fs.h': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/basename.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/dd.c': Transport endpoint is not connected 2024-04-21T09:29:40.066 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/split.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/whoami.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/timeout.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/getlimits.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/dircolors.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/link.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/sort.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/wc.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/prog-fprintf.h': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/uniq.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/pr.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/system.h': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/pwd.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/hostid.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/install.c': Transport endpoint is not connected 2024-04-21T09:29:40.067 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/wheel.h': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/mkfifo.c': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/mv.c': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/lbracket.c': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/mknod.c': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/mktemp.c': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/src/ls.c': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/po': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_prohibit_empty_lines_at_EOF': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/GNUmakefile': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_useless_cpp_parens': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/ChangeLog': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_require_config_h': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/tests': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/doc': Transport endpoint is not connected 2024-04-21T09:29:40.068 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_prohibit_tab_based_indentation': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/gl': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_prohibit_stat_st_blocks': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/THANKS': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/lib': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.tarball-version': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_error_message_uppercase': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_space_tab': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/ChangeLog-2007': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_require_config_h_first': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/ABOUT-NLS': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/aclocal.m4': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/bootstrap': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/NEWS': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/ChangeLog-2006': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_unmarked_diagnostics': Transport endpoint is not connected 2024-04-21T09:29:40.069 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/Makefile.in': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/ChangeLog-2005': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/m4': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.version': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_prohibit_fail_0': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/Makefile.am': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/INSTALL': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/maint.mk': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/bootstrap.conf': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/gnulib-tests': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/AUTHORS': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_po_check': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/dist-check.mk': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/ChangeLog-2008': Transport endpoint is not connected 2024-04-21T09:29:40.070 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_trailing_blank': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_file_system': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/README': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/configure.ac': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_system_h_headers': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/THANKStt.in': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/old': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_sun_os_names': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/THANKS-to-translators': Transport endpoint is not connected 2024-04-21T09:29:40.071 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/build-aux': Transport endpoint is not connected 2024-04-21T09:29:40.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T09:29:40.072 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/configure': Transport endpoint is not connected 2024-04-21T09:29:40.073 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.vg-suppressions': Transport endpoint is not connected 2024-04-21T09:29:40.073 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_obsolete_symbols': Transport endpoint is not connected 2024-04-21T09:29:40.073 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/.x-sc_prohibit_atoi_atof': Transport endpoint is not connected 2024-04-21T09:29:40.073 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/COPYING': Transport endpoint is not connected 2024-04-21T09:29:40.073 INFO:tasks.workunit.client.0.smithi026.stderr:rm: cannot remove 'coreutils-8.5/cfg.mk': Transport endpoint is not connected 2024-04-21T09:29:40.073 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2024-04-21T09:29:40.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-21T09:29:40.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 Processor -- start 2024-04-21T09:29:40.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 -- start start 2024-04-21T09:29:40.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5dc0c6980 0x7ff5dc1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff5dc0c6d60 0x7ff5dc0ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff5dc159410 con 0x7ff5dc0c6980 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff5dc15d170 con 0x7ff5dc0c6d60 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e3fd4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff5dc06d5a0 con 0x7ff5dc06d0f0 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5dc0c6980 0x7ff5dc1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff5dc0c6980 0x7ff5dc1598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42494/0 (socket says 172.21.15.26:42494) 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 -- 172.21.15.26:0/782280904 learned_addr learned my addr 172.21.15.26:0/782280904 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e2571640 1 --2- 172.21.15.26:0/782280904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e156f640 1 --2- 172.21.15.26:0/782280904 >> v2:172.21.15.169:3300/0 conn(0x7ff5dc0c6d60 0x7ff5dc0ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 -- 172.21.15.26:0/782280904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 msgr2=0x7ff5dc15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 --2- 172.21.15.26:0/782280904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 -- 172.21.15.26:0/782280904 >> v2:172.21.15.169:3300/0 conn(0x7ff5dc0c6d60 msgr2=0x7ff5dc0ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 --2- 172.21.15.26:0/782280904 >> v2:172.21.15.169:3300/0 conn(0x7ff5dc0c6d60 0x7ff5dc0ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e1d70640 1 -- 172.21.15.26:0/782280904 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc073ab0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.098+0000 7ff5e156f640 1 --2- 172.21.15.26:0/782280904 >> v2:172.21.15.169:3300/0 conn(0x7ff5dc0c6d60 0x7ff5dc0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:40.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e1d70640 1 --2- 172.21.15.26:0/782280904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc1598a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c4360 tx=0x7ff5cc01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38123071840fa45 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e0d6e640 1 -- 172.21.15.26:0/782280904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0b5070 con 0x7ff5dc0c6980 2024-04-21T09:29:40.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e0d6e640 1 -- 172.21.15.26:0/782280904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5cc0a89d0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e0d6e640 1 -- 172.21.15.26:0/782280904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0a8da0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/782280904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 msgr2=0x7ff5dc1598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/782280904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc1598a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc0c4360 tx=0x7ff5cc01ed10 comp rx=0 tx=0).stop 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/782280904 shutdown_connections 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/782280904 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/782280904 >> v2:172.21.15.169:3300/0 conn(0x7ff5dc0c6d60 0x7ff5dc0ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/782280904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc1598a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/782280904 >> 172.21.15.26:0/782280904 conn(0x7ff5dc0c9b50 msgr2=0x7ff5dc0c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/782280904 shutdown_connections 2024-04-21T09:29:40.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/782280904 wait complete. 2024-04-21T09:29:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 Processor -- start 2024-04-21T09:29:40.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.102+0000 7ff5e3fd4640 1 -- start start 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5dc0c6d60 0x7ff5dc15ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc158dc0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff5dc073d50 con 0x7ff5dc0c6d60 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff5dc1590a0 con 0x7ff5dc06d0f0 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc15a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42496/0 (socket says 172.21.15.26:42496) 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 -- 172.21.15.26:0/3727849612 learned_addr learned my addr 172.21.15.26:0/3727849612 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e1d70640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e2571640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5dc0c6d60 0x7ff5dc15ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 -- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 msgr2=0x7ff5dc15c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 -- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5dc0c6d60 msgr2=0x7ff5dc15ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5dc0c6d60 0x7ff5dc15ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 -- 172.21.15.26:0/3727849612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5dc1492e0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e156f640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc15a920 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c7f0 tx=0x7ff5d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3727849612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8015070 con 0x7ff5dc0c6980 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3727849612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5d8004220 con 0x7ff5dc0c6980 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5dc14bda0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3727849612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8003620 con 0x7ff5dc0c6980 2024-04-21T09:29:40.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5dc149000 con 0x7ff5dc0c6980 2024-04-21T09:29:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5dc075ef0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3727849612 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff5d80039d0 con 0x7ff5dc0c6980 2024-04-21T09:29:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5d27fc640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff5c0068380 0x7ff5c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3727849612 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7ff5d8086960 con 0x7ff5dc0c6980 2024-04-21T09:29:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.106+0000 7ff5e1d70640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff5c0068380 0x7ff5c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.110+0000 7ff5e1d70640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff5c0068380 0x7ff5c006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b2000 tx=0x7ff5cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.118+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3727849612 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff5d8056890 con 0x7ff5dc0c6980 2024-04-21T09:29:40.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.282+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5dc0cc040 con 0x7ff5dc0c6980 2024-04-21T09:29:40.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5d27fc640 1 -- 172.21.15.26:0/3727849612 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16716 (secure 0 0 0) 0x7ff5d805ab90 con 0x7ff5dc0c6980 2024-04-21T09:29:40.288 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:40.288 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":67,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T09:28:51.732460+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":765,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":750,"length":16}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T09:29:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff5c0068380 msgr2=0x7ff5c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff5c0068380 0x7ff5c006a840 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b2000 tx=0x7ff5cc008040 comp rx=0 tx=0).stop 2024-04-21T09:29:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 msgr2=0x7ff5dc15a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc15a920 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff5d800c7f0 tx=0x7ff5d800ccb0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 shutdown_connections 2024-04-21T09:29:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5dc0c6d60 0x7ff5dc15ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff5c0068380 0x7ff5c006a840 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff5dc0c6980 0x7ff5dc15a920 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 --2- 172.21.15.26:0/3727849612 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5dc06d0f0 0x7ff5dc15c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 >> 172.21.15.26:0/3727849612 conn(0x7ff5dc0c9b50 msgr2=0x7ff5dc14e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 shutdown_connections 2024-04-21T09:29:40.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.286+0000 7ff5e3fd4640 1 -- 172.21.15.26:0/3727849612 wait complete. 2024-04-21T09:29:40.309 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 765, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T09:29:40.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T09:29:40.394 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh' 2024-04-21T09:29:40.637 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=97f757c031ca4505b78573172dba3452 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi026 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh' 2024-04-21T09:29:40.639 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-21T09:29:40.648 INFO:tasks.quiescer:joining Quiescers 2024-04-21T09:29:40.649 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-21T09:29:40.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.466+0000 7f157350a640 1 Processor -- start 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.466+0000 7f157350a640 1 -- start start 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f157350a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f156c154e70 0x7f156c15b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f157350a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f156c0cb340 0x7f156c0c8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f157350a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156c15e260 con 0x7f156c0cc8d0 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f157350a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f156c15e540 con 0x7f156c0cb340 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f157350a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f156c15e820 con 0x7f156c154e70 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1570aa5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f156c0cc8d0 0x7f156c0d0350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54674/0 (socket says 172.21.15.26:54674) 2024-04-21T09:29:40.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1571aa7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f156c0cb340 0x7f156c0c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1570aa5640 1 -- 172.21.15.26:0/3520240853 learned_addr learned my addr 172.21.15.26:0/3520240853 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f15712a6640 1 --2- 172.21.15.26:0/3520240853 >> v2:172.21.15.169:3300/0 conn(0x7f156c154e70 0x7f156c15b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1571aa7640 1 -- 172.21.15.26:0/3520240853 >> v2:172.21.15.169:3300/0 conn(0x7f156c154e70 msgr2=0x7f156c15b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1571aa7640 1 --2- 172.21.15.26:0/3520240853 >> v2:172.21.15.169:3300/0 conn(0x7f156c154e70 0x7f156c15b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1571aa7640 1 -- 172.21.15.26:0/3520240853 >> v1:172.21.15.26:6789/0 conn(0x7f156c0cc8d0 legacy=0x7f156c0d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f155ffff640 1 -- 172.21.15.26:0/3520240853 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3833005100 0 0) 0x7f156c15e260 con 0x7f156c0cc8d0 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1571aa7640 1 -- 172.21.15.26:0/3520240853 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c15eb00 con 0x7f156c0cb340 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f15712a6640 1 --2- 172.21.15.26:0/3520240853 >> v2:172.21.15.169:3300/0 conn(0x7f156c154e70 0x7f156c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:40.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.470+0000 7f1571aa7640 1 --2- 172.21.15.26:0/3520240853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c0cb340 0x7f156c0c8990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f156c0cadf0 tx=0x7f156401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5b4458645bbef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f155ffff640 1 -- 172.21.15.26:0/3520240853 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640b2070 con 0x7f156c0cb340 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f155ffff640 1 -- 172.21.15.26:0/3520240853 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15640a57f0 con 0x7f156c0cb340 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f155ffff640 1 -- 172.21.15.26:0/3520240853 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640a5bc0 con 0x7f156c0cb340 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- 172.21.15.26:0/3520240853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c0cb340 msgr2=0x7f156c0c8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 --2- 172.21.15.26:0/3520240853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c0cb340 0x7f156c0c8990 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f156c0cadf0 tx=0x7f156401c930 comp rx=0 tx=0).stop 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- 172.21.15.26:0/3520240853 shutdown_connections 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 --2- 172.21.15.26:0/3520240853 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c0cb340 0x7f156c0c8990 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 --2- 172.21.15.26:0/3520240853 >> v2:172.21.15.169:3300/0 conn(0x7f156c154e70 0x7f156c15b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- 172.21.15.26:0/3520240853 >> 172.21.15.26:0/3520240853 conn(0x7f156c06de70 msgr2=0x7f156c06e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:40.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- 172.21.15.26:0/3520240853 shutdown_connections 2024-04-21T09:29:40.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- 172.21.15.26:0/3520240853 wait complete. 2024-04-21T09:29:40.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 Processor -- start 2024-04-21T09:29:40.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- start start 2024-04-21T09:29:40.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f156c0cb340 0x7f156c14a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c0cc8d0 0x7f156c1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c154e70 0x7f156c1f7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f156c0d0be0 con 0x7f156c154e70 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f156c0d0a60 con 0x7f156c0cc8d0 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f157350a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f156c167d70 con 0x7f156c0cb340 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c154e70 0x7f156c1f7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c154e70 0x7f156c1f7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42516/0 (socket says 172.21.15.26:42516) 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 -- 172.21.15.26:0/3044763485 learned_addr learned my addr 172.21.15.26:0/3044763485 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f15712a6640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f156c0cb340 0x7f156c14a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1570aa5640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c0cc8d0 0x7f156c1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 -- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f156c0cb340 msgr2=0x7f156c14a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f156c0cb340 0x7f156c14a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 -- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c0cc8d0 msgr2=0x7f156c1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c0cc8d0 0x7f156c1594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 -- 172.21.15.26:0/3044763485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f156c0d02d0 con 0x7f156c154e70 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f15712a6640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f156c0cb340 0x7f156c14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1570aa5640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c0cc8d0 0x7f156c1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:40.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.474+0000 7f1571aa7640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c154e70 0x7f156c1f7100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f15640b0040 tx=0x7f15640196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f155dffb640 1 -- 172.21.15.26:0/3044763485 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640b2050 con 0x7f156c154e70 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f155dffb640 1 -- 172.21.15.26:0/3044763485 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15640be070 con 0x7f156c154e70 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f156c14a880 con 0x7f156c154e70 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f155dffb640 1 -- 172.21.15.26:0/3044763485 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15640ad870 con 0x7f156c154e70 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f156c148b60 con 0x7f156c154e70 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f156c074320 con 0x7f156c154e70 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f155dffb640 1 -- 172.21.15.26:0/3044763485 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f15640ada10 con 0x7f156c154e70 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f155dffb640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1550068380 0x7f155006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f155dffb640 1 -- 172.21.15.26:0/3044763485 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f1564122580 con 0x7f156c154e70 2024-04-21T09:29:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f15712a6640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1550068380 0x7f155006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.478+0000 7f15712a6640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1550068380 0x7f155006a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f156000b990 tx=0x7f1560008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.482+0000 7f155dffb640 1 -- 172.21.15.26:0/3044763485 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1564016520 con 0x7f156c154e70 2024-04-21T09:29:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.646+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f156c165330 con 0x7f156c154e70 2024-04-21T09:29:40.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.646+0000 7f155dffb640 1 -- 172.21.15.26:0/3044763485 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7f15640f2b50 con 0x7f156c154e70 2024-04-21T09:29:40.665 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T09:29:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1550068380 msgr2=0x7f155006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1550068380 0x7f155006a840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f156000b990 tx=0x7f1560008040 comp rx=0 tx=0).stop 2024-04-21T09:29:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c154e70 msgr2=0x7f156c1f7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c154e70 0x7f156c1f7100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f15640b0040 tx=0x7f15640196d0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 shutdown_connections 2024-04-21T09:29:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1550068380 0x7f155006a840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f156c154e70 0x7f156c1f7100 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f156c0cc8d0 0x7f156c1594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 --2- 172.21.15.26:0/3044763485 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f156c0cb340 0x7f156c14a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 >> 172.21.15.26:0/3044763485 conn(0x7f156c06de70 msgr2=0x7f156c15a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 shutdown_connections 2024-04-21T09:29:40.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.650+0000 7f157350a640 1 -- 172.21.15.26:0/3044763485 wait complete. 2024-04-21T09:29:40.677 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T09:29:40.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1fe07640 1 Processor -- start 2024-04-21T09:29:40.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1fe07640 1 -- start start 2024-04-21T09:29:40.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1fe07640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda18151c10 0x7fda180c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1fe07640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda1806caf0 0x7fda1806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1fe07640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda180c3180 con 0x7fda18157940 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1fe07640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fda180c6020 con 0x7fda1806caf0 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1fe07640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fda180c3420 con 0x7fda18151c10 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1d3a2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda1806caf0 0x7fda1806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1d3a2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fda1806caf0 0x7fda1806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42520/0 (socket says 172.21.15.26:42520) 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1d3a2640 1 -- 172.21.15.26:0/1782030639 learned_addr learned my addr 172.21.15.26:0/1782030639 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1d3a2640 1 -- 172.21.15.26:0/1782030639 >> v2:172.21.15.169:3300/0 conn(0x7fda18151c10 msgr2=0x7fda180c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1d3a2640 1 --2- 172.21.15.26:0/1782030639 >> v2:172.21.15.169:3300/0 conn(0x7fda18151c10 0x7fda180c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1d3a2640 1 -- 172.21.15.26:0/1782030639 >> v1:172.21.15.169:6789/0 conn(0x7fda18157940 legacy=0x7fda1815aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.802+0000 7fda1d3a2640 1 -- 172.21.15.26:0/1782030639 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda180c3700 con 0x7fda1806caf0 2024-04-21T09:29:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1d3a2640 1 --2- 172.21.15.26:0/1782030639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1806caf0 0x7fda1806cf40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda1806d640 tx=0x7fda0c01ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ca79186881f65e server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1cba1640 1 -- 172.21.15.26:0/1782030639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0b5070 con 0x7fda1806caf0 2024-04-21T09:29:40.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1cba1640 1 -- 172.21.15.26:0/1782030639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0c0a89d0 con 0x7fda1806caf0 2024-04-21T09:29:40.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1cba1640 1 -- 172.21.15.26:0/1782030639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda0c0a8da0 con 0x7fda1806caf0 2024-04-21T09:29:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 -- 172.21.15.26:0/1782030639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1806caf0 msgr2=0x7fda1806cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 --2- 172.21.15.26:0/1782030639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1806caf0 0x7fda1806cf40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fda1806d640 tx=0x7fda0c01ecd0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 -- 172.21.15.26:0/1782030639 shutdown_connections 2024-04-21T09:29:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 --2- 172.21.15.26:0/1782030639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda1806caf0 0x7fda1806cf40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 --2- 172.21.15.26:0/1782030639 >> v2:172.21.15.169:3300/0 conn(0x7fda18151c10 0x7fda180c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 -- 172.21.15.26:0/1782030639 >> 172.21.15.26:0/1782030639 conn(0x7fda180702c0 msgr2=0x7fda180cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:40.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 -- 172.21.15.26:0/1782030639 shutdown_connections 2024-04-21T09:29:40.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 -- 172.21.15.26:0/1782030639 wait complete. 2024-04-21T09:29:40.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 Processor -- start 2024-04-21T09:29:40.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.806+0000 7fda1fe07640 1 -- start start 2024-04-21T09:29:40.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda1806caf0 0x7fda180c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda18151c10 0x7fda181ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda18157940 0x7fda18148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fda180c89d0 con 0x7fda18157940 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fda180c5cb0 con 0x7fda18151c10 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fda180c4170 con 0x7fda1806caf0 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda18157940 0x7fda18148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda18157940 0x7fda18148080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42536/0 (socket says 172.21.15.26:42536) 2024-04-21T09:29:40.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 -- 172.21.15.26:0/3504275200 learned_addr learned my addr 172.21.15.26:0/3504275200 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1dba3640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda1806caf0 0x7fda180c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1d3a2640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda18151c10 0x7fda181ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 -- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda1806caf0 msgr2=0x7fda180c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda1806caf0 0x7fda180c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 -- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda18151c10 msgr2=0x7fda181ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda18151c10 0x7fda181ed130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 -- 172.21.15.26:0/3504275200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1814f140 con 0x7fda18157940 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1e3a4640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda18157940 0x7fda18148080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c410 tx=0x7fda1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda167fc640 1 -- 172.21.15.26:0/3504275200 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10017070 con 0x7fda18157940 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda167fc640 1 -- 172.21.15.26:0/3504275200 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda10003600 con 0x7fda18157940 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda18157690 con 0x7fda18157940 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda167fc640 1 -- 172.21.15.26:0/3504275200 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda10003a30 con 0x7fda18157940 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda181491a0 con 0x7fda18157940 2024-04-21T09:29:40.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda18075ef0 con 0x7fda18157940 2024-04-21T09:29:40.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.810+0000 7fda167fc640 1 -- 172.21.15.26:0/3504275200 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fda1001a070 con 0x7fda18157940 2024-04-21T09:29:40.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.814+0000 7fda167fc640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fda04068380 0x7fda0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.814+0000 7fda167fc640 1 -- 172.21.15.26:0/3504275200 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fda10085dd0 con 0x7fda18157940 2024-04-21T09:29:40.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.814+0000 7fda1dba3640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fda04068380 0x7fda0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.814+0000 7fda1dba3640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fda04068380 0x7fda0406a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fda08009f20 tx=0x7fda080094f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.818+0000 7fda167fc640 1 -- 172.21.15.26:0/3504275200 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fda10056350 con 0x7fda18157940 2024-04-21T09:29:40.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfc671640 1 Processor -- start 2024-04-21T09:29:40.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfc671640 1 -- start start 2024-04-21T09:29:40.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfc671640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 0x7f7bf415eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfc671640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf415b3a0 con 0x7f7bf40c7680 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfc671640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf415b680 con 0x7f7bf40cb120 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfc671640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf415e130 con 0x7f7bf4154eb0 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf9c0c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7bf40c7680 0x7f7bf415ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54678/0 (socket says 172.21.15.26:54678) 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf9c0c640 1 -- 172.21.15.26:0/118171181 learned_addr learned my addr 172.21.15.26:0/118171181 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 0x7f7bf415eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420276405 0 0) 0x7f7bf415b3a0 con 0x7f7bf40c7680 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7be0003530 con 0x7f7bf40c7680 2024-04-21T09:29:40.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 175923151 0 0) 0x7f7be0003530 con 0x7f7bf40c7680 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 msgr2=0x7f7bf415eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 0x7f7bf415eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 >> v1:172.21.15.169:6789/0 conn(0x7f7bf40cb120 legacy=0x7f7bf40d01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf415b960 con 0x7f7bf40c7680 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f7be4001680 con 0x7f7bf40c7680 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 0x7f7bf415eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 >> v1:172.21.15.26:6789/0 conn(0x7f7bf40c7680 legacy=0x7f7bf415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be00039f0 0x7f7be0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be0004810 0x7f7be0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 0x7f7be00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf415e130 con 0x7f7be00039f0 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7be000bad0 con 0x7f7be0004810 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7be000bcd0 con 0x7f7bf4154eb0 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.850+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be00039f0 0x7f7be0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfac0e640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 0x7f7be00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bf9c0c640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be0004810 0x7f7be0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfa40d640 1 -- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 msgr2=0x7f7be00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7bf4154eb0 0x7f7be00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfa40d640 1 -- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be0004810 msgr2=0x7f7be0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be0004810 0x7f7be0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfa40d640 1 -- 172.21.15.26:0/118171181 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be0003530 con 0x7f7be00039f0 2024-04-21T09:29:40.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bf9c0c640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7be0004810 0x7f7be0004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be00039f0 0x7f7be0003e10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00073e0 tx=0x7f7bf001cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18dcd34c302e82c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00b2070 con 0x7f7be00039f0 2024-04-21T09:29:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf00a5bb0 con 0x7f7be00039f0 2024-04-21T09:29:40.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bf940b640 1 -- 172.21.15.26:0/118171181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0009c80 con 0x7f7be00039f0 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfc671640 1 -- 172.21.15.26:0/118171181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be00039f0 msgr2=0x7f7be0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfc671640 1 --2- 172.21.15.26:0/118171181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7be00039f0 0x7f7be0003e10 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00073e0 tx=0x7f7bf001cec0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfac0e640 1 -- 172.21.15.26:0/118171181 reap_dead start 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfc671640 1 -- 172.21.15.26:0/118171181 shutdown_connections 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfc671640 1 -- 172.21.15.26:0/118171181 >> 172.21.15.26:0/118171181 conn(0x7f7bf406dea0 msgr2=0x7f7bf406e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfc671640 1 -- 172.21.15.26:0/118171181 shutdown_connections 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.854+0000 7f7bfc671640 1 -- 172.21.15.26:0/118171181 wait complete. 2024-04-21T09:29:40.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 Processor -- start 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 -- start start 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be00039f0 0x7f7bf4157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4157430 0x7f7bf40c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf41647d0 0x7f7bf414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf40cb970 con 0x7f7bf4157430 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf415ef90 con 0x7f7bf41647d0 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf40cbaf0 con 0x7f7be00039f0 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4157430 0x7f7bf40c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4157430 0x7f7bf40c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42566/0 (socket says 172.21.15.26:42566) 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 -- 172.21.15.26:0/1584025538 learned_addr learned my addr 172.21.15.26:0/1584025538 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be00039f0 0x7f7bf4157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfac0e640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf41647d0 0x7f7bf414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 -- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be00039f0 msgr2=0x7f7bf4157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be00039f0 0x7f7bf4157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 -- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf41647d0 msgr2=0x7f7bf414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf41647d0 0x7f7bf414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:40.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 -- 172.21.15.26:0/1584025538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf41f7d60 con 0x7f7bf4157430 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfac0e640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf41647d0 0x7f7bf414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bf9c0c640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4157430 0x7f7bf40c85e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7be400d8a0 tx=0x7f7be400dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7beaffd640 1 -- 172.21.15.26:0/1584025538 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4019070 con 0x7f7bf4157430 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7beaffd640 1 -- 172.21.15.26:0/1584025538 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be40074e0 con 0x7f7bf4157430 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf41581b0 con 0x7f7bf4157430 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7beaffd640 1 -- 172.21.15.26:0/1584025538 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be40049f0 con 0x7f7bf4157430 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf41f6fa0 con 0x7f7bf4157430 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf4074320 con 0x7f7bf4157430 2024-04-21T09:29:40.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7beaffd640 1 -- 172.21.15.26:0/1584025538 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7be401c070 con 0x7f7bf4157430 2024-04-21T09:29:40.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7beaffd640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bd8068380 0x7f7bd806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:40.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.858+0000 7f7beaffd640 1 -- 172.21.15.26:0/1584025538 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f7be40865d0 con 0x7f7bf4157430 2024-04-21T09:29:40.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.862+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bd8068380 0x7f7bd806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:40.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.862+0000 7f7bfa40d640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bd8068380 0x7f7bd806a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00af000 tx=0x7f7bf0004a50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:40.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:40.866+0000 7f7beaffd640 1 -- 172.21.15.26:0/1584025538 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7be4056ac0 con 0x7f7bf4157430 2024-04-21T09:29:41.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda180c8c70 con 0x7fda18157940 2024-04-21T09:29:41.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda167fc640 1 -- 172.21.15.26:0/3504275200 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6827 (secure 0 0 0) 0x7fda10087070 con 0x7fda18157940 2024-04-21T09:29:41.027 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:41.028 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4223,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1158810568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6834","nonce":1158810568},{"type":"v1","addr":"172.21.15.169:6835","nonce":1158810568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4255,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6835/691430272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":691430272},{"type":"v1","addr":"172.21.15.26:6835","nonce":691430272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/1869146683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":1869146683},{"type":"v1","addr":"172.21.15.26:6833","nonce":1869146683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/3168198260","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6836","nonce":3168198260},{"type":"v1","addr":"172.21.15.26:6837","nonce":3168198260}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4276,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6838/360194031","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6836","nonce":360194031},{"type":"v1","addr":"172.21.15.169:6838","nonce":360194031}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-21T08:57:43.594557+0000","modified":"2024-04-21T08:57:50.320200+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.169:6839/4294502436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6837","nonce":4294502436},{"type":"v1","addr":"172.21.15.169:6839","nonce":4294502436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4279,"qdb_cluster":[4279]},"id":1}]} 2024-04-21T09:29:41.028 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 8 2024-04-21T09:29:41.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7bf40b5ba0 con 0x7f7bf4157430 2024-04-21T09:29:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7f7beaffd640 1 -- 172.21.15.26:0/1584025538 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) ==== 104+0+11 (secure 0 0 0) 0x7f7be40563c0 con 0x7f7bf4157430 2024-04-21T09:29:41.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fda04068380 msgr2=0x7fda0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.030 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T09:29:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fda04068380 0x7fda0406a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fda08009f20 tx=0x7fda080094f0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda18157940 msgr2=0x7fda18148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda18157940 0x7fda18148080 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fda1000c410 tx=0x7fda1000c8d0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 shutdown_connections 2024-04-21T09:29:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fda04068380 0x7fda0406a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fda18157940 0x7fda18148080 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda18151c10 0x7fda181ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 --2- 172.21.15.26:0/3504275200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda1806caf0 0x7fda180c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 >> 172.21.15.26:0/3504275200 conn(0x7fda180702c0 msgr2=0x7fda181432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 shutdown_connections 2024-04-21T09:29:41.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.026+0000 7fda1fe07640 1 -- 172.21.15.26:0/3504275200 wait complete. 2024-04-21T09:29:41.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bd8068380 msgr2=0x7f7bd806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bd8068380 0x7f7bd806a840 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00af000 tx=0x7f7bf0004a50 comp rx=0 tx=0).stop 2024-04-21T09:29:41.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4157430 msgr2=0x7f7bf40c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4157430 0x7f7bf40c85e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7be400d8a0 tx=0x7f7be400dd60 comp rx=0 tx=0).stop 2024-04-21T09:29:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 shutdown_connections 2024-04-21T09:29:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7bf41647d0 0x7f7bf414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7bd8068380 0x7f7bd806a840 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7bf4157430 0x7f7bf40c85e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 --2- 172.21.15.26:0/1584025538 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7be00039f0 0x7f7bf4157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 >> 172.21.15.26:0/1584025538 conn(0x7f7bf406dea0 msgr2=0x7f7bf4159a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 shutdown_connections 2024-04-21T09:29:41.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.030+0000 7f7bfc671640 1 -- 172.21.15.26:0/1584025538 wait complete. 2024-04-21T09:29:41.047 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4279 quiesce db --cancel --all' 2024-04-21T09:29:41.047 DEBUG:teuthology.orchestra.run.smithi026:> timeout 45 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4279 quiesce db --cancel --all 2024-04-21T09:29:41.049 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T09:29:41.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.198+0000 7f666ab05640 1 Processor -- start 2024-04-21T09:29:41.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.198+0000 7f666ab05640 1 -- start start 2024-04-21T09:29:41.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f666ab05640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6664159e60 0x7f6664070870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f666ab05640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f66641594e0 0x7f66640ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f666ab05640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6664159970 con 0x7f6664152bf0 2024-04-21T09:29:41.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f666ab05640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f66640c5250 con 0x7f66641594e0 2024-04-21T09:29:41.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f666ab05640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f66640c38e0 con 0x7f6664159e60 2024-04-21T09:29:41.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6664152bf0 0x7f66640c8bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54680/0 (socket says 172.21.15.26:54680) 2024-04-21T09:29:41.203 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 -- 172.21.15.26:0/26064059 learned_addr learned my addr 172.21.15.26:0/26064059 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:41.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f6663fff640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6664159e60 0x7f6664070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638937420 0 0) 0x7f665c001120 con 0x7f6664152bf0 2024-04-21T09:29:41.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6650003530 con 0x7f6664152bf0 2024-04-21T09:29:41.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66690a2640 1 --2- 172.21.15.26:0/26064059 >> v2:172.21.15.169:3300/0 conn(0x7f66641594e0 0x7f66640ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1918356072 0 0) 0x7f6650003530 con 0x7f6664152bf0 2024-04-21T09:29:41.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6664159e60 msgr2=0x7f6664070870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6664159e60 0x7f6664070870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 >> v2:172.21.15.169:3300/0 conn(0x7f66641594e0 msgr2=0x7f66640ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 --2- 172.21.15.26:0/26064059 >> v2:172.21.15.169:3300/0 conn(0x7f66641594e0 0x7f66640ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66640c3320 con 0x7f6664152bf0 2024-04-21T09:29:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f665c001850 con 0x7f6664152bf0 2024-04-21T09:29:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 >> v1:172.21.15.26:6789/0 conn(0x7f6664152bf0 legacy=0x7f66640c8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f6650003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6664159e60 0x7f6650004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6650004d50 0x7f66500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66640c5250 con 0x7f66500039c0 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f66640c38e0 con 0x7f6650004d50 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f665000b9d0 con 0x7f6664159e60 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f6650003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 -- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6664159e60 msgr2=0x7f6650004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6664159e60 0x7f6650004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 -- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6650004d50 msgr2=0x7f66500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6650004d50 0x7f66500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 -- 172.21.15.26:0/26064059 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6650003530 con 0x7f66500039c0 2024-04-21T09:29:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66688a1640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f6650003de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f665c00c4c0 tx=0x7f665c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16357303c5506f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c00c0e0 con 0x7f66500039c0 2024-04-21T09:29:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c0a9020 con 0x7f66500039c0 2024-04-21T09:29:41.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.202+0000 7f66637fe640 1 -- 172.21.15.26:0/26064059 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c005ae0 con 0x7f66500039c0 2024-04-21T09:29:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- 172.21.15.26:0/26064059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 msgr2=0x7f6650003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 --2- 172.21.15.26:0/26064059 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f6650003de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f665c00c4c0 tx=0x7f665c01ccc0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66690a2640 1 -- 172.21.15.26:0/26064059 reap_dead start 2024-04-21T09:29:41.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- 172.21.15.26:0/26064059 shutdown_connections 2024-04-21T09:29:41.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- 172.21.15.26:0/26064059 >> 172.21.15.26:0/26064059 conn(0x7f6664067760 msgr2=0x7f6664067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- 172.21.15.26:0/26064059 shutdown_connections 2024-04-21T09:29:41.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- 172.21.15.26:0/26064059 wait complete. 2024-04-21T09:29:41.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd513b8a640 1 Processor -- start 2024-04-21T09:29:41.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd513b8a640 1 -- start start 2024-04-21T09:29:41.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd513b8a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd50c154e40 0x7fd50c0d0390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 Processor -- start 2024-04-21T09:29:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd513b8a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c0cbbe0 0x7fd50c0d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd513b8a640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd50c15b060 con 0x7fd50c15abb0 2024-04-21T09:29:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd513b8a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd50c15b340 con 0x7fd50c154e40 2024-04-21T09:29:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd513b8a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c15b620 con 0x7fd50c0cbbe0 2024-04-21T09:29:41.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- start start 2024-04-21T09:29:41.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd511926640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd50c154e40 0x7fd50c0d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd511926640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd50c154e40 0x7fd50c0d0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42580/0 (socket says 172.21.15.26:42580) 2024-04-21T09:29:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd511926640 1 -- 172.21.15.26:0/4194582669 learned_addr learned my addr 172.21.15.26:0/4194582669 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd512127640 1 --2- 172.21.15.26:0/4194582669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c0cbbe0 0x7fd50c0d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd511926640 1 -- 172.21.15.26:0/4194582669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c0cbbe0 msgr2=0x7fd50c0d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd511926640 1 --2- 172.21.15.26:0/4194582669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c0cbbe0 0x7fd50c0d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd511926640 1 -- 172.21.15.26:0/4194582669 >> v1:172.21.15.169:6789/0 conn(0x7fd50c15abb0 legacy=0x7fd50c0cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd511926640 1 -- 172.21.15.26:0/4194582669 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c15b900 con 0x7fd50c154e40 2024-04-21T09:29:41.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7fd512127640 1 --2- 172.21.15.26:0/4194582669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c0cbbe0 0x7fd50c0d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:41.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f66640c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66641560e0 0x7f666415e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f666415e780 0x7f66641e87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66640703e0 con 0x7f66500039c0 2024-04-21T09:29:41.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f666415a240 con 0x7f66641560e0 2024-04-21T09:29:41.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f6664070070 con 0x7f666415e780 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f66640c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f66640c7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42590/0 (socket says 172.21.15.26:42590) 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 -- 172.21.15.26:0/257549541 learned_addr learned my addr 172.21.15.26:0/257549541 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66690a2640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f666415e780 0x7f66641e87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f6663fff640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66641560e0 0x7f666415e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 -- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f666415e780 msgr2=0x7f66641e87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f666415e780 0x7f66641e87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 -- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66641560e0 msgr2=0x7f666415e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66641560e0 0x7f666415e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 -- 172.21.15.26:0/257549541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6664159130 con 0x7f66500039c0 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66688a1640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f66640c7490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f665c0ab040 tx=0x7f6650005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66617fa640 1 -- 172.21.15.26:0/257549541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c0049f0 con 0x7f66500039c0 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66617fa640 1 -- 172.21.15.26:0/257549541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f665c004bb0 con 0x7f66500039c0 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6664158e90 con 0x7f66500039c0 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f66617fa640 1 -- 172.21.15.26:0/257549541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f665c0a57a0 con 0x7f66500039c0 2024-04-21T09:29:41.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.206+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66641f2930 con 0x7f66500039c0 2024-04-21T09:29:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6664074320 con 0x7f66500039c0 2024-04-21T09:29:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511926640 1 --2- 172.21.15.26:0/4194582669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c0d0390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd508009e50 tx=0x7fd50801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16274b2c02d39718 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd510924640 1 -- 172.21.15.26:0/4194582669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080b4070 con 0x7fd50c154e40 2024-04-21T09:29:41.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd510924640 1 -- 172.21.15.26:0/4194582669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5080af400 con 0x7fd50c154e40 2024-04-21T09:29:41.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd510924640 1 -- 172.21.15.26:0/4194582669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080af7d0 con 0x7fd50c154e40 2024-04-21T09:29:41.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7f66617fa640 1 -- 172.21.15.26:0/257549541 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f665c0a5940 con 0x7f66500039c0 2024-04-21T09:29:41.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7f66617fa640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6644068380 0x7f664406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- 172.21.15.26:0/4194582669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 msgr2=0x7fd50c0d0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 --2- 172.21.15.26:0/4194582669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c0d0390 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fd508009e50 tx=0x7fd50801f1e0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7f66617fa640 1 -- 172.21.15.26:0/257549541 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f665c11fa40 con 0x7f66500039c0 2024-04-21T09:29:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- 172.21.15.26:0/4194582669 shutdown_connections 2024-04-21T09:29:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 --2- 172.21.15.26:0/4194582669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c0cbbe0 0x7fd50c0d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 --2- 172.21.15.26:0/4194582669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c0d0390 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- 172.21.15.26:0/4194582669 >> 172.21.15.26:0/4194582669 conn(0x7fd50c067760 msgr2=0x7fd50c067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- 172.21.15.26:0/4194582669 shutdown_connections 2024-04-21T09:29:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- 172.21.15.26:0/4194582669 wait complete. 2024-04-21T09:29:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7f6663fff640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6644068380 0x7f664406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7f6663fff640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6644068380 0x7f664406a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6664151cc0 tx=0x7f664c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 Processor -- start 2024-04-21T09:29:41.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- start start 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd50c0cbbe0 0x7fd50c1f1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c15abb0 0x7fd50c1e4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1553a0 con 0x7fd50c154e40 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c155220 con 0x7fd50c0cbbe0 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd513b8a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c0c6900 con 0x7fd50c15abb0 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c148110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42592/0 (socket says 172.21.15.26:42592) 2024-04-21T09:29:41.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 -- 172.21.15.26:0/2230386914 learned_addr learned my addr 172.21.15.26:0/2230386914 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd512127640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c15abb0 0x7fd50c1e4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511926640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd50c0cbbe0 0x7fd50c1f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 -- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c15abb0 msgr2=0x7fd50c1e4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c15abb0 0x7fd50c1e4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 -- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd50c0cbbe0 msgr2=0x7fd50c1f1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd50c0cbbe0 0x7fd50c1f1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 -- 172.21.15.26:0/2230386914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd50c15e770 con 0x7fd50c154e40 2024-04-21T09:29:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.210+0000 7fd511125640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c148110 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00b3e0 tx=0x7fd4fc00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd5027fc640 1 -- 172.21.15.26:0/2230386914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc015020 con 0x7fd50c154e40 2024-04-21T09:29:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd5027fc640 1 -- 172.21.15.26:0/2230386914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc011830 con 0x7fd50c154e40 2024-04-21T09:29:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd50c15ea10 con 0x7fd50c154e40 2024-04-21T09:29:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd5027fc640 1 -- 172.21.15.26:0/2230386914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc011c60 con 0x7fd50c154e40 2024-04-21T09:29:41.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd50c1e4090 con 0x7fd50c154e40 2024-04-21T09:29:41.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7f66617fa640 1 -- 172.21.15.26:0/257549541 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6664159970 con 0x7f66500039c0 2024-04-21T09:29:41.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd5027fc640 1 -- 172.21.15.26:0/2230386914 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd4fc018020 con 0x7fd50c154e40 2024-04-21T09:29:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd5027fc640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd4f0068380 0x7fd4f006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.214+0000 7fd5027fc640 1 -- 172.21.15.26:0/2230386914 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fd4fc0865a0 con 0x7fd50c154e40 2024-04-21T09:29:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511926640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd4f0068380 0x7fd4f006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 Processor -- start 2024-04-21T09:29:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- start start 2024-04-21T09:29:41.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511926640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd4f0068380 0x7fd4f006a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b1000 tx=0x7fd5080aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16d8570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558ac1583b30 con 0x558ac16d8ab0 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558ac14ea2c0 con 0x558ac16dd9a0 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558ac14a34c0 con 0x558ac16d8190 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42608/0 (socket says 172.21.15.26:42608) 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 -- 172.21.15.26:0/3981356744 learned_addr learned my addr 172.21.15.26:0/3981356744 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511926640 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16d8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd512127640 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 -- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 msgr2=0x558ac16d8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16d8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 -- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 msgr2=0x558ac16ddd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16ddd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 -- 172.21.15.26:0/3981356744 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac14e4eb0 con 0x558ac16d8ab0 2024-04-21T09:29:41.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd511125640 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dd460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc084a30 tx=0x7fd4fc056560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c5555b85ba3fff server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd4ef7fe640 1 -- 172.21.15.26:0/3981356744 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0544c0 con 0x558ac16d8ab0 2024-04-21T09:29:41.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd4ef7fe640 1 -- 172.21.15.26:0/3981356744 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc054720 con 0x558ac16d8ab0 2024-04-21T09:29:41.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd4ef7fe640 1 -- 172.21.15.26:0/3981356744 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc055870 con 0x558ac16d8ab0 2024-04-21T09:29:41.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- 172.21.15.26:0/3981356744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 msgr2=0x558ac16dd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dd460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc084a30 tx=0x7fd4fc056560 comp rx=0 tx=0).stop 2024-04-21T09:29:41.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- 172.21.15.26:0/3981356744 shutdown_connections 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16ddd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dd460 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3981356744 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16d8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- 172.21.15.26:0/3981356744 >> 172.21.15.26:0/3981356744 conn(0x558ac16d9210 msgr2=0x558ac16db600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- 172.21.15.26:0/3981356744 shutdown_connections 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- 172.21.15.26:0/3981356744 wait complete. 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 -- start start 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.218+0000 7fd516d0c000 1 Processor -- start 2024-04-21T09:29:41.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16a1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558ac14e6280 con 0x558ac16d8ab0 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558ac14a89d0 con 0x558ac16dd9a0 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558ac148f1b0 con 0x558ac16d8190 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 10 client.0 _ll_register_callbacks cb 0x558ac159e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16a1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16a1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42624/0 (socket says 172.21.15.26:42624) 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 -- 172.21.15.26:0/3568431645 learned_addr learned my addr 172.21.15.26:0/3568431645 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511926640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd512127640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 -- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 msgr2=0x558ac16a14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16a14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 -- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 msgr2=0x558ac16e61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16e61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 -- 172.21.15.26:0/3568431645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac146de70 con 0x558ac16d8ab0 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511926640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511125640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16a1a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009fd0 tx=0x7fd4fc00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeda36a1b50c3652 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd4ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd4ecff9640 1 -- 172.21.15.26:0/3568431645 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc072020 con 0x558ac16d8ab0 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc054720 con 0x558ac16d8ab0 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd4ecff9640 1 -- 172.21.15.26:0/3568431645 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fd4fc055a70 con 0x558ac16d8ab0 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd4ecff9640 1 -- 172.21.15.26:0/3568431645 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd4fc084070 con 0x558ac16d8ab0 2024-04-21T09:29:41.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 10 client.5274 fetch_fsmap learned FSMap version 8 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558ac14a3710 con 0x558ac16d8ab0 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd4ecff9640 1 -- 172.21.15.26:0/3568431645 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc054720 con 0x558ac16d8ab0 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd4ecff9640 1 -- 172.21.15.26:0/3568431645 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fd4fc0860c0 con 0x558ac16d8ab0 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 10 client.5274 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 10 client.5274 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 20 client.5274 populate_metadata read hostname 'smithi026' 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac16e6ef0 0x558ac16e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 4 client.5274 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-21T09:29:41.245 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ac1483df0 con 0x558ac16e6ef0 2024-04-21T09:29:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511926640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac16e6ef0 0x558ac16e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd511926640 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac16e6ef0 0x558ac16e72d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a9b67e757193504 server_cookie=ba8103016dd76f6e in_seq=0 out_seq=0 2024-04-21T09:29:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.222+0000 7fd4ecff9640 10 client.5274 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd4ecff9640 1 -- 172.21.15.26:0/3568431645 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558ac1483df0 con 0x558ac16e6ef0 2024-04-21T09:29:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd4ecff9640 10 client.5274 handle_command_reply: tid=0 2024-04-21T09:29:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 client.5274 shutdown 2024-04-21T09:29:41.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 msgr2=0x558ac16a1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16a1a10 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009fd0 tx=0x7fd4fc00bf50 comp rx=0 tx=0).stop 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 shutdown_connections 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac16e6ef0 0x558ac16e72d0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16dd9a0 0x558ac16e61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd4ecff9640 0 client.5274 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16a1a10 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3568431645 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8190 0x558ac16a14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 >> 172.21.15.26:0/3568431645 conn(0x558ac16d9210 msgr2=0x558ac16db600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 shutdown_connections 2024-04-21T09:29:41.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 1 -- 172.21.15.26:0/3568431645 wait complete. 2024-04-21T09:29:41.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.226+0000 7fd516d0c000 20 client.5274 trim_cache size 0 max 16384 2024-04-21T09:29:41.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 Processor -- start 2024-04-21T09:29:41.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- start start 2024-04-21T09:29:41.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16f8970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16dd9a0 0x558ac16dcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1f4ff0 con 0x558ac16d8ab0 2024-04-21T09:29:41.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fd50c1f4330 con 0x558ac16d8190 2024-04-21T09:29:41.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fd50c1f4980 con 0x558ac16dd9a0 2024-04-21T09:29:41.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dc820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42628/0 (socket says 172.21.15.26:42628) 2024-04-21T09:29:41.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 -- 172.21.15.26:0/3402390349 learned_addr learned my addr 172.21.15.26:0/3402390349 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd512127640 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16dd9a0 0x558ac16dcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 -- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16dd9a0 msgr2=0x558ac16dcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16dd9a0 0x558ac16dcd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511926640 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 -- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 msgr2=0x558ac16f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16f8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 -- 172.21.15.26:0/3402390349 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ac156c9f0 con 0x558ac16d8ab0 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd511125640 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dc820 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00bda0 tx=0x7fd4fc080070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3b6ee4fceef57c server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd4eeffd640 1 -- 172.21.15.26:0/3402390349 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc072070 con 0x558ac16d8ab0 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd4eeffd640 1 -- 172.21.15.26:0/3402390349 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc0860c0 con 0x558ac16d8ab0 2024-04-21T09:29:41.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd4eeffd640 1 -- 172.21.15.26:0/3402390349 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0526c0 con 0x558ac16d8ab0 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- 172.21.15.26:0/3402390349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 msgr2=0x558ac16dc820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dc820 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00bda0 tx=0x7fd4fc080070 comp rx=0 tx=0).stop 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- 172.21.15.26:0/3402390349 shutdown_connections 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16dd9a0 0x558ac16dcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16d8ab0 0x558ac16dc820 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 --2- 172.21.15.26:0/3402390349 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- 172.21.15.26:0/3402390349 >> 172.21.15.26:0/3402390349 conn(0x558ac16d9210 msgr2=0x558ac1699d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- 172.21.15.26:0/3402390349 shutdown_connections 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- 172.21.15.26:0/3402390349 wait complete. 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.242+0000 7fd516d0c000 1 -- start start 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 Processor -- start 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8ab0 0x558ac169e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16dd9a0 0x558ac169e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558ac14e95d0 con 0x558ac16dd9a0 2024-04-21T09:29:41.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x558ac148a3d0 con 0x558ac16d8190 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x558ac14ee8f0 con 0x558ac16d8ab0 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 10 client.0 _ll_register_callbacks cb 0x7fd5080b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16dd9a0 0x558ac169e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16dd9a0 0x558ac169e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42636/0 (socket says 172.21.15.26:42636) 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 -- 172.21.15.26:0/1717410094 learned_addr learned my addr 172.21.15.26:0/1717410094 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd511926640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd511125640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8ab0 0x558ac169e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 -- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8ab0 msgr2=0x558ac169e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8ab0 0x558ac169e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 -- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 msgr2=0x558ac16a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 -- 172.21.15.26:0/1717410094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ac14b4d90 con 0x558ac16dd9a0 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd511125640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8ab0 0x558ac169e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd512127640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16dd9a0 0x558ac169e580 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd504011e50 tx=0x7fd5040136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9aa0edf10e0464 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-21T09:29:41.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 1 -- 172.21.15.26:0/1717410094 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd504016460 con 0x558ac16dd9a0 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 1 -- 172.21.15.26:0/1717410094 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fd504016600 con 0x558ac16dd9a0 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4fc0860c0 con 0x558ac16dd9a0 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 1 -- 172.21.15.26:0/1717410094 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7fd504027050 con 0x558ac16dd9a0 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 10 client.5280 fetch_fsmap learned FSMap version 8 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x558ac148f3a0 con 0x558ac16dd9a0 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 1 -- 172.21.15.26:0/1717410094 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc0860c0 con 0x558ac16dd9a0 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 1 -- 172.21.15.26:0/1717410094 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 8) ==== 4704+0+0 (secure 0 0 0) 0x7fd50402a020 con 0x558ac16dd9a0 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 10 client.5280 fetch_fsmap finished waiting for FSMap version 8 2024-04-21T09:29:41.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 10 client.5280 resolve_mds: validated gid 4279 aka daemon mds.d 2024-04-21T09:29:41.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 20 client.5280 populate_metadata read hostname 'smithi026' 2024-04-21T09:29:41.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac169eac0 0x558ac169eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 4 client.5280 mds_command: new command op to 4279 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-21T09:29:41.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 --> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x558ac14f7ce0 con 0x558ac169eac0 2024-04-21T09:29:41.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd511926640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac169eac0 0x558ac169eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 10 client.5280 ms_handle_connect on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:41.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd511926640 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac169eac0 0x558ac169eed0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a05fd56965eb1d0b server_cookie=b3e243a0c8073f3 in_seq=0 out_seq=0 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 1 -- 172.21.15.26:0/1717410094 <== mds.0 v2:172.21.15.169:6837/4294502436 1 ==== command_reply(tid 0: 0 ) ==== 8+0+78 (crc 0 0 0) 0x558ac14f7ce0 con 0x558ac169eac0 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 10 client.5280 handle_command_reply: tid=0 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 client.5280 shutdown 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16dd9a0 msgr2=0x558ac169e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16dd9a0 0x558ac169e580 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd504011e50 tx=0x7fd5040136b0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 shutdown_connections 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:6837/4294502436,v1:172.21.15.169:6839/4294502436] conn(0x558ac169eac0 0x558ac169eed0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558ac16dd9a0 0x558ac169e580 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x558ac16d8ab0 0x558ac169e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 --2- 172.21.15.26:0/1717410094 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x558ac16d8190 0x558ac16a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd4ecff9640 0 client.5280 ms_handle_reset on v2:172.21.15.169:6837/4294502436 2024-04-21T09:29:41.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 >> 172.21.15.26:0/1717410094 conn(0x558ac16d9210 msgr2=0x558ac16988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 shutdown_connections 2024-04-21T09:29:41.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 1 -- 172.21.15.26:0/1717410094 wait complete. 2024-04-21T09:29:41.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.246+0000 7fd516d0c000 20 client.5280 trim_cache size 0 max 16384 2024-04-21T09:29:41.265 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-21T09:29:41.265 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 8, 2024-04-21T09:29:41.265 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4279, 2024-04-21T09:29:41.265 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 34, 2024-04-21T09:29:41.265 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": {} 2024-04-21T09:29:41.265 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-21T09:29:41.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd4f0068380 msgr2=0x7fd4f006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd4f0068380 0x7fd4f006a840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5080b1000 tx=0x7fd5080aa000 comp rx=0 tx=0).stop 2024-04-21T09:29:41.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 msgr2=0x7fd50c148110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c148110 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc00b3e0 tx=0x7fd4fc00b8a0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 shutdown_connections 2024-04-21T09:29:41.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd50c15abb0 0x7fd50c1e4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fd4f0068380 0x7fd4f006a840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd50c154e40 0x7fd50c148110 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 --2- 172.21.15.26:0/2230386914 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd50c0cbbe0 0x7fd50c1f1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 >> 172.21.15.26:0/2230386914 conn(0x7fd50c067760 msgr2=0x7fd50c1540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 shutdown_connections 2024-04-21T09:29:41.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.250+0000 7fd513b8a640 1 -- 172.21.15.26:0/2230386914 wait complete. 2024-04-21T09:29:41.268 ERROR:teuthology.run_tasks:Manager failed: quiescer Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -110 (ETIMEDOUT) 2024-04-21T09:29:41.273 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-21T09:29:41.283 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-21T09:29:41.284 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T09:29:41.284 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T09:29:41.290 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T09:29:41.290 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T09:29:41.338 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T09:29:41.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f66640c8670 con 0x7f66500039c0 2024-04-21T09:29:41.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f66617fa640 1 -- 172.21.15.26:0/257549541 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) ==== 100+0+11 (secure 0 0 0) 0x7f665c0effc0 con 0x7f66500039c0 2024-04-21T09:29:41.383 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T09:29:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6644068380 msgr2=0x7f664406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6644068380 0x7f664406a840 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6664151cc0 tx=0x7f664c008040 comp rx=0 tx=0).stop 2024-04-21T09:29:41.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 msgr2=0x7f66640c7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f66640c7490 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f665c0ab040 tx=0x7f6650005840 comp rx=0 tx=0).stop 2024-04-21T09:29:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 shutdown_connections 2024-04-21T09:29:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f666415e780 0x7f66641e87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f66641560e0 0x7f666415e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6644068380 0x7f664406a840 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 --2- 172.21.15.26:0/257549541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66500039c0 0x7f66640c7490 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 >> 172.21.15.26:0/257549541 conn(0x7f6664067760 msgr2=0x7f66640cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 shutdown_connections 2024-04-21T09:29:41.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.382+0000 7f666ab05640 1 -- 172.21.15.26:0/257549541 wait complete. 2024-04-21T09:29:41.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-21T09:29:41.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.490+0000 7fcdfa05e640 1 Processor -- start 2024-04-21T09:29:41.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.490+0000 7fcdfa05e640 1 -- start start 2024-04-21T09:29:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdf406cd50 0x7fcdf40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.495 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcdf406d130 0x7fcdf406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf40c89d0 0x7fcdf40c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf40c0d80 con 0x7fcdf406cd50 2024-04-21T09:29:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fcdf40c8540 con 0x7fcdf406d130 2024-04-21T09:29:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf4158850 con 0x7fcdf40c89d0 2024-04-21T09:29:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdf406cd50 0x7fcdf40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcdf406cd50 0x7fcdf40ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42640/0 (socket says 172.21.15.26:42640) 2024-04-21T09:29:41.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 -- 172.21.15.26:0/561110197 learned_addr learned my addr 172.21.15.26:0/561110197 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf3fff640 1 --2- 172.21.15.26:0/561110197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf40c89d0 0x7fcdf40c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf2ffd640 1 --2- 172.21.15.26:0/561110197 >> v2:172.21.15.169:3300/0 conn(0x7fcdf406d130 0x7fcdf406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 -- 172.21.15.26:0/561110197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf40c89d0 msgr2=0x7fcdf40c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 --2- 172.21.15.26:0/561110197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf40c89d0 0x7fcdf40c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 -- 172.21.15.26:0/561110197 >> v2:172.21.15.169:3300/0 conn(0x7fcdf406d130 msgr2=0x7fcdf406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 --2- 172.21.15.26:0/561110197 >> v2:172.21.15.169:3300/0 conn(0x7fcdf406d130 0x7fcdf406d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 -- 172.21.15.26:0/561110197 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf40c7930 con 0x7fcdf406cd50 2024-04-21T09:29:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf37fe640 1 --2- 172.21.15.26:0/561110197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406cd50 0x7fcdf40ca670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4158b50 tx=0x7fcde401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6c4101e88eefc91 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf27fc640 1 -- 172.21.15.26:0/561110197 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde40b4070 con 0x7fcdf406cd50 2024-04-21T09:29:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf27fc640 1 -- 172.21.15.26:0/561110197 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde40af400 con 0x7fcdf406cd50 2024-04-21T09:29:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdf27fc640 1 -- 172.21.15.26:0/561110197 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde40af7d0 con 0x7fcdf406cd50 2024-04-21T09:29:41.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- 172.21.15.26:0/561110197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406cd50 msgr2=0x7fcdf40ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/561110197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406cd50 0x7fcdf40ca670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4158b50 tx=0x7fcde401f1e0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- 172.21.15.26:0/561110197 shutdown_connections 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/561110197 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf40c89d0 0x7fcdf40c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/561110197 >> v2:172.21.15.169:3300/0 conn(0x7fcdf406d130 0x7fcdf406d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/561110197 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406cd50 0x7fcdf40ca670 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- 172.21.15.26:0/561110197 >> 172.21.15.26:0/561110197 conn(0x7fcdf40c9b50 msgr2=0x7fcdf40c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- 172.21.15.26:0/561110197 shutdown_connections 2024-04-21T09:29:41.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.494+0000 7fcdfa05e640 1 -- 172.21.15.26:0/561110197 wait complete. 2024-04-21T09:29:41.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 Processor -- start 2024-04-21T09:29:41.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 -- start start 2024-04-21T09:29:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf406cd50 0x7fcdf40c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406d130 0x7fcdf4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdf40c89d0 0x7fcdf4154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf40c81d0 con 0x7fcdf406d130 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf40c7ef0 con 0x7fcdf40c89d0 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf4158450 con 0x7fcdf406cd50 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406d130 0x7fcdf4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406d130 0x7fcdf4154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42642/0 (socket says 172.21.15.26:42642) 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 -- 172.21.15.26:0/3607542583 learned_addr learned my addr 172.21.15.26:0/3607542583 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf37fe640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf406cd50 0x7fcdf40c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 -- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf406cd50 msgr2=0x7fcdf40c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf406cd50 0x7fcdf40c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 -- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdf40c89d0 msgr2=0x7fcdf4154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdf40c89d0 0x7fcdf4154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 -- 172.21.15.26:0/3607542583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf41f10c0 con 0x7fcdf406d130 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdf2ffd640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406d130 0x7fcdf4154a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0086b0 tx=0x7fcddc008b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdebfff640 1 -- 172.21.15.26:0/3607542583 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc019070 con 0x7fcdf406d130 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdebfff640 1 -- 172.21.15.26:0/3607542583 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcddc00d8e0 con 0x7fcdf406d130 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf41f0540 con 0x7fcdf406d130 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdebfff640 1 -- 172.21.15.26:0/3607542583 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcddc00dcd0 con 0x7fcdf406d130 2024-04-21T09:29:41.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf41f0b00 con 0x7fcdf406d130 2024-04-21T09:29:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdf4075ef0 con 0x7fcdf406d130 2024-04-21T09:29:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.498+0000 7fcdebfff640 1 -- 172.21.15.26:0/3607542583 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcddc01c070 con 0x7fcdf406d130 2024-04-21T09:29:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.502+0000 7fcdebfff640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdd4068380 0x7fcdd406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.502+0000 7fcdebfff640 1 -- 172.21.15.26:0/3607542583 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fcddc086350 con 0x7fcdf406d130 2024-04-21T09:29:41.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.502+0000 7fcdf37fe640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdd4068380 0x7fcdd406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.502+0000 7fcdf37fe640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdd4068380 0x7fcdd406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcde40b1000 tx=0x7fcde40aa000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.506+0000 7fcdebfff640 1 -- 172.21.15.26:0/3607542583 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcddc0561f0 con 0x7fcdf406d130 2024-04-21T09:29:41.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f053bfab640 1 Processor -- start 2024-04-21T09:29:41.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f053bfab640 1 -- start start 2024-04-21T09:29:41.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f053bfab640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f05340c9a30 0x7f0534159340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f053bfab640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0534071eb0 con 0x7f0534152a40 2024-04-21T09:29:41.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f053bfab640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05340c8090 con 0x7f053406b9e0 2024-04-21T09:29:41.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f053bfab640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f05340c86e0 con 0x7f05340c9a30 2024-04-21T09:29:41.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f0539d47640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0534152a40 0x7f05340c5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54690/0 (socket says 172.21.15.26:54690) 2024-04-21T09:29:41.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.594+0000 7f0539d47640 1 -- 172.21.15.26:0/3742003822 learned_addr learned my addr 172.21.15.26:0/3742003822 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:41.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053a548640 1 --2- 172.21.15.26:0/3742003822 >> v2:172.21.15.169:3300/0 conn(0x7f05340c9a30 0x7f0534159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1107961915 0 0) 0x7f0534071eb0 con 0x7f0534152a40 2024-04-21T09:29:41.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0520003530 con 0x7f0534152a40 2024-04-21T09:29:41.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 178776827 0 0) 0x7f0520003530 con 0x7f0534152a40 2024-04-21T09:29:41.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 >> v2:172.21.15.169:3300/0 conn(0x7f05340c9a30 msgr2=0x7f0534159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 --2- 172.21.15.26:0/3742003822 >> v2:172.21.15.169:3300/0 conn(0x7f05340c9a30 0x7f0534159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 >> v1:172.21.15.169:6789/0 conn(0x7f053406b9e0 legacy=0x7f0534161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05340c8370 con 0x7f0534152a40 2024-04-21T09:29:41.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7f0530001680 con 0x7f0534152a40 2024-04-21T09:29:41.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 >> v1:172.21.15.26:6789/0 conn(0x7f0534152a40 legacy=0x7f05340c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f0520003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0520004810 0x7f0520004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05200051d0 0x7f052000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f05340c86e0 con 0x7f0520003a10 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f052000c0e0 con 0x7f0520004810 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f052000c2e0 con 0x7f05200051d0 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539d47640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f0520003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539546640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0520004810 0x7f0520004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053a548640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05200051d0 0x7f052000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539d47640 1 -- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05200051d0 msgr2=0x7f052000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539d47640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05200051d0 0x7f052000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539d47640 1 -- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0520004810 msgr2=0x7f0520004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539d47640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0520004810 0x7f0520004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539d47640 1 -- 172.21.15.26:0/3742003822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0520003530 con 0x7f0520003a10 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053a548640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05200051d0 0x7f052000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053a548640 1 -- 172.21.15.26:0/3742003822 reap_dead start 2024-04-21T09:29:41.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0539d47640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f0520003e50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f053000c110 tx=0x7f053001f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a3bb738c4194d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530007c30 con 0x7f0520003a10 2024-04-21T09:29:41.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05300ac020 con 0x7f0520003a10 2024-04-21T09:29:41.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f0538d45640 1 -- 172.21.15.26:0/3742003822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05300058e0 con 0x7f0520003a10 2024-04-21T09:29:41.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053bfab640 1 -- 172.21.15.26:0/3742003822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 msgr2=0x7f0520003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053bfab640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f0520003e50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f053000c110 tx=0x7f053001f270 comp rx=0 tx=0).stop 2024-04-21T09:29:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053bfab640 1 -- 172.21.15.26:0/3742003822 shutdown_connections 2024-04-21T09:29:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053bfab640 1 --2- 172.21.15.26:0/3742003822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f0520003e50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053bfab640 1 -- 172.21.15.26:0/3742003822 >> 172.21.15.26:0/3742003822 conn(0x7f05340cd520 msgr2=0x7f05340c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053bfab640 1 -- 172.21.15.26:0/3742003822 shutdown_connections 2024-04-21T09:29:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.598+0000 7f053bfab640 1 -- 172.21.15.26:0/3742003822 wait complete. 2024-04-21T09:29:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 Processor -- start 2024-04-21T09:29:41.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 -- start start 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f05341f28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0534151020 0x7f05341de9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0534151460 0x7f0534153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0534152fa0 con 0x7f0520003a10 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f0534152e20 con 0x7f0534151020 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f0534073850 con 0x7f0534151460 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f05341f28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f05341f28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42670/0 (socket says 172.21.15.26:42670) 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 -- 172.21.15.26:0/618729795 learned_addr learned my addr 172.21.15.26:0/618729795 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539546640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0534151020 0x7f05341de9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053a548640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0534151460 0x7f0534153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 -- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0534151460 msgr2=0x7f0534153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0534151460 0x7f0534153610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 -- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0534151020 msgr2=0x7f05341de9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0534151020 0x7f05341de9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 -- 172.21.15.26:0/618729795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05341ee960 con 0x7f0520003a10 2024-04-21T09:29:41.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053a548640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0534151460 0x7f0534153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f0539d47640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f05341f28d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f05300ae040 tx=0x7f0520005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f052a7fc640 1 -- 172.21.15.26:0/618729795 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05300049f0 con 0x7f0520003a10 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f052a7fc640 1 -- 172.21.15.26:0/618729795 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05300b5070 con 0x7f0520003a10 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05341eec40 con 0x7f0520003a10 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f052a7fc640 1 -- 172.21.15.26:0/618729795 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530004dd0 con 0x7f0520003a10 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05341ef200 con 0x7f0520003a10 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.602+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0534074320 con 0x7f0520003a10 2024-04-21T09:29:41.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.606+0000 7f052a7fc640 1 -- 172.21.15.26:0/618729795 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f05300b1430 con 0x7f0520003a10 2024-04-21T09:29:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.606+0000 7f052a7fc640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f05180683b0 0x7f051806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.606+0000 7f052a7fc640 1 -- 172.21.15.26:0/618729795 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f0530123680 con 0x7f0520003a10 2024-04-21T09:29:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.606+0000 7f0539546640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f05180683b0 0x7f051806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.606+0000 7f0539546640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f05180683b0 0x7f051806a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0534158550 tx=0x7f0524009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.610+0000 7f052a7fc640 1 -- 172.21.15.26:0/618729795 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0530018f80 con 0x7f0520003a10 2024-04-21T09:29:41.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.730+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcdf414e4e0 con 0x7fcdf406d130 2024-04-21T09:29:41.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdebfff640 1 -- 172.21.15.26:0/3607542583 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16716 (secure 0 0 0) 0x7fcddc05a4f0 con 0x7fcdf406d130 2024-04-21T09:29:41.735 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:41.736 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":67,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T09:28:51.732460+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":765,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":750,"length":16}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T09:29:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdd4068380 msgr2=0x7fcdd406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdd4068380 0x7fcdd406a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcde40b1000 tx=0x7fcde40aa000 comp rx=0 tx=0).stop 2024-04-21T09:29:41.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406d130 msgr2=0x7fcdf4154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406d130 0x7fcdf4154a80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fcddc0086b0 tx=0x7fcddc008b70 comp rx=0 tx=0).stop 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 shutdown_connections 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdf40c89d0 0x7fcdf4154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fcdd4068380 0x7fcdd406a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcdf406d130 0x7fcdf4154a80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 --2- 172.21.15.26:0/3607542583 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdf406cd50 0x7fcdf40c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 >> 172.21.15.26:0/3607542583 conn(0x7fcdf40c9b50 msgr2=0x7fcdf406dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 shutdown_connections 2024-04-21T09:29:41.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.734+0000 7fcdfa05e640 1 -- 172.21.15.26:0/3607542583 wait complete. 2024-04-21T09:29:41.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 765, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T09:29:41.760 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T09:29:41.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f05340ca980 con 0x7f0520003a10 2024-04-21T09:29:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f052a7fc640 1 -- 172.21.15.26:0/618729795 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7f05300f3b70 con 0x7f0520003a10 2024-04-21T09:29:41.808 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-21T09:29:41.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f05180683b0 msgr2=0x7f051806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f05180683b0 0x7f051806a870 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0534158550 tx=0x7f0524009040 comp rx=0 tx=0).stop 2024-04-21T09:29:41.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 msgr2=0x7f05341f28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f05341f28d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f05300ae040 tx=0x7f0520005840 comp rx=0 tx=0).stop 2024-04-21T09:29:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 shutdown_connections 2024-04-21T09:29:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0534151460 0x7f0534153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0534151020 0x7f05341de9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f05180683b0 0x7f051806a870 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 --2- 172.21.15.26:0/618729795 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0520003a10 0x7f05341f28d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 >> 172.21.15.26:0/618729795 conn(0x7f05340cd520 msgr2=0x7f05340cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 shutdown_connections 2024-04-21T09:29:41.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.806+0000 7f053bfab640 1 -- 172.21.15.26:0/618729795 wait complete. 2024-04-21T09:29:41.828 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T09:29:41.828 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T09:29:41.879 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T09:29:41.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd542cd640 1 Processor -- start 2024-04-21T09:29:41.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd542cd640 1 -- start start 2024-04-21T09:29:41.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd542cd640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdd4c0c4510 0x7fdd4c158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd542cd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd4c0c71d0 0x7fdd4c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd542cd640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c0c6f90 con 0x7fdd4c158810 2024-04-21T09:29:41.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd542cd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c0c9980 con 0x7fdd4c0c71d0 2024-04-21T09:29:41.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd542cd640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c0c6cb0 con 0x7fdd4c0c4510 2024-04-21T09:29:41.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd5286a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd4c0c71d0 0x7fdd4c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.923 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd5286a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdd4c0c71d0 0x7fdd4c0c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42682/0 (socket says 172.21.15.26:42682) 2024-04-21T09:29:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.918+0000 7fdd5286a640 1 -- 172.21.15.26:0/470713437 learned_addr learned my addr 172.21.15.26:0/470713437 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd51868640 1 --2- 172.21.15.26:0/470713437 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c0c4510 0x7fdd4c158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd5286a640 1 -- 172.21.15.26:0/470713437 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c0c4510 msgr2=0x7fdd4c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd5286a640 1 --2- 172.21.15.26:0/470713437 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c0c4510 0x7fdd4c158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd5286a640 1 -- 172.21.15.26:0/470713437 >> v1:172.21.15.169:6789/0 conn(0x7fdd4c158810 legacy=0x7fdd4c0c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:41.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd5286a640 1 -- 172.21.15.26:0/470713437 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c0c83c0 con 0x7fdd4c0c71d0 2024-04-21T09:29:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd5286a640 1 --2- 172.21.15.26:0/470713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c0c71d0 0x7fdd4c0c8ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c050e50 tx=0x7fdd4401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f189d3d359403f88 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd51067640 1 -- 172.21.15.26:0/470713437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440a5760 con 0x7fdd4c0c71d0 2024-04-21T09:29:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd51067640 1 -- 172.21.15.26:0/470713437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd440a5900 con 0x7fdd4c0c71d0 2024-04-21T09:29:41.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd51067640 1 -- 172.21.15.26:0/470713437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440a5cd0 con 0x7fdd4c0c71d0 2024-04-21T09:29:41.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 -- 172.21.15.26:0/470713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c0c71d0 msgr2=0x7fdd4c0c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 --2- 172.21.15.26:0/470713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c0c71d0 0x7fdd4c0c8ea0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c050e50 tx=0x7fdd4401c9b0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 -- 172.21.15.26:0/470713437 shutdown_connections 2024-04-21T09:29:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 --2- 172.21.15.26:0/470713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c0c71d0 0x7fdd4c0c8ea0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 --2- 172.21.15.26:0/470713437 >> v2:172.21.15.169:3300/0 conn(0x7fdd4c0c4510 0x7fdd4c158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 -- 172.21.15.26:0/470713437 >> 172.21.15.26:0/470713437 conn(0x7fdd4c0725c0 msgr2=0x7fdd4c0729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 -- 172.21.15.26:0/470713437 shutdown_connections 2024-04-21T09:29:41.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.922+0000 7fdd542cd640 1 -- 172.21.15.26:0/470713437 wait complete. 2024-04-21T09:29:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 Processor -- start 2024-04-21T09:29:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 -- start start 2024-04-21T09:29:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c0c4510 0x7fdd4c151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0c71d0 0x7fdd4c1f6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c158810 0x7fdd4c1f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c06cdc0 con 0x7fdd4c158810 2024-04-21T09:29:41.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c06cc40 con 0x7fdd4c0c4510 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c0c9560 con 0x7fdd4c0c71d0 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c158810 0x7fdd4c1f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c158810 0x7fdd4c1f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42698/0 (socket says 172.21.15.26:42698) 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 -- 172.21.15.26:0/1486669747 learned_addr learned my addr 172.21.15.26:0/1486669747 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd52069640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c0c4510 0x7fdd4c151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd51868640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0c71d0 0x7fdd4c1f6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 -- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0c71d0 msgr2=0x7fdd4c1f6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0c71d0 0x7fdd4c1f6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 -- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c0c4510 msgr2=0x7fdd4c151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c0c4510 0x7fdd4c151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 -- 172.21.15.26:0/1486669747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c0c3d80 con 0x7fdd4c158810 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd52069640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c0c4510 0x7fdd4c151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd5286a640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c158810 0x7fdd4c1f6dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdd4401a5e0 tx=0x7fdd44019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd42ffd640 1 -- 172.21.15.26:0/1486669747 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440bc020 con 0x7fdd4c158810 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd42ffd640 1 -- 172.21.15.26:0/1486669747 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd440b86b0 con 0x7fdd4c158810 2024-04-21T09:29:41.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd42ffd640 1 -- 172.21.15.26:0/1486669747 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd440b8aa0 con 0x7fdd4c158810 2024-04-21T09:29:41.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c0c4040 con 0x7fdd4c158810 2024-04-21T09:29:41.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c1f4120 con 0x7fdd4c158810 2024-04-21T09:29:41.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.926+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c074320 con 0x7fdd4c158810 2024-04-21T09:29:41.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.930+0000 7fdd42ffd640 1 -- 172.21.15.26:0/1486669747 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdd440bf020 con 0x7fdd4c158810 2024-04-21T09:29:41.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.930+0000 7fdd42ffd640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdd30068380 0x7fdd3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:41.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.930+0000 7fdd42ffd640 1 -- 172.21.15.26:0/1486669747 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fdd441226f0 con 0x7fdd4c158810 2024-04-21T09:29:41.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.930+0000 7fdd52069640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdd30068380 0x7fdd3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:41.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.930+0000 7fdd52069640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdd30068380 0x7fdd3006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098b0 tx=0x7fdd48008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:41.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:41.934+0000 7fdd42ffd640 1 -- 172.21.15.26:0/1486669747 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdd440165a0 con 0x7fdd4c158810 2024-04-21T09:29:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.034+0000 7f4b953ec640 1 Processor -- start 2024-04-21T09:29:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.034+0000 7f4b953ec640 1 -- start start 2024-04-21T09:29:42.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b953ec640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4b900c6e00 0x7f4b9006f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b953ec640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b900c4510 0x7f4b901583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b953ec640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b90070f50 con 0x7f4b900c71e0 2024-04-21T09:29:42.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b953ec640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f4b900c84f0 con 0x7f4b900c4510 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b953ec640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f4b900c6160 con 0x7f4b900c6e00 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f4b900c4510 0x7f4b901583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8e7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b900c71e0 0x7f4b900c7de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54700/0 (socket says 172.21.15.26:54700) 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8e7fc640 1 -- 172.21.15.26:0/2213831541 learned_addr learned my addr 172.21.15.26:0/2213831541 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8effd640 1 --2- 172.21.15.26:0/2213831541 >> v2:172.21.15.169:3300/0 conn(0x7f4b900c6e00 0x7f4b9006f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8f7fe640 1 -- 172.21.15.26:0/2213831541 >> v2:172.21.15.169:3300/0 conn(0x7f4b900c6e00 msgr2=0x7f4b9006f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/2213831541 >> v2:172.21.15.169:3300/0 conn(0x7f4b900c6e00 0x7f4b9006f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8f7fe640 1 -- 172.21.15.26:0/2213831541 >> v1:172.21.15.26:6789/0 conn(0x7f4b900c71e0 legacy=0x7f4b900c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8dffb640 1 -- 172.21.15.26:0/2213831541 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163925412 0 0) 0x7f4b90070f50 con 0x7f4b900c71e0 2024-04-21T09:29:42.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.038+0000 7f4b8f7fe640 1 -- 172.21.15.26:0/2213831541 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9006f900 con 0x7f4b900c4510 2024-04-21T09:29:42.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/2213831541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c4510 0x7f4b901583c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4b90074040 tx=0x7f4b8801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956bfd0773b45f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b8dffb640 1 -- 172.21.15.26:0/2213831541 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880b4070 con 0x7f4b900c4510 2024-04-21T09:29:42.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b8dffb640 1 -- 172.21.15.26:0/2213831541 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b880af600 con 0x7f4b900c4510 2024-04-21T09:29:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b8dffb640 1 -- 172.21.15.26:0/2213831541 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880af9d0 con 0x7f4b900c4510 2024-04-21T09:29:42.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- 172.21.15.26:0/2213831541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c4510 msgr2=0x7f4b901583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 --2- 172.21.15.26:0/2213831541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c4510 0x7f4b901583c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f4b90074040 tx=0x7f4b8801f110 comp rx=0 tx=0).stop 2024-04-21T09:29:42.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- 172.21.15.26:0/2213831541 shutdown_connections 2024-04-21T09:29:42.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 --2- 172.21.15.26:0/2213831541 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c4510 0x7f4b901583c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 --2- 172.21.15.26:0/2213831541 >> v2:172.21.15.169:3300/0 conn(0x7f4b900c6e00 0x7f4b9006f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- 172.21.15.26:0/2213831541 >> 172.21.15.26:0/2213831541 conn(0x7f4b9006e730 msgr2=0x7f4b9006eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- 172.21.15.26:0/2213831541 shutdown_connections 2024-04-21T09:29:42.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- 172.21.15.26:0/2213831541 wait complete. 2024-04-21T09:29:42.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 Processor -- start 2024-04-21T09:29:42.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- start start 2024-04-21T09:29:42.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b900c4510 0x7f4b900c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900c6e00 0x7f4b90147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c71e0 0x7f4b90153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9006e160 con 0x7f4b900c71e0 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9006de80 con 0x7f4b900c4510 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.042+0000 7f4b953ec640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f4b900c5dd0 con 0x7f4b900c6e00 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c71e0 0x7f4b90153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c71e0 0x7f4b90153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42708/0 (socket says 172.21.15.26:42708) 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 -- 172.21.15.26:0/3245220102 learned_addr learned my addr 172.21.15.26:0/3245220102 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8e7fc640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900c6e00 0x7f4b90147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8effd640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b900c4510 0x7f4b900c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 -- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900c6e00 msgr2=0x7f4b90147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900c6e00 0x7f4b90147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 -- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b900c4510 msgr2=0x7f4b900c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b900c4510 0x7f4b900c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 -- 172.21.15.26:0/3245220102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b901f0f40 con 0x7f4b900c71e0 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8effd640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b900c4510 0x7f4b900c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b8f7fe640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c71e0 0x7f4b90153ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009d60 tx=0x7f4b8801beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b777fe640 1 -- 172.21.15.26:0/3245220102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b880b4040 con 0x7f4b900c71e0 2024-04-21T09:29:42.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b777fe640 1 -- 172.21.15.26:0/3245220102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b880c1070 con 0x7f4b900c71e0 2024-04-21T09:29:42.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b777fe640 1 -- 172.21.15.26:0/3245220102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b88009450 con 0x7f4b900c71e0 2024-04-21T09:29:42.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b90157110 con 0x7f4b900c71e0 2024-04-21T09:29:42.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b901f11e0 con 0x7f4b900c71e0 2024-04-21T09:29:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b90075ef0 con 0x7f4b900c71e0 2024-04-21T09:29:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b777fe640 1 -- 172.21.15.26:0/3245220102 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4b880ba690 con 0x7f4b900c71e0 2024-04-21T09:29:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b777fe640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4b7c068380 0x7f4b7c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.046+0000 7f4b777fe640 1 -- 172.21.15.26:0/3245220102 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f4b88125380 con 0x7f4b900c71e0 2024-04-21T09:29:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.050+0000 7f4b8effd640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4b7c068380 0x7f4b7c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.050+0000 7f4b8effd640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4b7c068380 0x7f4b7c06a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b80007a70 tx=0x7f4b80008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.054+0000 7f4b777fe640 1 -- 172.21.15.26:0/3245220102 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4b88018c70 con 0x7f4b900c71e0 2024-04-21T09:29:42.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.110+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdd4c0b29b0 con 0x7fdd4c158810 2024-04-21T09:29:42.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.110+0000 7fdd42ffd640 1 -- 172.21.15.26:0/1486669747 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7fdd440f2e00 con 0x7fdd4c158810 2024-04-21T09:29:42.112 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T09:29:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.110+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdd30068380 msgr2=0x7fdd3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.110+0000 7fdd542cd640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdd30068380 0x7fdd3006a840 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098b0 tx=0x7fdd48008040 comp rx=0 tx=0).stop 2024-04-21T09:29:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.110+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c158810 msgr2=0x7fdd4c1f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.110+0000 7fdd542cd640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c158810 0x7fdd4c1f6dd0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fdd4401a5e0 tx=0x7fdd44019750 comp rx=0 tx=0).stop 2024-04-21T09:29:42.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 shutdown_connections 2024-04-21T09:29:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fdd30068380 0x7fdd3006a840 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdd4c158810 0x7fdd4c1f6dd0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdd4c0c71d0 0x7fdd4c1f6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 --2- 172.21.15.26:0/1486669747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdd4c0c4510 0x7fdd4c151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 >> 172.21.15.26:0/1486669747 conn(0x7fdd4c0725c0 msgr2=0x7fdd4c1525e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 shutdown_connections 2024-04-21T09:29:42.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.114+0000 7fdd542cd640 1 -- 172.21.15.26:0/1486669747 wait complete. 2024-04-21T09:29:42.131 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T09:29:42.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.222+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b90156ba0 con 0x7f4b900c71e0 2024-04-21T09:29:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.222+0000 7f4b777fe640 1 -- 172.21.15.26:0/3245220102 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16716 (secure 0 0 0) 0x7f4b880f5860 con 0x7f4b900c71e0 2024-04-21T09:29:42.226 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:42.226 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":67,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T09:28:51.732460+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":765,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":750,"length":16}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T09:29:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4b7c068380 msgr2=0x7f4b7c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4b7c068380 0x7f4b7c06a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4b80007a70 tx=0x7f4b80008040 comp rx=0 tx=0).stop 2024-04-21T09:29:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c71e0 msgr2=0x7f4b90153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c71e0 0x7f4b90153ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f4b88009d60 tx=0x7f4b8801beb0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 shutdown_connections 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f4b7c068380 0x7f4b7c06a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b900c71e0 0x7f4b90153ea0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b900c6e00 0x7f4b90147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 --2- 172.21.15.26:0/3245220102 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b900c4510 0x7f4b900c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 >> 172.21.15.26:0/3245220102 conn(0x7f4b9006e730 msgr2=0x7f4b9006b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 shutdown_connections 2024-04-21T09:29:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.226+0000 7f4b953ec640 1 -- 172.21.15.26:0/3245220102 wait complete. 2024-04-21T09:29:42.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 765, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T09:29:42.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T09:29:42.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fac91f640 1 Processor -- start 2024-04-21T09:29:42.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fac91f640 1 -- start start 2024-04-21T09:29:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fac91f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa80b0d50 0x7f7fa806caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fac91f640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7fa815e180 0x7f7fa80ce5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fac91f640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fa8070af0 con 0x7f7fa8158310 2024-04-21T09:29:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fac91f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa81586f0 con 0x7f7fa80b0d50 2024-04-21T09:29:42.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fac91f640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f7fa806d110 con 0x7f7fa815e180 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa80b0d50 0x7f7fa806caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7fa80b0d50 0x7f7fa806caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42714/0 (socket says 172.21.15.26:42714) 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/3531921036 learned_addr learned my addr 172.21.15.26:0/3531921036 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/3531921036 >> v2:172.21.15.169:3300/0 conn(0x7f7fa815e180 msgr2=0x7f7fa80ce5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa6d9d640 1 --2- 172.21.15.26:0/3531921036 >> v2:172.21.15.169:3300/0 conn(0x7f7fa815e180 0x7f7fa80ce5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 --2- 172.21.15.26:0/3531921036 >> v2:172.21.15.169:3300/0 conn(0x7f7fa815e180 0x7f7fa80ce5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/3531921036 >> v1:172.21.15.169:6789/0 conn(0x7f7fa8158310 legacy=0x7f7fa806fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/3531921036 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa80c9290 con 0x7f7fa80b0d50 2024-04-21T09:29:42.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa5d9b640 1 --2- 172.21.15.26:0/3531921036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa80b0d50 0x7f7fa806caf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80c9fe0 tx=0x7f7f9c01eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d235687817fbfcd server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa559a640 1 -- 172.21.15.26:0/3531921036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0b5070 con 0x7f7fa80b0d50 2024-04-21T09:29:42.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa559a640 1 -- 172.21.15.26:0/3531921036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0a87f0 con 0x7f7fa80b0d50 2024-04-21T09:29:42.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.298+0000 7f7fa559a640 1 -- 172.21.15.26:0/3531921036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0a8bc0 con 0x7f7fa80b0d50 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- 172.21.15.26:0/3531921036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa80b0d50 msgr2=0x7f7fa806caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 --2- 172.21.15.26:0/3531921036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa80b0d50 0x7f7fa806caf0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f7fa80c9fe0 tx=0x7f7f9c01eaf0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- 172.21.15.26:0/3531921036 shutdown_connections 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 --2- 172.21.15.26:0/3531921036 >> v2:172.21.15.169:3300/0 conn(0x7f7fa815e180 0x7f7fa80ce5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 --2- 172.21.15.26:0/3531921036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa80b0d50 0x7f7fa806caf0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- 172.21.15.26:0/3531921036 >> 172.21.15.26:0/3531921036 conn(0x7f7fa8067760 msgr2=0x7f7fa8067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- 172.21.15.26:0/3531921036 shutdown_connections 2024-04-21T09:29:42.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- 172.21.15.26:0/3531921036 wait complete. 2024-04-21T09:29:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 Processor -- start 2024-04-21T09:29:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- start start 2024-04-21T09:29:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa80b0d50 0x7f7fa81f1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa8158310 0x7f7fa81549b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa815e180 0x7f7fa81591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa80c9b30 con 0x7f7fa8158310 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa80c9850 con 0x7f7fa815e180 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f7fa80ce0d0 con 0x7f7fa80b0d50 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa8158310 0x7f7fa81549b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa8158310 0x7f7fa81549b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42730/0 (socket says 172.21.15.26:42730) 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/2233631495 learned_addr learned my addr 172.21.15.26:0/2233631495 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa80b0d50 msgr2=0x7f7fa81f1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa659c640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa80b0d50 0x7f7fa81f1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa6d9d640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa815e180 0x7f7fa81591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa80b0d50 0x7f7fa81f1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa815e180 msgr2=0x7f7fa81591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa815e180 0x7f7fa81591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 -- 172.21.15.26:0/2233631495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa8150050 con 0x7f7fa8158310 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fa5d9b640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa8158310 0x7f7fa81549b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0b3040 tx=0x7f7f9c01b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7f96ffd640 1 -- 172.21.15.26:0/2233631495 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0c0070 con 0x7f7fa8158310 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7f96ffd640 1 -- 172.21.15.26:0/2233631495 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f9c0b09f0 con 0x7f7fa8158310 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa815c140 con 0x7f7fa8158310 2024-04-21T09:29:42.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7f96ffd640 1 -- 172.21.15.26:0/2233631495 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0b5070 con 0x7f7fa8158310 2024-04-21T09:29:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.302+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa8151dc0 con 0x7f7fa8158310 2024-04-21T09:29:42.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.306+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa8074320 con 0x7f7fa8158310 2024-04-21T09:29:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.306+0000 7f7f96ffd640 1 -- 172.21.15.26:0/2233631495 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f9c0c3070 con 0x7f7fa8158310 2024-04-21T09:29:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.306+0000 7f7f96ffd640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7f88068380 0x7f7f8806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.306+0000 7f7f96ffd640 1 -- 172.21.15.26:0/2233631495 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f7f9c123ae0 con 0x7f7fa8158310 2024-04-21T09:29:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.306+0000 7f7fa659c640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7f88068380 0x7f7f8806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.306+0000 7f7fa659c640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7f88068380 0x7f7f8806a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7f98003d90 tx=0x7f7f98009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.314+0000 7f7f96ffd640 1 -- 172.21.15.26:0/2233631495 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7fa8070af0 con 0x7f7fa8158310 2024-04-21T09:29:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 Processor -- start 2024-04-21T09:29:42.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 -- start start 2024-04-21T09:29:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38152bf0 0x7fac38159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac38070870 0x7fac381594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fac380c8bc0 0x7fac380ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fac380c5250 con 0x7fac38070870 2024-04-21T09:29:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fac380c38e0 con 0x7fac380c8bc0 2024-04-21T09:29:42.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac3d822640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac380703e0 con 0x7fac38152bf0 2024-04-21T09:29:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.354+0000 7fac2ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac38070870 0x7fac381594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fac38070870 0x7fac381594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42732/0 (socket says 172.21.15.26:42732) 2024-04-21T09:29:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 -- 172.21.15.26:0/2093623221 learned_addr learned my addr 172.21.15.26:0/2093623221 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac36ffd640 1 --2- 172.21.15.26:0/2093623221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38152bf0 0x7fac38159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac377fe640 1 --2- 172.21.15.26:0/2093623221 >> v2:172.21.15.169:3300/0 conn(0x7fac380c8bc0 0x7fac380ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 -- 172.21.15.26:0/2093623221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38152bf0 msgr2=0x7fac38159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 --2- 172.21.15.26:0/2093623221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38152bf0 0x7fac38159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 -- 172.21.15.26:0/2093623221 >> v2:172.21.15.169:3300/0 conn(0x7fac380c8bc0 msgr2=0x7fac380ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 --2- 172.21.15.26:0/2093623221 >> v2:172.21.15.169:3300/0 conn(0x7fac380c8bc0 0x7fac380ce150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 -- 172.21.15.26:0/2093623221 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac38070c90 con 0x7fac38070870 2024-04-21T09:29:42.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac2ffff640 1 --2- 172.21.15.26:0/2093623221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38070870 0x7fac381594e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fac380cbd60 tx=0x7fac2001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8403318dcb4a0e5b server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac367fc640 1 -- 172.21.15.26:0/2093623221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac200b0070 con 0x7fac38070870 2024-04-21T09:29:42.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac367fc640 1 -- 172.21.15.26:0/2093623221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac200ab600 con 0x7fac38070870 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac367fc640 1 -- 172.21.15.26:0/2093623221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac200ab9d0 con 0x7fac38070870 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 -- 172.21.15.26:0/2093623221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38070870 msgr2=0x7fac381594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 --2- 172.21.15.26:0/2093623221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38070870 0x7fac381594e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fac380cbd60 tx=0x7fac2001c520 comp rx=0 tx=0).stop 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 -- 172.21.15.26:0/2093623221 shutdown_connections 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 --2- 172.21.15.26:0/2093623221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38070870 0x7fac381594e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 --2- 172.21.15.26:0/2093623221 >> v2:172.21.15.169:3300/0 conn(0x7fac380c8bc0 0x7fac380ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 --2- 172.21.15.26:0/2093623221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38152bf0 0x7fac38159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 -- 172.21.15.26:0/2093623221 >> 172.21.15.26:0/2093623221 conn(0x7fac38067760 msgr2=0x7fac38067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 -- 172.21.15.26:0/2093623221 shutdown_connections 2024-04-21T09:29:42.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.358+0000 7fac3d822640 1 -- 172.21.15.26:0/2093623221 wait complete. 2024-04-21T09:29:42.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 Processor -- start 2024-04-21T09:29:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 -- start start 2024-04-21T09:29:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38070870 0x7fac381415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac380c8bc0 0x7fac38141b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38152bf0 0x7fac380c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fac380c8fd0 con 0x7fac38152bf0 2024-04-21T09:29:42.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fac38070070 con 0x7fac380c8bc0 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fac380c9150 con 0x7fac38070870 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38152bf0 0x7fac380c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38152bf0 0x7fac380c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42740/0 (socket says 172.21.15.26:42740) 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 -- 172.21.15.26:0/1661503419 learned_addr learned my addr 172.21.15.26:0/1661503419 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac2ffff640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac380c8bc0 0x7fac38141b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac36ffd640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38070870 0x7fac381415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 -- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38070870 msgr2=0x7fac381415c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38070870 0x7fac381415c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 -- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac380c8bc0 msgr2=0x7fac38141b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac380c8bc0 0x7fac38141b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 -- 172.21.15.26:0/1661503419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac38067d50 con 0x7fac38152bf0 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac377fe640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38152bf0 0x7fac380c9590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fac3000cd70 tx=0x7fac3000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac34ff9640 1 -- 172.21.15.26:0/1661503419 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30003ba0 con 0x7fac38152bf0 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac34ff9640 1 -- 172.21.15.26:0/1661503419 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac30003d40 con 0x7fac38152bf0 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac381f3680 con 0x7fac38152bf0 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac34ff9640 1 -- 172.21.15.26:0/1661503419 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac30004240 con 0x7fac38152bf0 2024-04-21T09:29:42.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac38142040 con 0x7fac38152bf0 2024-04-21T09:29:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac380b0190 con 0x7fac38152bf0 2024-04-21T09:29:42.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.362+0000 7fac34ff9640 1 -- 172.21.15.26:0/1661503419 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fac300043e0 con 0x7fac38152bf0 2024-04-21T09:29:42.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.366+0000 7fac34ff9640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fac18068380 0x7fac1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.366+0000 7fac34ff9640 1 -- 172.21.15.26:0/1661503419 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fac300874b0 con 0x7fac38152bf0 2024-04-21T09:29:42.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.366+0000 7fac36ffd640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fac18068380 0x7fac1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.366+0000 7fac36ffd640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fac18068380 0x7fac1806a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac2800b950 tx=0x7fac28008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.374+0000 7fac34ff9640 1 -- 172.21.15.26:0/1661503419 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fac380b0190 con 0x7fac38152bf0 2024-04-21T09:29:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.482+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7fa80cab40 con 0x7f7fa8158310 2024-04-21T09:29:42.484 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.482+0000 7f7f96ffd640 1 -- 172.21.15.26:0/2233631495 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) ==== 104+0+11 (secure 0 0 0) 0x7f7f9c0f4140 con 0x7f7fa8158310 2024-04-21T09:29:42.485 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T09:29:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7f88068380 msgr2=0x7f7f8806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7f88068380 0x7f7f8806a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7f98003d90 tx=0x7f7f98009040 comp rx=0 tx=0).stop 2024-04-21T09:29:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa8158310 msgr2=0x7f7fa81549b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa8158310 0x7f7fa81549b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0b3040 tx=0x7f7f9c01b890 comp rx=0 tx=0).stop 2024-04-21T09:29:42.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 shutdown_connections 2024-04-21T09:29:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7fa815e180 0x7f7fa81591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f7f88068380 0x7f7f8806a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7fa8158310 0x7f7fa81549b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 --2- 172.21.15.26:0/2233631495 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7fa80b0d50 0x7f7fa81f1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 >> 172.21.15.26:0/2233631495 conn(0x7f7fa8067760 msgr2=0x7f7fa806fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 shutdown_connections 2024-04-21T09:29:42.488 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.486+0000 7f7fac91f640 1 -- 172.21.15.26:0/2233631495 wait complete. 2024-04-21T09:29:42.503 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T09:29:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fac38074320 con 0x7fac38152bf0 2024-04-21T09:29:42.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac34ff9640 1 -- 172.21.15.26:0/1661503419 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7fac3001d340 con 0x7fac38152bf0 2024-04-21T09:29:42.540 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T09:29:42.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fac18068380 msgr2=0x7fac1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fac18068380 0x7fac1806a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fac2800b950 tx=0x7fac28008040 comp rx=0 tx=0).stop 2024-04-21T09:29:42.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38152bf0 msgr2=0x7fac380c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38152bf0 0x7fac380c9590 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fac3000cd70 tx=0x7fac3000a660 comp rx=0 tx=0).stop 2024-04-21T09:29:42.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 shutdown_connections 2024-04-21T09:29:42.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fac18068380 0x7fac1806a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fac38152bf0 0x7fac380c9590 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac380c8bc0 0x7fac38141b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 --2- 172.21.15.26:0/1661503419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac38070870 0x7fac381415c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 >> 172.21.15.26:0/1661503419 conn(0x7fac38067760 msgr2=0x7fac380cd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 shutdown_connections 2024-04-21T09:29:42.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.538+0000 7fac3d822640 1 -- 172.21.15.26:0/1661503419 wait complete. 2024-04-21T09:29:42.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T09:29:42.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e95c7640 1 Processor -- start 2024-04-21T09:29:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e95c7640 1 -- start start 2024-04-21T09:29:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e95c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e415b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e95c7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42e40cc8d0 0x7f42e40d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e95c7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42e415e260 con 0x7f42e40cb340 2024-04-21T09:29:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e95c7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f42e415e540 con 0x7f42e40cc8d0 2024-04-21T09:29:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e95c7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42e415e820 con 0x7f42e4154e70 2024-04-21T09:29:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42dbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f42e40cc8d0 0x7f42e40d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f42e40cb340 0x7f42e40c8990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54712/0 (socket says 172.21.15.26:54712) 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e37fe640 1 -- 172.21.15.26:0/1690384927 learned_addr learned my addr 172.21.15.26:0/1690384927 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e2ffd640 1 --2- 172.21.15.26:0/1690384927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e415b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42dbfff640 1 -- 172.21.15.26:0/1690384927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 msgr2=0x7f42e415b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42dbfff640 1 --2- 172.21.15.26:0/1690384927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e415b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42dbfff640 1 -- 172.21.15.26:0/1690384927 >> v1:172.21.15.26:6789/0 conn(0x7f42e40cb340 legacy=0x7f42e40c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42dbfff640 1 -- 172.21.15.26:0/1690384927 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e415eb00 con 0x7f42e40cc8d0 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e27fc640 1 -- 172.21.15.26:0/1690384927 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608556439 0 0) 0x7f42e415e260 con 0x7f42e40cb340 2024-04-21T09:29:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e2ffd640 1 --2- 172.21.15.26:0/1690384927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42dbfff640 1 --2- 172.21.15.26:0/1690384927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cc8d0 0x7f42e40d0350 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0097c0 tx=0x7f42cc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436c8299043356fc server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e27fc640 1 -- 172.21.15.26:0/1690384927 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0b0070 con 0x7f42e40cc8d0 2024-04-21T09:29:42.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e27fc640 1 -- 172.21.15.26:0/1690384927 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc0ab600 con 0x7f42e40cc8d0 2024-04-21T09:29:42.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.618+0000 7f42e27fc640 1 -- 172.21.15.26:0/1690384927 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0ab9d0 con 0x7f42e40cc8d0 2024-04-21T09:29:42.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- 172.21.15.26:0/1690384927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cc8d0 msgr2=0x7f42e40d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 --2- 172.21.15.26:0/1690384927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cc8d0 0x7f42e40d0350 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0097c0 tx=0x7f42cc01c4a0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- 172.21.15.26:0/1690384927 shutdown_connections 2024-04-21T09:29:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 --2- 172.21.15.26:0/1690384927 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cc8d0 0x7f42e40d0350 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 --2- 172.21.15.26:0/1690384927 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e415b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- 172.21.15.26:0/1690384927 >> 172.21.15.26:0/1690384927 conn(0x7f42e406de70 msgr2=0x7f42e406e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- 172.21.15.26:0/1690384927 shutdown_connections 2024-04-21T09:29:42.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- 172.21.15.26:0/1690384927 wait complete. 2024-04-21T09:29:42.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 Processor -- start 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- start start 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cb340 0x7f42e414da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42e40cc8d0 0x7f42e41599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e4157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4168100 con 0x7f42e40cb340 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f42e4167f80 con 0x7f42e40cc8d0 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f42e4168280 con 0x7f42e4154e70 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cb340 0x7f42e414da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cb340 0x7f42e414da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42754/0 (socket says 172.21.15.26:42754) 2024-04-21T09:29:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 -- 172.21.15.26:0/140408690 learned_addr learned my addr 172.21.15.26:0/140408690 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42dbfff640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42e40cc8d0 0x7f42e41599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 -- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 msgr2=0x7f42e4157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e37fe640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e4157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e4157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 -- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42e40cc8d0 msgr2=0x7f42e41599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42e40cc8d0 0x7f42e41599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 -- 172.21.15.26:0/140408690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42e414cb40 con 0x7f42e40cb340 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42dbfff640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42e40cc8d0 0x7f42e41599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e37fe640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e2ffd640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cb340 0x7f42e414da70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e840 tx=0x7f42d400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42db7fe640 1 -- 172.21.15.26:0/140408690 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d4017070 con 0x7f42e40cb340 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42db7fe640 1 -- 172.21.15.26:0/140408690 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42d400c8d0 con 0x7f42e40cb340 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42e414e4d0 con 0x7f42e40cb340 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42db7fe640 1 -- 172.21.15.26:0/140408690 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d400f040 con 0x7f42e40cb340 2024-04-21T09:29:42.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.622+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42e414ea90 con 0x7f42e40cb340 2024-04-21T09:29:42.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.626+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42e4074320 con 0x7f42e40cb340 2024-04-21T09:29:42.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.626+0000 7f42db7fe640 1 -- 172.21.15.26:0/140408690 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f42d401a070 con 0x7f42e40cb340 2024-04-21T09:29:42.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.626+0000 7f42db7fe640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f42c8068380 0x7f42c806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.626+0000 7f42db7fe640 1 -- 172.21.15.26:0/140408690 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f42d4086690 con 0x7f42e40cb340 2024-04-21T09:29:42.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.626+0000 7f42dbfff640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f42c8068380 0x7f42c806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.626+0000 7f42dbfff640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f42c8068380 0x7f42c806a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0ad000 tx=0x7f42cc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.630+0000 7f42db7fe640 1 -- 172.21.15.26:0/140408690 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f42d4056c00 con 0x7f42e40cb340 2024-04-21T09:29:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3c5f03640 1 Processor -- start 2024-04-21T09:29:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3c5f03640 1 -- start start 2024-04-21T09:29:42.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3c5f03640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff3c0071bc0 0x7ff3c00c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3c5f03640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 0x7ff3c00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3c5f03640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c00c83f0 con 0x7ff3c0154ef0 2024-04-21T09:29:42.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3c5f03640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c01552d0 con 0x7ff3c0071bc0 2024-04-21T09:29:42.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3c5f03640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c015aee0 con 0x7ff3c00c68f0 2024-04-21T09:29:42.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3bf7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff3c0154ef0 0x7ff3c015b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54718/0 (socket says 172.21.15.26:54718) 2024-04-21T09:29:42.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3bf7fe640 1 -- 172.21.15.26:0/2312636234 learned_addr learned my addr 172.21.15.26:0/2312636234 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3bffff640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 0x7ff3c00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3beffd640 1 --2- 172.21.15.26:0/2312636234 >> v2:172.21.15.169:3300/0 conn(0x7ff3c0071bc0 0x7ff3c00c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243334052 0 0) 0x7ff3c00c83f0 con 0x7ff3c0154ef0 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3a8003530 con 0x7ff3c0154ef0 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4102122151 0 0) 0x7ff3a8003530 con 0x7ff3c0154ef0 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 msgr2=0x7ff3c00c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 0x7ff3c00c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 >> v2:172.21.15.169:3300/0 conn(0x7ff3c0071bc0 msgr2=0x7ff3c00c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 --2- 172.21.15.26:0/2312636234 >> v2:172.21.15.169:3300/0 conn(0x7ff3c0071bc0 0x7ff3c00c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c015ba80 con 0x7ff3c0154ef0 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7ff3b0001680 con 0x7ff3c0154ef0 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 >> v1:172.21.15.26:6789/0 conn(0x7ff3c0154ef0 legacy=0x7ff3c015b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 0x7ff3a80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a8003f40 0x7ff3a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a8004d50 0x7ff3a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c01552d0 con 0x7ff3a8003f40 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c015aee0 con 0x7ff3a8004d50 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3a800ba00 con 0x7ff3c00c68f0 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3beffd640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a8003f40 0x7ff3a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3bf7fe640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 0x7ff3a80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3beffd640 1 -- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 msgr2=0x7ff3a80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3beffd640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3c00c68f0 0x7ff3a80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3bffff640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a8004d50 0x7ff3a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3beffd640 1 -- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a8004d50 msgr2=0x7ff3a80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3beffd640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3a8004d50 0x7ff3a80051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.738+0000 7ff3beffd640 1 -- 172.21.15.26:0/2312636234 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a8003530 con 0x7ff3a8003f40 2024-04-21T09:29:42.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3beffd640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a8003f40 0x7ff3a8004810 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009ae0 tx=0x7ff3b401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8efce748bfa05a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40b2070 con 0x7ff3a8003f40 2024-04-21T09:29:42.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b40a56a0 con 0x7ff3a8003f40 2024-04-21T09:29:42.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3be7fc640 1 -- 172.21.15.26:0/2312636234 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b40096b0 con 0x7ff3a8003f40 2024-04-21T09:29:42.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- 172.21.15.26:0/2312636234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a8003f40 msgr2=0x7ff3a8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 --2- 172.21.15.26:0/2312636234 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3a8003f40 0x7ff3a8004810 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff3b4009ae0 tx=0x7ff3b401cab0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3bffff640 1 -- 172.21.15.26:0/2312636234 reap_dead start 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- 172.21.15.26:0/2312636234 shutdown_connections 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- 172.21.15.26:0/2312636234 >> 172.21.15.26:0/2312636234 conn(0x7ff3c00c92d0 msgr2=0x7ff3c00c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- 172.21.15.26:0/2312636234 shutdown_connections 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- 172.21.15.26:0/2312636234 wait complete. 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 Processor -- start 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- start start 2024-04-21T09:29:42.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3a8003f40 0x7ff3c0153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3c01561d0 0x7ff3c00c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c01f0780 0x7ff3c01f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c00c7790 con 0x7ff3c01f0780 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c00c7270 con 0x7ff3c01561d0 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3c5f03640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c00c80b0 con 0x7ff3a8003f40 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c01f0780 0x7ff3c01f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3bffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c01f0780 0x7ff3c01f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42772/0 (socket says 172.21.15.26:42772) 2024-04-21T09:29:42.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.742+0000 7ff3bffff640 1 -- 172.21.15.26:0/3054239301 learned_addr learned my addr 172.21.15.26:0/3054239301 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bf7fe640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3a8003f40 0x7ff3c0153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3beffd640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3c01561d0 0x7ff3c00c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bffff640 1 -- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3a8003f40 msgr2=0x7ff3c0153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bffff640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3a8003f40 0x7ff3c0153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bffff640 1 -- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3c01561d0 msgr2=0x7ff3c00c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bffff640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3c01561d0 0x7ff3c00c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bffff640 1 -- 172.21.15.26:0/3054239301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c0153ed0 con 0x7ff3c01f0780 2024-04-21T09:29:42.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bffff640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c01f0780 0x7ff3c01f0c00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00ca700 tx=0x7ff3b800f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3a7fff640 1 -- 172.21.15.26:0/3054239301 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b801c070 con 0x7ff3c01f0780 2024-04-21T09:29:42.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3a7fff640 1 -- 172.21.15.26:0/3054239301 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b8017400 con 0x7ff3c01f0780 2024-04-21T09:29:42.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c01f3e90 con 0x7ff3c01f0780 2024-04-21T09:29:42.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3a7fff640 1 -- 172.21.15.26:0/3054239301 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80177f0 con 0x7ff3c01f0780 2024-04-21T09:29:42.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c01f4450 con 0x7ff3c01f0780 2024-04-21T09:29:42.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c0074320 con 0x7ff3c01f0780 2024-04-21T09:29:42.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3a7fff640 1 -- 172.21.15.26:0/3054239301 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff3b801f070 con 0x7ff3c01f0780 2024-04-21T09:29:42.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3a7fff640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3ac068380 0x7ff3ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3a7fff640 1 -- 172.21.15.26:0/3054239301 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7ff3b8086c70 con 0x7ff3c01f0780 2024-04-21T09:29:42.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.746+0000 7ff3bf7fe640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3ac068380 0x7ff3ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.750+0000 7ff3bf7fe640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3ac068380 0x7ff3ac06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0000fc0 tx=0x7ff3b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.750+0000 7ff3a7fff640 1 -- 172.21.15.26:0/3054239301 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff3b8012070 con 0x7ff3c01f0780 2024-04-21T09:29:42.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.790+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f42e4158510 con 0x7f42e40cb340 2024-04-21T09:29:42.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.790+0000 7f42db7fe640 1 -- 172.21.15.26:0/140408690 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) ==== 100+0+11 (secure 0 0 0) 0x7f42d4056500 con 0x7f42e40cb340 2024-04-21T09:29:42.793 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T09:29:42.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f42c8068380 msgr2=0x7f42c806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f42c8068380 0x7f42c806a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f42cc0ad000 tx=0x7f42cc008040 comp rx=0 tx=0).stop 2024-04-21T09:29:42.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cb340 msgr2=0x7f42e414da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cb340 0x7f42e414da70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f42d400e840 tx=0x7f42d400ed00 comp rx=0 tx=0).stop 2024-04-21T09:29:42.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 shutdown_connections 2024-04-21T09:29:42.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f42e4154e70 0x7f42e4157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f42e40cc8d0 0x7f42e41599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f42c8068380 0x7f42c806a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 --2- 172.21.15.26:0/140408690 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f42e40cb340 0x7f42e414da70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 >> 172.21.15.26:0/140408690 conn(0x7f42e406de70 msgr2=0x7f42e40c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 shutdown_connections 2024-04-21T09:29:42.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.794+0000 7f42e95c7640 1 -- 172.21.15.26:0/140408690 wait complete. 2024-04-21T09:29:42.811 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-21T09:29:42.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff3c00c7ad0 con 0x7ff3c01f0780 2024-04-21T09:29:42.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3a7fff640 1 -- 172.21.15.26:0/3054239301 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) ==== 104+0+11 (secure 0 0 0) 0x7ff3b80571d0 con 0x7ff3c01f0780 2024-04-21T09:29:42.916 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T09:29:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3ac068380 msgr2=0x7ff3ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3ac068380 0x7ff3ac06a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff3b0000fc0 tx=0x7ff3b0009040 comp rx=0 tx=0).stop 2024-04-21T09:29:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c01f0780 msgr2=0x7ff3c01f0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c01f0780 0x7ff3c01f0c00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00ca700 tx=0x7ff3b800f4a0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 shutdown_connections 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff3ac068380 0x7ff3ac06a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff3c01f0780 0x7ff3c01f0c00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff3c01561d0 0x7ff3c00c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 --2- 172.21.15.26:0/3054239301 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3a8003f40 0x7ff3c0153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 >> 172.21.15.26:0/3054239301 conn(0x7ff3c00c92d0 msgr2=0x7ff3c0159110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 shutdown_connections 2024-04-21T09:29:42.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.914+0000 7ff3c5f03640 1 -- 172.21.15.26:0/3054239301 wait complete. 2024-04-21T09:29:42.935 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T09:29:42.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.982+0000 7fc488654640 1 Processor -- start 2024-04-21T09:29:42.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc488654640 1 -- start start 2024-04-21T09:29:42.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc488654640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc480152b00 0x7fc4800c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc488654640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4801592b0 0x7fc4800c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc488654640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4800c74f0 con 0x7fc480073a80 2024-04-21T09:29:42.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc488654640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc480071d50 con 0x7fc480152b00 2024-04-21T09:29:42.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc488654640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc480152ee0 con 0x7fc4801592b0 2024-04-21T09:29:42.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4863f0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc480152b00 0x7fc4800c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc485bef640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc480073a80 0x7fc480158ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54720/0 (socket says 172.21.15.26:54720) 2024-04-21T09:29:42.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc485bef640 1 -- 172.21.15.26:0/880280005 learned_addr learned my addr 172.21.15.26:0/880280005 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:42.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc486bf1640 1 --2- 172.21.15.26:0/880280005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4801592b0 0x7fc4800c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4863f0640 1 -- 172.21.15.26:0/880280005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4801592b0 msgr2=0x7fc4800c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:42.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4863f0640 1 --2- 172.21.15.26:0/880280005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4801592b0 0x7fc4800c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4863f0640 1 -- 172.21.15.26:0/880280005 >> v1:172.21.15.26:6789/0 conn(0x7fc480073a80 legacy=0x7fc480158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4863f0640 1 -- 172.21.15.26:0/880280005 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4800c8c30 con 0x7fc480152b00 2024-04-21T09:29:42.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4853ee640 1 -- 172.21.15.26:0/880280005 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261217630 0 0) 0x7fc4800c74f0 con 0x7fc480073a80 2024-04-21T09:29:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4863f0640 1 --2- 172.21.15.26:0/880280005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc480152b00 0x7fc4800c5e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc480071ed0 tx=0x7fc47001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06f052e2fc0bb0d server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4853ee640 1 -- 172.21.15.26:0/880280005 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4700b2070 con 0x7fc480152b00 2024-04-21T09:29:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4853ee640 1 -- 172.21.15.26:0/880280005 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4700a59e0 con 0x7fc480152b00 2024-04-21T09:29:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.986+0000 7fc4853ee640 1 -- 172.21.15.26:0/880280005 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4700a5db0 con 0x7fc480152b00 2024-04-21T09:29:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- 172.21.15.26:0/880280005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc480152b00 msgr2=0x7fc4800c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 --2- 172.21.15.26:0/880280005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc480152b00 0x7fc4800c5e40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc480071ed0 tx=0x7fc47001c920 comp rx=0 tx=0).stop 2024-04-21T09:29:42.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- 172.21.15.26:0/880280005 shutdown_connections 2024-04-21T09:29:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 --2- 172.21.15.26:0/880280005 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4801592b0 0x7fc4800c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 --2- 172.21.15.26:0/880280005 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc480152b00 0x7fc4800c5e40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- 172.21.15.26:0/880280005 >> 172.21.15.26:0/880280005 conn(0x7fc4800702c0 msgr2=0x7fc4800cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- 172.21.15.26:0/880280005 shutdown_connections 2024-04-21T09:29:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- 172.21.15.26:0/880280005 wait complete. 2024-04-21T09:29:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 Processor -- start 2024-04-21T09:29:42.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- start start 2024-04-21T09:29:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc480073a80 0x7fc480155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc480152b00 0x7fc4800cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4801592b0 0x7fc480153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800c71b0 con 0x7fc4801592b0 2024-04-21T09:29:42.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc480067d60 con 0x7fc480073a80 2024-04-21T09:29:42.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc488654640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc48006cf70 con 0x7fc480152b00 2024-04-21T09:29:42.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4801592b0 0x7fc480153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4801592b0 0x7fc480153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42792/0 (socket says 172.21.15.26:42792) 2024-04-21T09:29:42.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 -- 172.21.15.26:0/619892244 learned_addr learned my addr 172.21.15.26:0/619892244 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:42.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc485bef640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc480152b00 0x7fc4800cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc4863f0640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc480073a80 0x7fc480155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:42.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 -- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc480152b00 msgr2=0x7fc4800cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc480152b00 0x7fc4800cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 -- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc480073a80 msgr2=0x7fc480155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc480073a80 0x7fc480155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 -- 172.21.15.26:0/619892244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48014ed70 con 0x7fc4801592b0 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc4863f0640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc480073a80 0x7fc480155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.990+0000 7fc486bf1640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4801592b0 0x7fc480153340 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc47800d590 tx=0x7fc47800da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc47effd640 1 -- 172.21.15.26:0/619892244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4780125f0 con 0x7fc4801592b0 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc47effd640 1 -- 172.21.15.26:0/619892244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc478019070 con 0x7fc4801592b0 2024-04-21T09:29:42.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4801f1ac0 con 0x7fc4801592b0 2024-04-21T09:29:43.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc47effd640 1 -- 172.21.15.26:0/619892244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4780129f0 con 0x7fc4801592b0 2024-04-21T09:29:43.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48014f2f0 con 0x7fc4801592b0 2024-04-21T09:29:43.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc480074320 con 0x7fc4801592b0 2024-04-21T09:29:43.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc47effd640 1 -- 172.21.15.26:0/619892244 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc478012b90 con 0x7fc4801592b0 2024-04-21T09:29:43.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc47effd640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc46c0683b0 0x7fc46c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc47effd640 1 -- 172.21.15.26:0/619892244 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fc478086ce0 con 0x7fc4801592b0 2024-04-21T09:29:43.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc4863f0640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc46c0683b0 0x7fc46c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.994+0000 7fc4863f0640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc46c0683b0 0x7fc46c06a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4700af000 tx=0x7fc4700a7070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:42.998+0000 7fc47effd640 1 -- 172.21.15.26:0/619892244 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc4780572f0 con 0x7fc4801592b0 2024-04-21T09:29:43.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef28377640 1 Processor -- start 2024-04-21T09:29:43.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef28377640 1 -- start start 2024-04-21T09:29:43.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef28377640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef20154cc0 0x7fef200ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef28377640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef2015ef30 con 0x7fef201550a0 2024-04-21T09:29:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef28377640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef200b3fd0 con 0x7fef200ccfe0 2024-04-21T09:29:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef28377640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fef200b42b0 con 0x7fef20154cc0 2024-04-21T09:29:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef26113640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef20154cc0 0x7fef200ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef26113640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fef20154cc0 0x7fef200ccaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42808/0 (socket says 172.21.15.26:42808) 2024-04-21T09:29:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef26113640 1 -- 172.21.15.26:0/548274394 learned_addr learned my addr 172.21.15.26:0/548274394 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef26113640 1 -- 172.21.15.26:0/548274394 >> v1:172.21.15.169:6789/0 conn(0x7fef200ccfe0 legacy=0x7fef2015e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef26113640 1 -- 172.21.15.26:0/548274394 >> v1:172.21.15.26:6789/0 conn(0x7fef201550a0 legacy=0x7fef200d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef25111640 1 -- 172.21.15.26:0/548274394 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044293955 0 0) 0x7fef2015ef30 con 0x7fef201550a0 2024-04-21T09:29:43.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.046+0000 7fef26113640 1 -- 172.21.15.26:0/548274394 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef200b4590 con 0x7fef20154cc0 2024-04-21T09:29:43.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef26113640 1 --2- 172.21.15.26:0/548274394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef20154cc0 0x7fef200ccaa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009e50 tx=0x7fef1c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1e1595f9bf5616 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef25111640 1 -- 172.21.15.26:0/548274394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0b4070 con 0x7fef20154cc0 2024-04-21T09:29:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef25111640 1 -- 172.21.15.26:0/548274394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c0af400 con 0x7fef20154cc0 2024-04-21T09:29:43.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef25111640 1 -- 172.21.15.26:0/548274394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0af7d0 con 0x7fef20154cc0 2024-04-21T09:29:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- 172.21.15.26:0/548274394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef20154cc0 msgr2=0x7fef200ccaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 --2- 172.21.15.26:0/548274394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef20154cc0 0x7fef200ccaa0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fef1c009e50 tx=0x7fef1c01f1e0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- 172.21.15.26:0/548274394 shutdown_connections 2024-04-21T09:29:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 --2- 172.21.15.26:0/548274394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef20154cc0 0x7fef200ccaa0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- 172.21.15.26:0/548274394 >> 172.21.15.26:0/548274394 conn(0x7fef2006de80 msgr2=0x7fef2006e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- 172.21.15.26:0/548274394 shutdown_connections 2024-04-21T09:29:43.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- 172.21.15.26:0/548274394 wait complete. 2024-04-21T09:29:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 Processor -- start 2024-04-21T09:29:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- start start 2024-04-21T09:29:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef200ccfe0 0x7fef201581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef20154cc0 0x7fef201f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef201550a0 0x7fef20153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fef2015ae60 con 0x7fef200ccfe0 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fef200b5070 con 0x7fef20154cc0 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.050+0000 7fef28377640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fef200d0a60 con 0x7fef201550a0 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef200ccfe0 0x7fef201581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef200ccfe0 0x7fef201581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42810/0 (socket says 172.21.15.26:42810) 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 -- 172.21.15.26:0/3331138157 learned_addr learned my addr 172.21.15.26:0/3331138157 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26914640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef201550a0 0x7fef20153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 -- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef201550a0 msgr2=0x7fef20153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef201550a0 0x7fef20153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 -- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef20154cc0 msgr2=0x7fef201f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef20154cc0 0x7fef201f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 -- 172.21.15.26:0/3331138157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef20151840 con 0x7fef200ccfe0 2024-04-21T09:29:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef26113640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef200ccfe0 0x7fef201581a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fef1c025f30 tx=0x7fef1c01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef12ffd640 1 -- 172.21.15.26:0/3331138157 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0c2070 con 0x7fef200ccfe0 2024-04-21T09:29:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef12ffd640 1 -- 172.21.15.26:0/3331138157 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef1c0090d0 con 0x7fef200ccfe0 2024-04-21T09:29:43.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef20151b20 con 0x7fef200ccfe0 2024-04-21T09:29:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef12ffd640 1 -- 172.21.15.26:0/3331138157 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef1c0b4040 con 0x7fef200ccfe0 2024-04-21T09:29:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef201f43a0 con 0x7fef200ccfe0 2024-04-21T09:29:43.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef20074320 con 0x7fef200ccfe0 2024-04-21T09:29:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef12ffd640 1 -- 172.21.15.26:0/3331138157 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef1c0c5070 con 0x7fef200ccfe0 2024-04-21T09:29:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef12ffd640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fef040683b0 0x7fef0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef12ffd640 1 -- 172.21.15.26:0/3331138157 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fef1c1246d0 con 0x7fef200ccfe0 2024-04-21T09:29:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.054+0000 7fef25912640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fef040683b0 0x7fef0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.058+0000 7fef25912640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fef040683b0 0x7fef0406a870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef14007fd0 tx=0x7fef14007900 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.058+0000 7fef12ffd640 1 -- 172.21.15.26:0/3331138157 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef1c0cc080 con 0x7fef200ccfe0 2024-04-21T09:29:43.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.174+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc48006d280 con 0x7fc4801592b0 2024-04-21T09:29:43.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.174+0000 7fc47effd640 1 -- 172.21.15.26:0/619892244 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7fc478056bf0 con 0x7fc4801592b0 2024-04-21T09:29:43.178 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-21T09:29:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc46c0683b0 msgr2=0x7fc46c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc46c0683b0 0x7fc46c06a870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4700af000 tx=0x7fc4700a7070 comp rx=0 tx=0).stop 2024-04-21T09:29:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4801592b0 msgr2=0x7fc480153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4801592b0 0x7fc480153340 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc47800d590 tx=0x7fc47800da50 comp rx=0 tx=0).stop 2024-04-21T09:29:43.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 shutdown_connections 2024-04-21T09:29:43.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc46c0683b0 0x7fc46c06a870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4801592b0 0x7fc480153340 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc480152b00 0x7fc4800cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 --2- 172.21.15.26:0/619892244 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc480073a80 0x7fc480155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 >> 172.21.15.26:0/619892244 conn(0x7fc4800702c0 msgr2=0x7fc480151160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 shutdown_connections 2024-04-21T09:29:43.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.178+0000 7fc488654640 1 -- 172.21.15.26:0/619892244 wait complete. 2024-04-21T09:29:43.197 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-21T09:29:43.197 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-21T09:29:43.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-21T09:29:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.214+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fef2015b300 con 0x7fef200ccfe0 2024-04-21T09:29:43.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.214+0000 7fef12ffd640 1 -- 172.21.15.26:0/3331138157 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) ==== 100+0+11 (secure 0 0 0) 0x7fef1c018d40 con 0x7fef200ccfe0 2024-04-21T09:29:43.218 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T09:29:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fef040683b0 msgr2=0x7fef0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fef040683b0 0x7fef0406a870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fef14007fd0 tx=0x7fef14007900 comp rx=0 tx=0).stop 2024-04-21T09:29:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef200ccfe0 msgr2=0x7fef201581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef200ccfe0 0x7fef201581a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fef1c025f30 tx=0x7fef1c01bf80 comp rx=0 tx=0).stop 2024-04-21T09:29:43.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 shutdown_connections 2024-04-21T09:29:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fef201550a0 0x7fef20153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fef20154cc0 0x7fef201f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fef040683b0 0x7fef0406a870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 --2- 172.21.15.26:0/3331138157 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef200ccfe0 0x7fef201581a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 >> 172.21.15.26:0/3331138157 conn(0x7fef2006de80 msgr2=0x7fef200cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 shutdown_connections 2024-04-21T09:29:43.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.218+0000 7fef28377640 1 -- 172.21.15.26:0/3331138157 wait complete. 2024-04-21T09:29:43.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-21T09:29:43.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e961c640 1 Processor -- start 2024-04-21T09:29:43.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e961c640 1 -- start start 2024-04-21T09:29:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e961c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff1e4154cc0 0x7ff1e40ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e961c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 0x7ff1e40d0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e961c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1e415ef30 con 0x7ff1e40ccfe0 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e961c640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7ff1e40b3fd0 con 0x7ff1e4154cc0 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e961c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e40b42b0 con 0x7ff1e41550a0 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff1e40ccfe0 0x7ff1e415e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54730/0 (socket says 172.21.15.26:54730) 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e37fe640 1 -- 172.21.15.26:0/4109337772 learned_addr learned my addr 172.21.15.26:0/4109337772 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1dbfff640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 0x7ff1e40d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/4109337772 >> v2:172.21.15.169:3300/0 conn(0x7ff1e4154cc0 0x7ff1e40ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141645039 0 0) 0x7ff1e415ef30 con 0x7ff1e40ccfe0 2024-04-21T09:29:43.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1d0003530 con 0x7ff1e40ccfe0 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 342348703 0 0) 0x7ff1d0003530 con 0x7ff1e40ccfe0 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 msgr2=0x7ff1e40d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 0x7ff1e40d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 >> v2:172.21.15.169:3300/0 conn(0x7ff1e4154cc0 msgr2=0x7ff1e40ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 --2- 172.21.15.26:0/4109337772 >> v2:172.21.15.169:3300/0 conn(0x7ff1e4154cc0 0x7ff1e40ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e40b4590 con 0x7ff1e40ccfe0 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3454155664 0 0) 0x7ff1dc001a00 con 0x7ff1e40ccfe0 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 >> v1:172.21.15.26:6789/0 conn(0x7ff1e40ccfe0 legacy=0x7ff1e415e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1d00039c0 0x7ff1d0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 0x7ff1d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1d0004d50 0x7ff1d00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e40b3fd0 con 0x7ff1d00039c0 2024-04-21T09:29:43.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e40b42b0 con 0x7ff1d0004d50 2024-04-21T09:29:43.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff1d000ba00 con 0x7ff1e41550a0 2024-04-21T09:29:43.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1d00039c0 0x7ff1d0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e37fe640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1d0004d50 0x7ff1d00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1dbfff640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 0x7ff1d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e2ffd640 1 -- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 msgr2=0x7ff1d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 0x7ff1d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e2ffd640 1 -- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1d0004d50 msgr2=0x7ff1d00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1d0004d50 0x7ff1d00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e2ffd640 1 -- 172.21.15.26:0/4109337772 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1d0003530 con 0x7ff1d00039c0 2024-04-21T09:29:43.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1e37fe640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1d0004d50 0x7ff1d00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:43.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.342+0000 7ff1dbfff640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1e41550a0 0x7ff1d0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1d00039c0 0x7ff1d0003de0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009ae0 tx=0x7ff1d401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3424995fd0f6bb server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40b2070 con 0x7ff1d00039c0 2024-04-21T09:29:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d40a56a0 con 0x7ff1d00039c0 2024-04-21T09:29:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e27fc640 1 -- 172.21.15.26:0/4109337772 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d40096b0 con 0x7ff1d00039c0 2024-04-21T09:29:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 -- 172.21.15.26:0/4109337772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1d00039c0 msgr2=0x7ff1d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 --2- 172.21.15.26:0/4109337772 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1d00039c0 0x7ff1d0003de0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009ae0 tx=0x7ff1d401cab0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e37fe640 1 -- 172.21.15.26:0/4109337772 reap_dead start 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 -- 172.21.15.26:0/4109337772 shutdown_connections 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 -- 172.21.15.26:0/4109337772 >> 172.21.15.26:0/4109337772 conn(0x7ff1e406de80 msgr2=0x7ff1e406e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 -- 172.21.15.26:0/4109337772 shutdown_connections 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 -- 172.21.15.26:0/4109337772 wait complete. 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 Processor -- start 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 -- start start 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1d00039c0 0x7ff1e41f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1e40d0fd0 0x7ff1e40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.346+0000 7ff1e961c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e41f0b30 0x7ff1e41f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e961c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e415ae60 con 0x7ff1e41f0b30 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e961c640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e40b5070 con 0x7ff1e40d0fd0 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e961c640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e415e840 con 0x7ff1d00039c0 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e41f0b30 0x7ff1e41f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e41f0b30 0x7ff1e41f0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42830/0 (socket says 172.21.15.26:42830) 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 -- 172.21.15.26:0/424898333 learned_addr learned my addr 172.21.15.26:0/424898333 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1d00039c0 0x7ff1e41f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 -- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1d00039c0 msgr2=0x7ff1e41f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1d00039c0 0x7ff1e41f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 -- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1e40d0fd0 msgr2=0x7ff1e40b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1e40d0fd0 0x7ff1e40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 -- 172.21.15.26:0/424898333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e40cfdb0 con 0x7ff1e41f0b30 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e37fe640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e41f0b30 0x7ff1e41f0fc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40c3bb0 tx=0x7ff1dc010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1db7fe640 1 -- 172.21.15.26:0/424898333 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc01a070 con 0x7ff1e41f0b30 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1db7fe640 1 -- 172.21.15.26:0/424898333 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1dc011040 con 0x7ff1e41f0b30 2024-04-21T09:29:43.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e40d0090 con 0x7ff1e41f0b30 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1db7fe640 1 -- 172.21.15.26:0/424898333 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1dc00ece0 con 0x7ff1e41f0b30 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e40d0650 con 0x7ff1e41f0b30 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e4075ef0 con 0x7ff1e41f0b30 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1db7fe640 1 -- 172.21.15.26:0/424898333 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff1dc01d070 con 0x7ff1e41f0b30 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1db7fe640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff1c4068380 0x7ff1c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1db7fe640 1 -- 172.21.15.26:0/424898333 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7ff1dc0890c0 con 0x7ff1e41f0b30 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff1c4068380 0x7ff1c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.350+0000 7ff1e2ffd640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff1c4068380 0x7ff1c406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009ae0 tx=0x7ff1d40046d0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.354+0000 7ff1db7fe640 1 -- 172.21.15.26:0/424898333 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff1dc058ff0 con 0x7ff1e41f0b30 2024-04-21T09:29:43.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdefdcf640 1 Processor -- start 2024-04-21T09:29:43.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdefdcf640 1 -- start start 2024-04-21T09:29:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdefdcf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde81598a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdefdcf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbde80ca670 0x7fbde806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdefdcf640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbde8073ab0 con 0x7fbde80c6980 2024-04-21T09:29:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdefdcf640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbde8159410 con 0x7fbde80ca670 2024-04-21T09:29:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdefdcf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbde8074030 con 0x7fbde80c6d60 2024-04-21T09:29:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdee36c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbde80ca670 0x7fbde806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdee36c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbde80ca670 0x7fbde806d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42832/0 (socket says 172.21.15.26:42832) 2024-04-21T09:29:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdee36c640 1 -- 172.21.15.26:0/729395068 learned_addr learned my addr 172.21.15.26:0/729395068 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbded36a640 1 --2- 172.21.15.26:0/729395068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde81598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdee36c640 1 -- 172.21.15.26:0/729395068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 msgr2=0x7fbde81598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdee36c640 1 --2- 172.21.15.26:0/729395068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde81598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdee36c640 1 -- 172.21.15.26:0/729395068 >> v1:172.21.15.169:6789/0 conn(0x7fbde80c6980 legacy=0x7fbde80725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.394+0000 7fbdee36c640 1 -- 172.21.15.26:0/729395068 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde8073d50 con 0x7fbde80ca670 2024-04-21T09:29:43.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdee36c640 1 --2- 172.21.15.26:0/729395068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde806d0f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0e4401d4f0607 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdecb69640 1 -- 172.21.15.26:0/729395068 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00b4070 con 0x7fbde80ca670 2024-04-21T09:29:43.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdecb69640 1 -- 172.21.15.26:0/729395068 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde00af400 con 0x7fbde80ca670 2024-04-21T09:29:43.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdecb69640 1 -- 172.21.15.26:0/729395068 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00af7d0 con 0x7fbde80ca670 2024-04-21T09:29:43.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- 172.21.15.26:0/729395068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 msgr2=0x7fbde806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/729395068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde806d0f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde001f1e0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- 172.21.15.26:0/729395068 shutdown_connections 2024-04-21T09:29:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/729395068 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde806d0f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/729395068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde81598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- 172.21.15.26:0/729395068 >> 172.21.15.26:0/729395068 conn(0x7fbde80c9b50 msgr2=0x7fbde80c9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- 172.21.15.26:0/729395068 shutdown_connections 2024-04-21T09:29:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- 172.21.15.26:0/729395068 wait complete. 2024-04-21T09:29:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 Processor -- start 2024-04-21T09:29:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- start start 2024-04-21T09:29:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbde80c6980 0x7fbde8159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde815aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbde80c73d0 con 0x7fbde80ca670 2024-04-21T09:29:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fbde81590a0 con 0x7fbde80c6980 2024-04-21T09:29:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdefdcf640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fbde815cc30 con 0x7fbde80c6d60 2024-04-21T09:29:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdee36c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbded36a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde815aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdee36c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde815afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42836/0 (socket says 172.21.15.26:42836) 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.398+0000 7fbdedb6b640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbde80c6980 0x7fbde8159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdee36c640 1 -- 172.21.15.26:0/3780712221 learned_addr learned my addr 172.21.15.26:0/3780712221 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdee36c640 1 -- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 msgr2=0x7fbde815aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdee36c640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde815aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdee36c640 1 -- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbde80c6980 msgr2=0x7fbde8159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdee36c640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbde80c6980 0x7fbde8159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdee36c640 1 -- 172.21.15.26:0/3780712221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde815b510 con 0x7fbde80ca670 2024-04-21T09:29:43.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdee36c640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde815afd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde001bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdda7fc640 1 -- 172.21.15.26:0/3780712221 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde00b4040 con 0x7fbde80ca670 2024-04-21T09:29:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdda7fc640 1 -- 172.21.15.26:0/3780712221 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde00c0070 con 0x7fbde80ca670 2024-04-21T09:29:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde80c6200 con 0x7fbde80ca670 2024-04-21T09:29:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdda7fc640 1 -- 172.21.15.26:0/3780712221 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde0009510 con 0x7fbde80ca670 2024-04-21T09:29:43.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde814dea0 con 0x7fbde80ca670 2024-04-21T09:29:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde8074320 con 0x7fbde80ca670 2024-04-21T09:29:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdda7fc640 1 -- 172.21.15.26:0/3780712221 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbde00c5460 con 0x7fbde80ca670 2024-04-21T09:29:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdda7fc640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbdcc0683b0 0x7fbdcc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdda7fc640 1 -- 172.21.15.26:0/3780712221 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fbde0124c00 con 0x7fbde80ca670 2024-04-21T09:29:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdedb6b640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbdcc0683b0 0x7fbdcc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.402+0000 7fbdedb6b640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbdcc0683b0 0x7fbdcc06a870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbddc007fd0 tx=0x7fbddc007e40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.406+0000 7fbdda7fc640 1 -- 172.21.15.26:0/3780712221 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbde815b510 con 0x7fbde80ca670 2024-04-21T09:29:43.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.514+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff1e40cb380 con 0x7ff1e41f0b30 2024-04-21T09:29:43.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1db7fe640 1 -- 172.21.15.26:0/424898333 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) ==== 74+0+16716 (secure 0 0 0) 0x7ff1dc05d2f0 con 0x7ff1e41f0b30 2024-04-21T09:29:43.519 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:43.519 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":67,"fsid":"c3cab1f1-d502-48e1-871b-caee77004426","created":"2024-04-21T08:57:26.550201+0000","modified":"2024-04-21T09:28:51.732460+0000","last_up_change":"2024-04-21T08:57:37.170941+0000","last_in_change":"2024-04-21T08:57:28.837455+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-21T08:57:35.181448+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-21T08:57:41.907144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-21T08:57:42.562311+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":765,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"46b90dcf-abe9-4d0c-b3c8-1f7ec9e4938d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6809","nonce":2156201471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6813","nonce":2156201471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6818","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6819","nonce":2156201471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":2156201471},{"type":"v1","addr":"172.21.15.26:6815","nonce":2156201471}]},"public_addr":"172.21.15.26:6809/2156201471","cluster_addr":"172.21.15.26:6813/2156201471","heartbeat_back_addr":"172.21.15.26:6819/2156201471","heartbeat_front_addr":"172.21.15.26:6815/2156201471","state":["exists","up"]},{"osd":1,"uuid":"b60ccb31-5f4e-4677-b3f7-d53b66c8bd2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6807","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6811","nonce":1666945982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6817","nonce":1666945982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6822","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6823","nonce":1666945982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1666945982},{"type":"v1","addr":"172.21.15.26:6821","nonce":1666945982}]},"public_addr":"172.21.15.26:6811/1666945982","cluster_addr":"172.21.15.26:6817/1666945982","heartbeat_back_addr":"172.21.15.26:6823/1666945982","heartbeat_front_addr":"172.21.15.26:6821/1666945982","state":["exists","up"]},{"osd":2,"uuid":"ac81d636-91c1-413c-bff1-46cf85d1f481","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6825","nonce":3089494797}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6826","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6827","nonce":3089494797}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6830","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6831","nonce":3089494797}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":3089494797},{"type":"v1","addr":"172.21.15.26:6829","nonce":3089494797}]},"public_addr":"172.21.15.26:6825/3089494797","cluster_addr":"172.21.15.26:6827/3089494797","heartbeat_back_addr":"172.21.15.26:6831/3089494797","heartbeat_front_addr":"172.21.15.26:6829/3089494797","state":["exists","up"]},{"osd":3,"uuid":"839fe36a-5e49-47c2-9361-6d331421254c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6801","nonce":852338092}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6803","nonce":852338092}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6812","nonce":852338092}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":852338092},{"type":"v1","addr":"172.21.15.26:6805","nonce":852338092}]},"public_addr":"172.21.15.26:6801/852338092","cluster_addr":"172.21.15.26:6803/852338092","heartbeat_back_addr":"172.21.15.26:6812/852338092","heartbeat_front_addr":"172.21.15.26:6805/852338092","state":["exists","up"]},{"osd":4,"uuid":"9fec732b-95f2-40c0-a9b3-49911f569507","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6801","nonce":3582063879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6803","nonce":3582063879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6807","nonce":3582063879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":3582063879},{"type":"v1","addr":"172.21.15.169:6805","nonce":3582063879}]},"public_addr":"172.21.15.169:6801/3582063879","cluster_addr":"172.21.15.169:6803/3582063879","heartbeat_back_addr":"172.21.15.169:6807/3582063879","heartbeat_front_addr":"172.21.15.169:6805/3582063879","state":["exists","up"]},{"osd":5,"uuid":"c43e46c5-2655-4ea7-bf8c-6622b1cf3b1d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6810","nonce":2167632650}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6814","nonce":2167632650}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6822","nonce":2167632650}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":2167632650},{"type":"v1","addr":"172.21.15.169:6818","nonce":2167632650}]},"public_addr":"172.21.15.169:6810/2167632650","cluster_addr":"172.21.15.169:6814/2167632650","heartbeat_back_addr":"172.21.15.169:6822/2167632650","heartbeat_front_addr":"172.21.15.169:6818/2167632650","state":["exists","up"]},{"osd":6,"uuid":"b0ef3a6d-1cec-4eb8-bb89-347eadd2ff54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6809","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6811","nonce":190806267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6813","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6815","nonce":190806267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6821","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6823","nonce":190806267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6817","nonce":190806267},{"type":"v1","addr":"172.21.15.169:6819","nonce":190806267}]},"public_addr":"172.21.15.169:6811/190806267","cluster_addr":"172.21.15.169:6815/190806267","heartbeat_back_addr":"172.21.15.169:6823/190806267","heartbeat_front_addr":"172.21.15.169:6819/190806267","state":["exists","up"]},{"osd":7,"uuid":"7767a47f-5c61-4b8d-b1bd-a03805547ed5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6825","nonce":1350262825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6827","nonce":1350262825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6831","nonce":1350262825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":1350262825},{"type":"v1","addr":"172.21.15.169:6829","nonce":1350262825}]},"public_addr":"172.21.15.169:6825/1350262825","cluster_addr":"172.21.15.169:6827/1350262825","heartbeat_back_addr":"172.21.15.169:6831/1350262825","heartbeat_front_addr":"172.21.15.169:6829/1350262825","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.532902+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.337044+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.510236+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.432762+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.091021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.201454+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.063193+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-21T08:57:34.148850+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.39","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":750,"length":16}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-21T09:29:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff1c4068380 msgr2=0x7ff1c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff1c4068380 0x7ff1c406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff1d4009ae0 tx=0x7ff1d40046d0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e41f0b30 msgr2=0x7ff1e41f0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e41f0b30 0x7ff1e41f0fc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7ff1e40c3bb0 tx=0x7ff1dc010d00 comp rx=0 tx=0).stop 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 shutdown_connections 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7ff1c4068380 0x7ff1c406a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff1e41f0b30 0x7ff1e41f0fc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff1e40d0fd0 0x7ff1e40b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 --2- 172.21.15.26:0/424898333 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff1d00039c0 0x7ff1e41f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 >> 172.21.15.26:0/424898333 conn(0x7ff1e406de80 msgr2=0x7ff1e4152f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 shutdown_connections 2024-04-21T09:29:43.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.518+0000 7ff1e961c640 1 -- 172.21.15.26:0/424898333 wait complete. 2024-04-21T09:29:43.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-21T08:57:35.181448+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-21T08:57:41.907144+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-21T08:57:42.562311+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 765, 'snap_epoch': 65, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-21T09:29:43.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-21T09:29:43.579 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbde814ede0 con 0x7fbde80ca670 2024-04-21T09:29:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdda7fc640 1 -- 172.21.15.26:0/3780712221 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7fbde0018d40 con 0x7fbde80ca670 2024-04-21T09:29:43.580 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-21T09:29:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbdcc0683b0 msgr2=0x7fbdcc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbdcc0683b0 0x7fbdcc06a870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbddc007fd0 tx=0x7fbddc007e40 comp rx=0 tx=0).stop 2024-04-21T09:29:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 msgr2=0x7fbde815afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde815afd0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde001bf80 comp rx=0 tx=0).stop 2024-04-21T09:29:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 shutdown_connections 2024-04-21T09:29:43.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fbdcc0683b0 0x7fbdcc06a870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbde80ca670 0x7fbde815afd0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbde80c6d60 0x7fbde815aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 --2- 172.21.15.26:0/3780712221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbde80c6980 0x7fbde8159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 >> 172.21.15.26:0/3780712221 conn(0x7fbde80c9b50 msgr2=0x7fbde80725a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 shutdown_connections 2024-04-21T09:29:43.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.578+0000 7fbdefdcf640 1 -- 172.21.15.26:0/3780712221 wait complete. 2024-04-21T09:29:43.597 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2024-04-21T09:29:43.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T09:29:43.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-21T09:29:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.658+0000 7fc4647d7640 1 Processor -- start 2024-04-21T09:29:43.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.658+0000 7fc4647d7640 1 -- start start 2024-04-21T09:29:43.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.658+0000 7fc4647d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c152b00 0x7fc45c0c5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.658+0000 7fc4647d7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc45c073a80 0x7fc45c0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.658+0000 7fc4647d7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc45c0c74f0 con 0x7fc45c158ba0 2024-04-21T09:29:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.658+0000 7fc4647d7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fc45c071d50 con 0x7fc45c073a80 2024-04-21T09:29:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.658+0000 7fc4647d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc45c152ee0 con 0x7fc45c152b00 2024-04-21T09:29:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c152b00 0x7fc45c0c5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c152b00 0x7fc45c0c5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:41060/0 (socket says 172.21.15.26:41060) 2024-04-21T09:29:43.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 -- 172.21.15.26:0/3319299113 learned_addr learned my addr 172.21.15.26:0/3319299113 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc461d72640 1 --2- 172.21.15.26:0/3319299113 >> v2:172.21.15.169:3300/0 conn(0x7fc45c073a80 0x7fc45c0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:29:43.665 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T09:29:43.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-21T09:29:43.665 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-21T09:29:43.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 -- 172.21.15.26:0/3319299113 >> v2:172.21.15.169:3300/0 conn(0x7fc45c073a80 msgr2=0x7fc45c0c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 --2- 172.21.15.26:0/3319299113 >> v2:172.21.15.169:3300/0 conn(0x7fc45c073a80 0x7fc45c0c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 -- 172.21.15.26:0/3319299113 >> v1:172.21.15.169:6789/0 conn(0x7fc45c158ba0 legacy=0x7fc45c158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 -- 172.21.15.26:0/3319299113 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45c0c8c30 con 0x7fc45c152b00 2024-04-21T09:29:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc462573640 1 --2- 172.21.15.26:0/3319299113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c152b00 0x7fc45c0c5e40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc458009870 tx=0x7fc45801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43b3618b5cc59f38 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc461571640 1 -- 172.21.15.26:0/3319299113 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580a95f0 con 0x7fc45c152b00 2024-04-21T09:29:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc461571640 1 -- 172.21.15.26:0/3319299113 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4580a9790 con 0x7fc45c152b00 2024-04-21T09:29:43.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc461571640 1 -- 172.21.15.26:0/3319299113 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580a9b60 con 0x7fc45c152b00 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 -- 172.21.15.26:0/3319299113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c152b00 msgr2=0x7fc45c0c5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 --2- 172.21.15.26:0/3319299113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c152b00 0x7fc45c0c5e40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fc458009870 tx=0x7fc45801c530 comp rx=0 tx=0).stop 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 -- 172.21.15.26:0/3319299113 shutdown_connections 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 --2- 172.21.15.26:0/3319299113 >> v2:172.21.15.169:3300/0 conn(0x7fc45c073a80 0x7fc45c0c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 --2- 172.21.15.26:0/3319299113 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c152b00 0x7fc45c0c5e40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 -- 172.21.15.26:0/3319299113 >> 172.21.15.26:0/3319299113 conn(0x7fc45c0702c0 msgr2=0x7fc45c0cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 -- 172.21.15.26:0/3319299113 shutdown_connections 2024-04-21T09:29:43.668 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.662+0000 7fc4647d7640 1 -- 172.21.15.26:0/3319299113 wait complete. 2024-04-21T09:29:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 Processor -- start 2024-04-21T09:29:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 -- start start 2024-04-21T09:29:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc45c073a80 0x7fc45c1f19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc45c152b00 0x7fc45c148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c158ba0 0x7fc45c157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c0c71b0 con 0x7fc45c152b00 2024-04-21T09:29:43.671 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fc45c067d60 con 0x7fc45c073a80 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fc45c06cf70 con 0x7fc45c158ba0 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc45c152b00 0x7fc45c148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc45c152b00 0x7fc45c148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42846/0 (socket says 172.21.15.26:42846) 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 -- 172.21.15.26:0/919970099 learned_addr learned my addr 172.21.15.26:0/919970099 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc462573640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc45c073a80 0x7fc45c1f19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc462d74640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c158ba0 0x7fc45c157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 -- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c158ba0 msgr2=0x7fc45c157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c158ba0 0x7fc45c157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 -- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc45c073a80 msgr2=0x7fc45c1f19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc45c073a80 0x7fc45c1f19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 -- 172.21.15.26:0/919970099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc45c1f45f0 con 0x7fc45c152b00 2024-04-21T09:29:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc462d74640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c158ba0 0x7fc45c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc461d72640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc45c152b00 0x7fc45c148520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00e8a0 tx=0x7fc44c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc452ffd640 1 -- 172.21.15.26:0/919970099 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c017070 con 0x7fc45c152b00 2024-04-21T09:29:43.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc452ffd640 1 -- 172.21.15.26:0/919970099 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc44c00c940 con 0x7fc45c152b00 2024-04-21T09:29:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc45c1f48d0 con 0x7fc45c152b00 2024-04-21T09:29:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc452ffd640 1 -- 172.21.15.26:0/919970099 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc44c00ccf0 con 0x7fc45c152b00 2024-04-21T09:29:43.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc45c1f4e90 con 0x7fc45c152b00 2024-04-21T09:29:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.666+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc45c074320 con 0x7fc45c152b00 2024-04-21T09:29:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.670+0000 7fc452ffd640 1 -- 172.21.15.26:0/919970099 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc44c01a070 con 0x7fc45c152b00 2024-04-21T09:29:43.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.670+0000 7fc452ffd640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc440068380 0x7fc44006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.670+0000 7fc452ffd640 1 -- 172.21.15.26:0/919970099 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fc44c086bb0 con 0x7fc45c152b00 2024-04-21T09:29:43.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.670+0000 7fc462573640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc440068380 0x7fc44006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.670+0000 7fc462573640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc440068380 0x7fc44006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4580ae000 tx=0x7fc4580b3040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.674+0000 7fc452ffd640 1 -- 172.21.15.26:0/919970099 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc44c0571c0 con 0x7fc45c152b00 2024-04-21T09:29:43.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc45c06d280 con 0x7fc45c152b00 2024-04-21T09:29:43.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc452ffd640 1 -- 172.21.15.26:0/919970099 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) ==== 93+0+10 (secure 0 0 0) 0x7fc44c056ac0 con 0x7fc45c152b00 2024-04-21T09:29:43.831 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-21T09:29:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc440068380 msgr2=0x7fc44006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc440068380 0x7fc44006a840 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc4580ae000 tx=0x7fc4580b3040 comp rx=0 tx=0).stop 2024-04-21T09:29:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc45c152b00 msgr2=0x7fc45c148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc45c152b00 0x7fc45c148520 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc44c00e8a0 tx=0x7fc44c00eca0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 shutdown_connections 2024-04-21T09:29:43.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc45c158ba0 0x7fc45c157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fc440068380 0x7fc44006a840 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc45c152b00 0x7fc45c148520 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 --2- 172.21.15.26:0/919970099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc45c073a80 0x7fc45c1f19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 >> 172.21.15.26:0/919970099 conn(0x7fc45c0702c0 msgr2=0x7fc45c158fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 shutdown_connections 2024-04-21T09:29:43.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.830+0000 7fc4647d7640 1 -- 172.21.15.26:0/919970099 wait complete. 2024-04-21T09:29:43.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-21T09:29:43.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.974+0000 7fab2b0c7640 1 Processor -- start 2024-04-21T09:29:43.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.974+0000 7fab2b0c7640 1 -- start start 2024-04-21T09:29:43.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.974+0000 7fab2b0c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab24152e60 0x7fab240736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.974+0000 7fab2b0c7640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fab240c5e90 0x7fab24073be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.974+0000 7fab2b0c7640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab24153240 con 0x7fab240ccba0 2024-04-21T09:29:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.974+0000 7fab2b0c7640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7fab24158d10 con 0x7fab240c5e90 2024-04-21T09:29:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.974+0000 7fab2b0c7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab240c6b60 con 0x7fab24152e60 2024-04-21T09:29:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab28e63640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab24152e60 0x7fab240736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab29664640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fab240c5e90 0x7fab24073be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab23fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fab240ccba0 0x7fab241591a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:43050/0 (socket says 172.21.15.26:43050) 2024-04-21T09:29:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab28e63640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab24152e60 0x7fab240736a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.26:41084/0 (socket says 172.21.15.26:41084) 2024-04-21T09:29:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab23fff640 1 -- 172.21.15.26:0/3805498242 learned_addr learned my addr 172.21.15.26:0/3805498242 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:43.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab29664640 1 -- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab24152e60 msgr2=0x7fab240736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab29664640 1 --2- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab24152e60 0x7fab240736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab29664640 1 -- 172.21.15.26:0/3805498242 >> v1:172.21.15.169:6789/0 conn(0x7fab240ccba0 legacy=0x7fab241591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab29664640 1 -- 172.21.15.26:0/3805498242 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab240c3550 con 0x7fab240c5e90 2024-04-21T09:29:43.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab28e63640 1 --2- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab24152e60 0x7fab240736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-21T09:29:43.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.978+0000 7fab29664640 1 --2- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab240c5e90 0x7fab24073be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009d90 tx=0x7fab1c01f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c4927915c6ee11 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab237fe640 1 -- 172.21.15.26:0/3805498242 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0b4070 con 0x7fab240c5e90 2024-04-21T09:29:43.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab237fe640 1 -- 172.21.15.26:0/3805498242 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1c0af600 con 0x7fab240c5e90 2024-04-21T09:29:43.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab237fe640 1 -- 172.21.15.26:0/3805498242 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0af9d0 con 0x7fab240c5e90 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab240c5e90 msgr2=0x7fab24073be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab240c5e90 0x7fab24073be0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fab1c009d90 tx=0x7fab1c01f150 comp rx=0 tx=0).stop 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- 172.21.15.26:0/3805498242 shutdown_connections 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab240c5e90 0x7fab24073be0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/3805498242 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab24152e60 0x7fab240736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- 172.21.15.26:0/3805498242 >> 172.21.15.26:0/3805498242 conn(0x7fab240cbef0 msgr2=0x7fab240cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- 172.21.15.26:0/3805498242 shutdown_connections 2024-04-21T09:29:43.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- 172.21.15.26:0/3805498242 wait complete. 2024-04-21T09:29:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 Processor -- start 2024-04-21T09:29:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- start start 2024-04-21T09:29:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab240c5e90 0x7fab241f2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab240ccba0 0x7fab24157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab24152e60 0x7fab2414e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fab240c67b0 con 0x7fab240ccba0 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fab240c3b10 con 0x7fab24152e60 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fab241f2c90 con 0x7fab240c5e90 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab240ccba0 0x7fab24157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab240ccba0 0x7fab24157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42848/0 (socket says 172.21.15.26:42848) 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 -- 172.21.15.26:0/2034491618 learned_addr learned my addr 172.21.15.26:0/2034491618 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab29664640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab24152e60 0x7fab2414e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab28e63640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab240c5e90 0x7fab241f2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 -- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab240c5e90 msgr2=0x7fab241f2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab240c5e90 0x7fab241f2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 -- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab24152e60 msgr2=0x7fab2414e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab24152e60 0x7fab2414e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 -- 172.21.15.26:0/2034491618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab24153c00 con 0x7fab240ccba0 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab23fff640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab240ccba0 0x7fab24157d50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c430 tx=0x7fab1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab217fa640 1 -- 172.21.15.26:0/2034491618 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab10017070 con 0x7fab240ccba0 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab217fa640 1 -- 172.21.15.26:0/2034491618 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab10005cf0 con 0x7fab240ccba0 2024-04-21T09:29:43.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab24154a20 con 0x7fab240ccba0 2024-04-21T09:29:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab217fa640 1 -- 172.21.15.26:0/2034491618 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab100072f0 con 0x7fab240ccba0 2024-04-21T09:29:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.982+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab24154180 con 0x7fab240ccba0 2024-04-21T09:29:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.986+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab24074320 con 0x7fab240ccba0 2024-04-21T09:29:43.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.986+0000 7fab217fa640 1 -- 172.21.15.26:0/2034491618 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab1001a070 con 0x7fab240ccba0 2024-04-21T09:29:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.986+0000 7fab217fa640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fab08068380 0x7fab0806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.986+0000 7fab217fa640 1 -- 172.21.15.26:0/2034491618 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fab10085e00 con 0x7fab240ccba0 2024-04-21T09:29:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.986+0000 7fab28e63640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fab08068380 0x7fab0806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:43.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.986+0000 7fab28e63640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fab08068380 0x7fab0806a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab18009a50 tx=0x7fab18008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:43.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:43.990+0000 7fab217fa640 1 -- 172.21.15.26:0/2034491618 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fab10056380 con 0x7fab240ccba0 2024-04-21T09:29:44.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.146+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fab240c4000 con 0x7fab240ccba0 2024-04-21T09:29:44.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.146+0000 7fab217fa640 1 -- 172.21.15.26:0/2034491618 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v67) ==== 104+0+11 (secure 0 0 0) 0x7fab10055c80 con 0x7fab240ccba0 2024-04-21T09:29:44.150 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-21T09:29:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fab08068380 msgr2=0x7fab0806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fab08068380 0x7fab0806a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fab18009a50 tx=0x7fab18008040 comp rx=0 tx=0).stop 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab240ccba0 msgr2=0x7fab24157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab240ccba0 0x7fab24157d50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fab1000c430 tx=0x7fab1000c8f0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 shutdown_connections 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fab24152e60 0x7fab2414e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fab08068380 0x7fab0806a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab240ccba0 0x7fab24157d50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 --2- 172.21.15.26:0/2034491618 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fab240c5e90 0x7fab241f2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 >> 172.21.15.26:0/2034491618 conn(0x7fab240cbef0 msgr2=0x7fab24150690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:44.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 shutdown_connections 2024-04-21T09:29:44.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.150+0000 7fab2b0c7640 1 -- 172.21.15.26:0/2034491618 wait complete. 2024-04-21T09:29:44.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-21T09:29:44.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.290+0000 7fa2c37b0640 1 Processor -- start 2024-04-21T09:29:44.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c37b0640 1 -- start start 2024-04-21T09:29:44.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c37b0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2bc151fa0 0x7fa2bc15af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c37b0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2bc0bfbb0 con 0x7fa2bc0734a0 2024-04-21T09:29:44.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c37b0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2bc06ced0 con 0x7fa2bc151bc0 2024-04-21T09:29:44.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c37b0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa2bc06d1b0 con 0x7fa2bc151fa0 2024-04-21T09:29:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c0d4b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa2bc151fa0 0x7fa2bc15af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c1d4d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa2bc0734a0 0x7fa2bc15b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54744/0 (socket says 172.21.15.26:54744) 2024-04-21T09:29:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c1d4d640 1 -- 172.21.15.26:0/1311859912 learned_addr learned my addr 172.21.15.26:0/1311859912 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c0d4b640 1 -- 172.21.15.26:0/1311859912 >> v1:172.21.15.169:6789/0 conn(0x7fa2bc151bc0 legacy=0x7fa2bc072d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c0d4b640 1 -- 172.21.15.26:0/1311859912 >> v1:172.21.15.26:6789/0 conn(0x7fa2bc0734a0 legacy=0x7fa2bc15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c0d4b640 1 -- 172.21.15.26:0/1311859912 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc071fd0 con 0x7fa2bc151fa0 2024-04-21T09:29:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2c0d4b640 1 --2- 172.21.15.26:0/1311859912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151fa0 0x7fa2bc15af30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0097c0 tx=0x7fa2ac01c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b1e956e5d70a28 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.294+0000 7fa2b3fff640 1 -- 172.21.15.26:0/1311859912 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0b0070 con 0x7fa2bc151fa0 2024-04-21T09:29:44.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2b3fff640 1 -- 172.21.15.26:0/1311859912 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac0ab600 con 0x7fa2bc151fa0 2024-04-21T09:29:44.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2b3fff640 1 -- 172.21.15.26:0/1311859912 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0ab9d0 con 0x7fa2bc151fa0 2024-04-21T09:29:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- 172.21.15.26:0/1311859912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151fa0 msgr2=0x7fa2bc15af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/1311859912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151fa0 0x7fa2bc15af30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0097c0 tx=0x7fa2ac01c2f0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- 172.21.15.26:0/1311859912 shutdown_connections 2024-04-21T09:29:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/1311859912 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151fa0 0x7fa2bc15af30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- 172.21.15.26:0/1311859912 >> 172.21.15.26:0/1311859912 conn(0x7fa2bc0cbef0 msgr2=0x7fa2bc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- 172.21.15.26:0/1311859912 shutdown_connections 2024-04-21T09:29:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- 172.21.15.26:0/1311859912 wait complete. 2024-04-21T09:29:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 Processor -- start 2024-04-21T09:29:44.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- start start 2024-04-21T09:29:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2bc0734a0 0x7fa2bc14aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151bc0 0x7fa2bc142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2bc151fa0 0x7fa2bc143160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc072870 con 0x7fa2bc151bc0 2024-04-21T09:29:44.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc072590 con 0x7fa2bc0734a0 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7fa2bc06cb00 con 0x7fa2bc151fa0 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151bc0 0x7fa2bc142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151bc0 0x7fa2bc142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42864/0 (socket says 172.21.15.26:42864) 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 -- 172.21.15.26:0/316599443 learned_addr learned my addr 172.21.15.26:0/316599443 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 -- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2bc151fa0 msgr2=0x7fa2bc143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2bc151fa0 0x7fa2bc143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 -- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2bc0734a0 msgr2=0x7fa2bc14aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2bc0734a0 0x7fa2bc14aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 -- 172.21.15.26:0/316599443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc0c1b70 con 0x7fa2bc151bc0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c0d4b640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151bc0 0x7fa2bc142c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0ae040 tx=0x7fa2ac01ab30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2b1ffb640 1 -- 172.21.15.26:0/316599443 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0b0050 con 0x7fa2bc151bc0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2b1ffb640 1 -- 172.21.15.26:0/316599443 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ac0bc070 con 0x7fa2bc151bc0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc0c8010 con 0x7fa2bc151bc0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2b1ffb640 1 -- 172.21.15.26:0/316599443 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac0aac20 con 0x7fa2bc151bc0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.298+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc0c0570 con 0x7fa2bc151bc0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.302+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2bc074320 con 0x7fa2bc151bc0 2024-04-21T09:29:44.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.302+0000 7fa2b1ffb640 1 -- 172.21.15.26:0/316599443 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa2ac0c1460 con 0x7fa2bc151bc0 2024-04-21T09:29:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.302+0000 7fa2b1ffb640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2a0068380 0x7fa2a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.302+0000 7fa2b1ffb640 1 -- 172.21.15.26:0/316599443 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7fa2ac121640 con 0x7fa2bc151bc0 2024-04-21T09:29:44.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.302+0000 7fa2c154c640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2a0068380 0x7fa2a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.302+0000 7fa2c154c640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2a0068380 0x7fa2a006a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8007fd0 tx=0x7fa2b8007d40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.306+0000 7fa2b1ffb640 1 -- 172.21.15.26:0/316599443 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa2ac015fb0 con 0x7fa2bc151bc0 2024-04-21T09:29:44.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.466+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa2bc0c0da0 con 0x7fa2bc151bc0 2024-04-21T09:29:44.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2b1ffb640 1 -- 172.21.15.26:0/316599443 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v67) ==== 100+0+11 (secure 0 0 0) 0x7fa2ac0f1bc0 con 0x7fa2bc151bc0 2024-04-21T09:29:44.471 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-21T09:29:44.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2a0068380 msgr2=0x7fa2a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2a0068380 0x7fa2a006a840 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa2b8007fd0 tx=0x7fa2b8007d40 comp rx=0 tx=0).stop 2024-04-21T09:29:44.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151bc0 msgr2=0x7fa2bc142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151bc0 0x7fa2bc142c20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0ae040 tx=0x7fa2ac01ab30 comp rx=0 tx=0).stop 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 shutdown_connections 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa2bc151fa0 0x7fa2bc143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7fa2a0068380 0x7fa2a006a840 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa2bc151bc0 0x7fa2bc142c20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 --2- 172.21.15.26:0/316599443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2bc0734a0 0x7fa2bc14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 >> 172.21.15.26:0/316599443 conn(0x7fa2bc0cbef0 msgr2=0x7fa2bc14b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 shutdown_connections 2024-04-21T09:29:44.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.470+0000 7fa2c37b0640 1 -- 172.21.15.26:0/316599443 wait complete. 2024-04-21T09:29:44.490 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-21T09:29:44.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14b9fc6640 1 Processor -- start 2024-04-21T09:29:44.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14b9fc6640 1 -- start start 2024-04-21T09:29:44.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14b9fc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4152bf0 0x7f14b4159e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14b9fc6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14b4070870 0x7f14b41594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14b9fc6640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14b4070c90 con 0x7f14b40c8bc0 2024-04-21T09:29:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14b9fc6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f14b40c5250 con 0x7f14b4070870 2024-04-21T09:29:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14b9fc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f14b40c38e0 con 0x7f14b4152bf0 2024-04-21T09:29:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.610+0000 7f14abfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14b4070870 0x7f14b41594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b37fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4152bf0 0x7f14b4159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b3fff640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f14b40c8bc0 0x7f14b40ce150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.26:43072/0 (socket says 172.21.15.26:43072) 2024-04-21T09:29:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14abfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14b4070870 0x7f14b41594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42868/0 (socket says 172.21.15.26:42868) 2024-04-21T09:29:44.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b3fff640 1 -- 172.21.15.26:0/4127803596 learned_addr learned my addr 172.21.15.26:0/4127803596 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14abfff640 1 -- 172.21.15.26:0/4127803596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4152bf0 msgr2=0x7f14b4159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14abfff640 1 --2- 172.21.15.26:0/4127803596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4152bf0 0x7f14b4159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14abfff640 1 -- 172.21.15.26:0/4127803596 >> v1:172.21.15.169:6789/0 conn(0x7f14b40c8bc0 legacy=0x7f14b40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14abfff640 1 -- 172.21.15.26:0/4127803596 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b40c3320 con 0x7f14b4070870 2024-04-21T09:29:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14abfff640 1 --2- 172.21.15.26:0/4127803596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b4070870 0x7f14b41594e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f149c0097c0 tx=0x7f149c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2ef0a6a8b77753 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b2ffd640 1 -- 172.21.15.26:0/4127803596 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c0b0070 con 0x7f14b4070870 2024-04-21T09:29:44.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b2ffd640 1 -- 172.21.15.26:0/4127803596 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149c0ab600 con 0x7f14b4070870 2024-04-21T09:29:44.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b2ffd640 1 -- 172.21.15.26:0/4127803596 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c0ab9d0 con 0x7f14b4070870 2024-04-21T09:29:44.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 -- 172.21.15.26:0/4127803596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b4070870 msgr2=0x7f14b41594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/4127803596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b4070870 0x7f14b41594e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f149c0097c0 tx=0x7f149c01c4a0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 -- 172.21.15.26:0/4127803596 shutdown_connections 2024-04-21T09:29:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/4127803596 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b4070870 0x7f14b41594e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/4127803596 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4152bf0 0x7f14b4159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 -- 172.21.15.26:0/4127803596 >> 172.21.15.26:0/4127803596 conn(0x7f14b4067760 msgr2=0x7f14b4067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 -- 172.21.15.26:0/4127803596 shutdown_connections 2024-04-21T09:29:44.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.614+0000 7f14b9fc6640 1 -- 172.21.15.26:0/4127803596 wait complete. 2024-04-21T09:29:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 Processor -- start 2024-04-21T09:29:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 -- start start 2024-04-21T09:29:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4070870 0x7f14b40b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40c8bc0 0x7f14b415ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14b4152bf0 0x7f14b40b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f14b40c8fd0 con 0x7f14b40c8bc0 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f14b40703e0 con 0x7f14b4152bf0 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f14b40c9150 con 0x7f14b4070870 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40c8bc0 0x7f14b415ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40c8bc0 0x7f14b415ad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42870/0 (socket says 172.21.15.26:42870) 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 -- 172.21.15.26:0/922192371 learned_addr learned my addr 172.21.15.26:0/922192371 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b37fe640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4070870 0x7f14b40b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b3fff640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14b4152bf0 0x7f14b40b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 -- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4070870 msgr2=0x7f14b40b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4070870 0x7f14b40b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 -- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14b4152bf0 msgr2=0x7f14b40b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14b4152bf0 0x7f14b40b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 -- 172.21.15.26:0/922192371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b40caf10 con 0x7f14b40c8bc0 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14abfff640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40c8bc0 0x7f14b415ad90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f149c01a0d0 tx=0x7f149c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b0ff9640 1 -- 172.21.15.26:0/922192371 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c0ba070 con 0x7f14b40c8bc0 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b0ff9640 1 -- 172.21.15.26:0/922192371 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149c0b43f0 con 0x7f14b40c8bc0 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b0ff9640 1 -- 172.21.15.26:0/922192371 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c0b0040 con 0x7f14b40c8bc0 2024-04-21T09:29:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b40cb1f0 con 0x7f14b40c8bc0 2024-04-21T09:29:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b40b1d00 con 0x7f14b40c8bc0 2024-04-21T09:29:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.618+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b4074320 con 0x7f14b40c8bc0 2024-04-21T09:29:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.622+0000 7f14b0ff9640 1 -- 172.21.15.26:0/922192371 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f149c0bd070 con 0x7f14b40c8bc0 2024-04-21T09:29:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.622+0000 7f14b0ff9640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1494068380 0x7f149406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.622+0000 7f14b0ff9640 1 -- 172.21.15.26:0/922192371 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f149c11f9b0 con 0x7f14b40c8bc0 2024-04-21T09:29:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.622+0000 7f14b37fe640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1494068380 0x7f149406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.622+0000 7f14b37fe640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1494068380 0x7f149406a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009af0 tx=0x7f14a4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.626+0000 7f14b0ff9640 1 -- 172.21.15.26:0/922192371 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f149c016090 con 0x7f14b40c8bc0 2024-04-21T09:29:44.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.802+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f14b40cb3c0 con 0x7f14b40c8bc0 2024-04-21T09:29:44.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b0ff9640 1 -- 172.21.15.26:0/922192371 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v67) ==== 80+0+0 (secure 0 0 0) 0x7f149c0eff20 con 0x7f14b40c8bc0 2024-04-21T09:29:44.806 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-21T09:29:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1494068380 msgr2=0x7f149406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1494068380 0x7f149406a840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f14a4009af0 tx=0x7f14a4008040 comp rx=0 tx=0).stop 2024-04-21T09:29:44.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40c8bc0 msgr2=0x7f14b415ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40c8bc0 0x7f14b415ad90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f149c01a0d0 tx=0x7f149c019240 comp rx=0 tx=0).stop 2024-04-21T09:29:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 shutdown_connections 2024-04-21T09:29:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f14b4152bf0 0x7f14b40b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f1494068380 0x7f149406a840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14b40c8bc0 0x7f14b415ad90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 --2- 172.21.15.26:0/922192371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f14b4070870 0x7f14b40b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 >> 172.21.15.26:0/922192371 conn(0x7f14b4067760 msgr2=0x7f14b4067b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 shutdown_connections 2024-04-21T09:29:44.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.806+0000 7f14b9fc6640 1 -- 172.21.15.26:0/922192371 wait complete. 2024-04-21T09:29:44.827 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_fuse.py", line 175, in task yield all_mounts File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -110 (ETIMEDOUT) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/cephfs/mount.py", line 196, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType 2024-04-21T09:29:44.835 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-21T09:29:44.846 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-21T09:29:44.846 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T09:29:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e51997640 1 Processor -- start 2024-04-21T09:29:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e51997640 1 -- start start 2024-04-21T09:29:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e51997640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e4c0b3120 0x7f3e4c0c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e51997640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f3e4c15b100 0x7f3e4c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e51997640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e4c15ac40 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e51997640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4c15bab0 con 0x7f3e4c0b3120 2024-04-21T09:29:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e51997640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f3e4c06fb90 con 0x7f3e4c15b100 2024-04-21T09:29:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e4c0b3120 0x7f3e4c0c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4a7fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3e4c06f2e0 0x7f3e4c06caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54756/0 (socket says 172.21.15.26:54756) 2024-04-21T09:29:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4a7fc640 1 -- 172.21.15.26:0/2197974480 learned_addr learned my addr 172.21.15.26:0/2197974480 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:44.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4b7fe640 1 --2- 172.21.15.26:0/2197974480 >> v2:172.21.15.169:3300/0 conn(0x7f3e4c15b100 0x7f3e4c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4affd640 1 -- 172.21.15.26:0/2197974480 >> v2:172.21.15.169:3300/0 conn(0x7f3e4c15b100 msgr2=0x7f3e4c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4affd640 1 --2- 172.21.15.26:0/2197974480 >> v2:172.21.15.169:3300/0 conn(0x7f3e4c15b100 0x7f3e4c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4affd640 1 -- 172.21.15.26:0/2197974480 >> v1:172.21.15.26:6789/0 conn(0x7f3e4c06f2e0 legacy=0x7f3e4c06caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4affd640 1 -- 172.21.15.26:0/2197974480 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c0ce080 con 0x7f3e4c0b3120 2024-04-21T09:29:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e49ffb640 1 -- 172.21.15.26:0/2197974480 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123966297 0 0) 0x7f3e3c0014a0 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.974+0000 7f3e4b7fe640 1 --2- 172.21.15.26:0/2197974480 >> v2:172.21.15.169:3300/0 conn(0x7f3e4c15b100 0x7f3e4c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-21T09:29:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e4affd640 1 --2- 172.21.15.26:0/2197974480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c0c8b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c06e040 tx=0x7f3e3401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d0dd17ad839c75 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e49ffb640 1 -- 172.21.15.26:0/2197974480 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e340b5070 con 0x7f3e4c0b3120 2024-04-21T09:29:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e49ffb640 1 -- 172.21.15.26:0/2197974480 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e340a8970 con 0x7f3e4c0b3120 2024-04-21T09:29:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e49ffb640 1 -- 172.21.15.26:0/2197974480 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e340a8d40 con 0x7f3e4c0b3120 2024-04-21T09:29:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 -- 172.21.15.26:0/2197974480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c0b3120 msgr2=0x7f3e4c0c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 --2- 172.21.15.26:0/2197974480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c0c8b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c06e040 tx=0x7f3e3401ec70 comp rx=0 tx=0).stop 2024-04-21T09:29:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 -- 172.21.15.26:0/2197974480 shutdown_connections 2024-04-21T09:29:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 --2- 172.21.15.26:0/2197974480 >> v2:172.21.15.169:3300/0 conn(0x7f3e4c15b100 0x7f3e4c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 --2- 172.21.15.26:0/2197974480 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c0c8b50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 -- 172.21.15.26:0/2197974480 >> 172.21.15.26:0/2197974480 conn(0x7f3e4c067760 msgr2=0x7f3e4c067b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 -- 172.21.15.26:0/2197974480 shutdown_connections 2024-04-21T09:29:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.978+0000 7f3e51997640 1 -- 172.21.15.26:0/2197974480 wait complete. 2024-04-21T09:29:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 Processor -- start 2024-04-21T09:29:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 -- start start 2024-04-21T09:29:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c06f2e0 0x7f3e4c1f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e4c15b100 0x7f3e4c14d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0ce920 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0ce640 con 0x7f3e4c0b3120 2024-04-21T09:29:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c0b3500 con 0x7f3e4c15b100 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c06f2e0 0x7f3e4c1f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c06f2e0 0x7f3e4c1f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42882/0 (socket says 172.21.15.26:42882) 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 -- 172.21.15.26:0/2177006133 learned_addr learned my addr 172.21.15.26:0/2177006133 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4b7fe640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e4c15b100 0x7f3e4c14d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4a7fc640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 -- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e4c15b100 msgr2=0x7f3e4c14d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e4c15b100 0x7f3e4c14d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 -- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e4c0b3120 msgr2=0x7f3e4c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 -- 172.21.15.26:0/2177006133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c1523d0 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4a7fc640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-21T09:29:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e4affd640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c06f2e0 0x7f3e4c1f1680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e340b3040 tx=0x7f3e3401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e43fff640 1 -- 172.21.15.26:0/2177006133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e340bf070 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e43fff640 1 -- 172.21.15.26:0/2177006133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e340b0740 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e43fff640 1 -- 172.21.15.26:0/2177006133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e340b5040 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c1e8220 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c14c4a0 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c075ef0 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.982+0000 7f3e43fff640 1 -- 172.21.15.26:0/2177006133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e340c2070 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.986+0000 7f3e43fff640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3e2c068380 0x7f3e2c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.986+0000 7f3e43fff640 1 -- 172.21.15.26:0/2177006133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f3e34123250 con 0x7f3e4c06f2e0 2024-04-21T09:29:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.986+0000 7f3e4a7fc640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3e2c068380 0x7f3e2c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.986+0000 7f3e4a7fc640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3e2c068380 0x7f3e2c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c001740 tx=0x7f3e3c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:44.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:44.990+0000 7f3e43fff640 1 -- 172.21.15.26:0/2177006133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e340187d0 con 0x7f3e4c06f2e0 2024-04-21T09:29:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.146+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e4c0c8520 con 0x7f3e2c068380 2024-04-21T09:29:45.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.166+0000 7f3e43fff640 1 -- 172.21.15.26:0/2177006133 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+256918 (secure 0 0 0) 0x7f3e4c0c8520 con 0x7f3e2c068380 2024-04-21T09:29:45.170 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:45.172 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T09:29:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3e2c068380 msgr2=0x7f3e2c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3e2c068380 0x7f3e2c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c001740 tx=0x7f3e3c009040 comp rx=0 tx=0).stop 2024-04-21T09:29:45.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c06f2e0 msgr2=0x7f3e4c1f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c06f2e0 0x7f3e4c1f1680 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3e340b3040 tx=0x7f3e3401ba10 comp rx=0 tx=0).stop 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 shutdown_connections 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3e4c15b100 0x7f3e4c14d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3e4c0b3120 0x7f3e4c150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f3e2c068380 0x7f3e2c06a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 --2- 172.21.15.26:0/2177006133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e4c06f2e0 0x7f3e4c1f1680 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 >> 172.21.15.26:0/2177006133 conn(0x7f3e4c067760 msgr2=0x7f3e4c0cd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 shutdown_connections 2024-04-21T09:29:45.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.170+0000 7f3e51997640 1 -- 172.21.15.26:0/2177006133 wait complete. 2024-04-21T09:29:45.189 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":1024,"stamp":"2024-04-21T09:29:43.843814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":677079726,"num_objects":3958,"num_object_clones":50,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3958,"num_whiteouts":50,"num_read":41813,"num_read_kb":2031800,"num_write":105597,"num_write_kb":5137267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1324,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157333,"ondisk_log_size":157333,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1495544,"kb_used_data":302776,"kb_used_omap":12,"kb_used_meta":1192691,"kb_avail":753479176,"statfs":{"total":773094113280,"available":771562676224,"internally_reserved":0,"allocated":310042624,"data_stored":1352877068,"data_compressed":202371992,"data_compressed_allocated":244379648,"data_compressed_original":1302302720,"omap_allocated":12751,"internal_metadata":1221316145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7920650,"num_objects":226,"num_object_clones":50,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":226,"num_whiteouts":50,"num_read":7,"num_read_kb":13,"num_write":306,"num_write_kb":8054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004590"},"pg_stats":[{"pgid":"3.3f","version":"67'1976","reported_seq":5166,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.338469+0000","last_change":"2024-04-21T09:28:45.808023+0000","last_active":"2024-04-21T09:29:36.338469+0000","last_peered":"2024-04-21T09:29:36.338469+0000","last_clean":"2024-04-21T09:29:36.338469+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T09:29:36.338469+0000","last_undegraded":"2024-04-21T09:29:36.338469+0000","last_fullsized":"2024-04-21T09:29:36.338469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:27:26.225041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0643233040000002,"stat_sum":{"num_bytes":502677,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":352,"num_read_kb":22087,"num_write":1205,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"67'1967","reported_seq":5124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.891517+0000","last_change":"2024-04-21T09:28:45.682471+0000","last_active":"2024-04-21T09:29:36.891517+0000","last_peered":"2024-04-21T09:29:36.891517+0000","last_clean":"2024-04-21T09:29:36.891517+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T09:29:36.891517+0000","last_undegraded":"2024-04-21T09:29:36.891517+0000","last_fullsized":"2024-04-21T09:29:36.891517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":1967,"log_dups_size":0,"ondisk_log_size":1967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:34:15.568475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9328418279999999,"stat_sum":{"num_bytes":505908,"num_objects":27,"num_object_clones":1,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":1,"num_read":340,"num_read_kb":38857,"num_write":1145,"num_write_kb":55958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"67'2118","reported_seq":5325,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.721312+0000","last_change":"2024-04-21T09:28:45.603908+0000","last_active":"2024-04-21T09:29:36.721312+0000","last_peered":"2024-04-21T09:29:36.721312+0000","last_clean":"2024-04-21T09:29:36.721312+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T09:29:36.721312+0000","last_undegraded":"2024-04-21T09:29:36.721312+0000","last_fullsized":"2024-04-21T09:29:36.721312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:22:47.835176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.860021943,"stat_sum":{"num_bytes":4940571,"num_objects":41,"num_object_clones":1,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":1,"num_read":403,"num_read_kb":42077,"num_write":1289,"num_write_kb":62942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"67'2146","reported_seq":5472,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.792866+0000","last_change":"2024-04-21T09:28:44.726765+0000","last_active":"2024-04-21T09:29:40.792866+0000","last_peered":"2024-04-21T09:29:40.792866+0000","last_clean":"2024-04-21T09:29:40.792866+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T09:29:40.792866+0000","last_undegraded":"2024-04-21T09:29:40.792866+0000","last_fullsized":"2024-04-21T09:29:40.792866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:41:04.840117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.959635896,"stat_sum":{"num_bytes":441508,"num_objects":37,"num_object_clones":2,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":547,"num_read_kb":34802,"num_write":1270,"num_write_kb":47093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"67'2298","reported_seq":5638,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.647029+0000","last_change":"2024-04-21T09:28:45.663584+0000","last_active":"2024-04-21T09:29:36.647029+0000","last_peered":"2024-04-21T09:29:36.647029+0000","last_clean":"2024-04-21T09:29:36.647029+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T09:29:36.647029+0000","last_undegraded":"2024-04-21T09:29:36.647029+0000","last_fullsized":"2024-04-21T09:29:36.647029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:08:37.989572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.921205912,"stat_sum":{"num_bytes":156079,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":599,"num_read_kb":39674,"num_write":1344,"num_write_kb":54131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"67'2003","reported_seq":5102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.598512+0000","last_change":"2024-04-21T09:28:44.691139+0000","last_active":"2024-04-21T09:29:35.598512+0000","last_peered":"2024-04-21T09:29:35.598512+0000","last_clean":"2024-04-21T09:29:35.598512+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T09:29:35.598512+0000","last_undegraded":"2024-04-21T09:29:35.598512+0000","last_fullsized":"2024-04-21T09:29:35.598512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2003,"log_dups_size":0,"ondisk_log_size":2003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:53.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.924815653,"stat_sum":{"num_bytes":1113393,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":288,"num_read_kb":38543,"num_write":1179,"num_write_kb":50375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"67'2110","reported_seq":5924,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.324414+0000","last_change":"2024-04-21T09:28:43.594707+0000","last_active":"2024-04-21T09:29:36.324414+0000","last_peered":"2024-04-21T09:29:36.324414+0000","last_clean":"2024-04-21T09:29:36.324414+0000","last_became_active":"2024-04-21T08:58:32.691443+0000","last_became_peered":"2024-04-21T08:58:32.691443+0000","last_unstale":"2024-04-21T09:29:36.324414+0000","last_undegraded":"2024-04-21T09:29:36.324414+0000","last_fullsized":"2024-04-21T09:29:36.324414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:04.800718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.80746012599999994,"stat_sum":{"num_bytes":568893,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1027,"num_read_kb":52226,"num_write":1264,"num_write_kb":62955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"67'2006","reported_seq":5980,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.869122+0000","last_change":"2024-04-21T09:28:45.614210+0000","last_active":"2024-04-21T09:29:36.869122+0000","last_peered":"2024-04-21T09:29:36.869122+0000","last_clean":"2024-04-21T09:29:36.869122+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T09:29:36.869122+0000","last_undegraded":"2024-04-21T09:29:36.869122+0000","last_fullsized":"2024-04-21T09:29:36.869122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:06:23.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8701777609999999,"stat_sum":{"num_bytes":537300,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":1150,"num_read_kb":33023,"num_write":1229,"num_write_kb":54712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"67'2150","reported_seq":5388,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.824051+0000","last_change":"2024-04-21T09:28:44.075556+0000","last_active":"2024-04-21T09:29:36.824051+0000","last_peered":"2024-04-21T09:29:36.824051+0000","last_clean":"2024-04-21T09:29:36.824051+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T09:29:36.824051+0000","last_undegraded":"2024-04-21T09:29:36.824051+0000","last_fullsized":"2024-04-21T09:29:36.824051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2150,"log_dups_size":0,"ondisk_log_size":2150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:44:27.626872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.288225602,"stat_sum":{"num_bytes":780489,"num_objects":33,"num_object_clones":1,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":459,"num_read_kb":22355,"num_write":1259,"num_write_kb":31073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"67'2045","reported_seq":4954,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:13.996098+0000","last_change":"2024-04-21T09:28:45.793666+0000","last_active":"2024-04-21T09:29:13.996098+0000","last_peered":"2024-04-21T09:29:13.996098+0000","last_clean":"2024-04-21T09:29:13.996098+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T09:29:13.996098+0000","last_undegraded":"2024-04-21T09:29:13.996098+0000","last_fullsized":"2024-04-21T09:29:13.996098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:59:26.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0506586059999998,"stat_sum":{"num_bytes":886801,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":115,"num_read_kb":25524,"num_write":1193,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"67'2190","reported_seq":5535,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:13.996052+0000","last_change":"2024-04-21T09:28:45.729189+0000","last_active":"2024-04-21T09:29:13.996052+0000","last_peered":"2024-04-21T09:29:13.996052+0000","last_clean":"2024-04-21T09:29:13.996052+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T09:29:13.996052+0000","last_undegraded":"2024-04-21T09:29:13.996052+0000","last_fullsized":"2024-04-21T09:29:13.996052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2190,"log_dups_size":0,"ondisk_log_size":2190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:20:55.197831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9863790639999999,"stat_sum":{"num_bytes":512628,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":582,"num_read_kb":27956,"num_write":1285,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"67'2136","reported_seq":5478,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.536784+0000","last_change":"2024-04-21T09:28:45.754426+0000","last_active":"2024-04-21T09:29:36.536784+0000","last_peered":"2024-04-21T09:29:36.536784+0000","last_clean":"2024-04-21T09:29:36.536784+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T09:29:36.536784+0000","last_undegraded":"2024-04-21T09:29:36.536784+0000","last_fullsized":"2024-04-21T09:29:36.536784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2136,"log_dups_size":0,"ondisk_log_size":2136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:14:29.919258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0119082499999998,"stat_sum":{"num_bytes":124574,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":573,"num_read_kb":30723,"num_write":1237,"num_write_kb":59298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"67'2104","reported_seq":5571,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:39.772658+0000","last_change":"2024-04-21T09:28:44.334415+0000","last_active":"2024-04-21T09:29:39.772658+0000","last_peered":"2024-04-21T09:29:39.772658+0000","last_clean":"2024-04-21T09:29:39.772658+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T09:29:39.772658+0000","last_undegraded":"2024-04-21T09:29:39.772658+0000","last_fullsized":"2024-04-21T09:29:39.772658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:05.033551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.565899868,"stat_sum":{"num_bytes":469288,"num_objects":52,"num_object_clones":2,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":2,"num_read":685,"num_read_kb":43798,"num_write":1205,"num_write_kb":56104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"67'2110","reported_seq":5862,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.794436+0000","last_change":"2024-04-21T09:28:44.286645+0000","last_active":"2024-04-21T09:29:40.794436+0000","last_peered":"2024-04-21T09:29:40.794436+0000","last_clean":"2024-04-21T09:29:40.794436+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T09:29:40.794436+0000","last_undegraded":"2024-04-21T09:29:40.794436+0000","last_fullsized":"2024-04-21T09:29:40.794436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:36:24.613204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.525286513,"stat_sum":{"num_bytes":304275,"num_objects":32,"num_object_clones":3,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":3,"num_read":963,"num_read_kb":23936,"num_write":1250,"num_write_kb":37373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"67'2141","reported_seq":6625,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.766621+0000","last_change":"2024-04-21T09:28:45.623954+0000","last_active":"2024-04-21T09:29:36.766621+0000","last_peered":"2024-04-21T09:29:36.766621+0000","last_clean":"2024-04-21T09:29:36.766621+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T09:29:36.766621+0000","last_undegraded":"2024-04-21T09:29:36.766621+0000","last_fullsized":"2024-04-21T09:29:36.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:21:00.996466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8799607360000001,"stat_sum":{"num_bytes":417227,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1695,"num_read_kb":52415,"num_write":1270,"num_write_kb":61138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"67'2100","reported_seq":6185,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:04.038636+0000","last_change":"2024-04-21T09:28:45.850347+0000","last_active":"2024-04-21T09:29:04.038636+0000","last_peered":"2024-04-21T09:29:04.038636+0000","last_clean":"2024-04-21T09:29:04.038636+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T09:29:04.038636+0000","last_undegraded":"2024-04-21T09:29:04.038636+0000","last_fullsized":"2024-04-21T09:29:04.038636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:42:25.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0582485780000002,"stat_sum":{"num_bytes":1249894,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":1288,"num_read_kb":34743,"num_write":1255,"num_write_kb":54320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"67'2199","reported_seq":5083,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.974803+0000","last_change":"2024-04-21T09:28:45.958125+0000","last_active":"2024-04-21T09:29:35.974803+0000","last_peered":"2024-04-21T09:29:35.974803+0000","last_clean":"2024-04-21T09:29:35.974803+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T09:29:35.974803+0000","last_undegraded":"2024-04-21T09:29:35.974803+0000","last_fullsized":"2024-04-21T09:29:35.974803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2199,"log_dups_size":0,"ondisk_log_size":2199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:13.513878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1537557870000001,"stat_sum":{"num_bytes":141554,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":112,"num_read_kb":17137,"num_write":1304,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"67'2059","reported_seq":5991,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.802839+0000","last_change":"2024-04-21T09:28:43.599747+0000","last_active":"2024-04-21T09:29:40.802839+0000","last_peered":"2024-04-21T09:29:40.802839+0000","last_clean":"2024-04-21T09:29:40.802839+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T09:29:40.802839+0000","last_undegraded":"2024-04-21T09:29:40.802839+0000","last_fullsized":"2024-04-21T09:29:40.802839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:49:28.524290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.81275123299999996,"stat_sum":{"num_bytes":768636,"num_objects":39,"num_object_clones":3,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":3,"num_read":1145,"num_read_kb":44755,"num_write":1183,"num_write_kb":52539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"67'2213","reported_seq":6399,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.742921+0000","last_change":"2024-04-21T09:28:45.983997+0000","last_active":"2024-04-21T09:29:35.742921+0000","last_peered":"2024-04-21T09:29:35.742921+0000","last_clean":"2024-04-21T09:29:35.742921+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T09:29:35.742921+0000","last_undegraded":"2024-04-21T09:29:35.742921+0000","last_fullsized":"2024-04-21T09:29:35.742921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2213,"log_dups_size":0,"ondisk_log_size":2213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:21:48.421213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.178589391,"stat_sum":{"num_bytes":222526,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1423,"num_read_kb":51823,"num_write":1303,"num_write_kb":61673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"67'2122","reported_seq":5055,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:18.996867+0000","last_change":"2024-04-21T09:28:45.715848+0000","last_active":"2024-04-21T09:29:18.996867+0000","last_peered":"2024-04-21T09:29:18.996867+0000","last_clean":"2024-04-21T09:29:18.996867+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T09:29:18.996867+0000","last_undegraded":"2024-04-21T09:29:18.996867+0000","last_fullsized":"2024-04-21T09:29:18.996867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2122,"log_dups_size":0,"ondisk_log_size":2122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:28:46.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.973257233,"stat_sum":{"num_bytes":457598,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":140,"num_read_kb":25252,"num_write":1260,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"67'2103","reported_seq":4972,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.810038+0000","last_change":"2024-04-21T09:28:44.201893+0000","last_active":"2024-04-21T09:29:40.810038+0000","last_peered":"2024-04-21T09:29:40.810038+0000","last_clean":"2024-04-21T09:29:40.810038+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T09:29:40.810038+0000","last_undegraded":"2024-04-21T09:29:40.810038+0000","last_fullsized":"2024-04-21T09:29:40.810038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:36:24.613204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.455701914,"stat_sum":{"num_bytes":448493,"num_objects":42,"num_object_clones":2,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":86,"num_read_kb":5325,"num_write":1236,"num_write_kb":17334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"67'2219","reported_seq":5255,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.696596+0000","last_change":"2024-04-21T09:28:44.030220+0000","last_active":"2024-04-21T09:29:36.696596+0000","last_peered":"2024-04-21T09:29:36.696596+0000","last_clean":"2024-04-21T09:29:36.696596+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T09:29:36.696596+0000","last_undegraded":"2024-04-21T09:29:36.696596+0000","last_fullsized":"2024-04-21T09:29:36.696596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2219,"log_dups_size":0,"ondisk_log_size":2219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:28.530777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.2438301680000001,"stat_sum":{"num_bytes":94707,"num_objects":29,"num_object_clones":1,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":1,"num_read":274,"num_read_kb":28972,"num_write":1307,"num_write_kb":44070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"67'2062","reported_seq":5414,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.883671+0000","last_change":"2024-04-21T09:28:45.578589+0000","last_active":"2024-04-21T09:29:36.883671+0000","last_peered":"2024-04-21T09:29:36.883671+0000","last_clean":"2024-04-21T09:29:36.883671+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T09:29:36.883671+0000","last_undegraded":"2024-04-21T09:29:36.883671+0000","last_fullsized":"2024-04-21T09:29:36.883671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:35.516268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8341122309999998,"stat_sum":{"num_bytes":200823,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":552,"num_read_kb":30111,"num_write":1222,"num_write_kb":38022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"67'2083","reported_seq":5187,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.698787+0000","last_change":"2024-04-21T09:28:45.850276+0000","last_active":"2024-04-21T09:29:03.698787+0000","last_peered":"2024-04-21T09:29:03.698787+0000","last_clean":"2024-04-21T09:29:03.698787+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T09:29:03.698787+0000","last_undegraded":"2024-04-21T09:29:03.698787+0000","last_fullsized":"2024-04-21T09:29:03.698787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2083,"log_dups_size":0,"ondisk_log_size":2083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:35.516268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.057834615,"stat_sum":{"num_bytes":660086,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":300,"num_read_kb":20512,"num_write":1241,"num_write_kb":34965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"67'2054","reported_seq":6083,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.862211+0000","last_change":"2024-04-21T09:28:45.708941+0000","last_active":"2024-04-21T09:29:36.862211+0000","last_peered":"2024-04-21T09:29:36.862211+0000","last_clean":"2024-04-21T09:29:36.862211+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T09:29:36.862211+0000","last_undegraded":"2024-04-21T09:29:36.862211+0000","last_fullsized":"2024-04-21T09:29:36.862211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:11.310198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9586817540000001,"stat_sum":{"num_bytes":1445526,"num_objects":44,"num_object_clones":1,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":1,"num_read":1219,"num_read_kb":60063,"num_write":1227,"num_write_kb":71441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"67'2177","reported_seq":5205,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.815972+0000","last_change":"2024-04-21T09:28:44.774942+0000","last_active":"2024-04-21T09:29:40.815972+0000","last_peered":"2024-04-21T09:29:40.815972+0000","last_clean":"2024-04-21T09:29:40.815972+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T09:29:40.815972+0000","last_undegraded":"2024-04-21T09:29:40.815972+0000","last_fullsized":"2024-04-21T09:29:40.815972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2177,"log_dups_size":0,"ondisk_log_size":2177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:29:49.619769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.007323854,"stat_sum":{"num_bytes":512918,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":3,"num_read":235,"num_read_kb":26618,"num_write":1322,"num_write_kb":39117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"67'1959","reported_seq":5516,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.746559+0000","last_change":"2024-04-21T09:28:44.334410+0000","last_active":"2024-04-21T09:29:36.746559+0000","last_peered":"2024-04-21T09:29:36.746559+0000","last_clean":"2024-04-21T09:29:36.746559+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T09:29:36.746559+0000","last_undegraded":"2024-04-21T09:29:36.746559+0000","last_fullsized":"2024-04-21T09:29:36.746559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:49.352592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5644472729999999,"stat_sum":{"num_bytes":2949062,"num_objects":40,"num_object_clones":1,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":1,"num_read":716,"num_read_kb":28488,"num_write":1192,"num_write_kb":51795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"67'2069","reported_seq":5037,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.835617+0000","last_change":"2024-04-21T09:28:44.316505+0000","last_active":"2024-04-21T09:29:35.835617+0000","last_peered":"2024-04-21T09:29:35.835617+0000","last_clean":"2024-04-21T09:29:35.835617+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T09:29:35.835617+0000","last_undegraded":"2024-04-21T09:29:35.835617+0000","last_fullsized":"2024-04-21T09:29:35.835617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2069,"log_dups_size":0,"ondisk_log_size":2069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:59:31.726512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5495412690000001,"stat_sum":{"num_bytes":1001324,"num_objects":44,"num_object_clones":1,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":1,"num_read":167,"num_read_kb":32562,"num_write":1243,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"67'2271","reported_seq":5890,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.267783+0000","last_change":"2024-04-21T09:28:45.648220+0000","last_active":"2024-04-21T09:29:36.267783+0000","last_peered":"2024-04-21T09:29:36.267783+0000","last_clean":"2024-04-21T09:29:36.267783+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T09:29:36.267783+0000","last_undegraded":"2024-04-21T09:29:36.267783+0000","last_fullsized":"2024-04-21T09:29:36.267783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2271,"log_dups_size":0,"ondisk_log_size":2271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:59:21.088123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9028510230000002,"stat_sum":{"num_bytes":617957,"num_objects":42,"num_object_clones":1,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":1,"num_read":867,"num_read_kb":32016,"num_write":1336,"num_write_kb":41863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"67'2070","reported_seq":4992,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.410703+0000","last_change":"2024-04-21T09:28:45.908865+0000","last_active":"2024-04-21T09:29:03.410703+0000","last_peered":"2024-04-21T09:29:03.410703+0000","last_clean":"2024-04-21T09:29:03.410703+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T09:29:03.410703+0000","last_undegraded":"2024-04-21T09:29:03.410703+0000","last_fullsized":"2024-04-21T09:29:03.410703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:34:15.568475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1077100120000001,"stat_sum":{"num_bytes":495958,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":113,"num_read_kb":16753,"num_write":1234,"num_write_kb":25261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"67'2203","reported_seq":5597,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.387979+0000","last_change":"2024-04-21T09:28:43.573426+0000","last_active":"2024-04-21T09:29:36.387979+0000","last_peered":"2024-04-21T09:29:36.387979+0000","last_clean":"2024-04-21T09:29:36.387979+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T09:29:36.387979+0000","last_undegraded":"2024-04-21T09:29:36.387979+0000","last_fullsized":"2024-04-21T09:29:36.387979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:10:15.081587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.79063146299999998,"stat_sum":{"num_bytes":284339,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":606,"num_read_kb":35939,"num_write":1331,"num_write_kb":55388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"67'2125","reported_seq":5852,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.797142+0000","last_change":"2024-04-21T09:28:44.716171+0000","last_active":"2024-04-21T09:29:40.797142+0000","last_peered":"2024-04-21T09:29:40.797142+0000","last_clean":"2024-04-21T09:29:40.797142+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T09:29:40.797142+0000","last_undegraded":"2024-04-21T09:29:40.797142+0000","last_fullsized":"2024-04-21T09:29:40.797142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:21.917758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.950351495,"stat_sum":{"num_bytes":563723,"num_objects":44,"num_object_clones":4,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":4,"num_read":921,"num_read_kb":31125,"num_write":1290,"num_write_kb":49562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"67'2187","reported_seq":6187,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.789067+0000","last_change":"2024-04-21T09:28:44.057277+0000","last_active":"2024-04-21T09:29:40.789067+0000","last_peered":"2024-04-21T09:29:40.789067+0000","last_clean":"2024-04-21T09:29:40.789067+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T09:29:40.789067+0000","last_undegraded":"2024-04-21T09:29:40.789067+0000","last_fullsized":"2024-04-21T09:29:40.789067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2187,"log_dups_size":0,"ondisk_log_size":2187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:06:22.193296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.2705725050000001,"stat_sum":{"num_bytes":1126596,"num_objects":32,"num_object_clones":2,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":2,"num_read":1237,"num_read_kb":21520,"num_write":1295,"num_write_kb":35547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"67'411","reported_seq":529,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.223843+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T09:29:07.223843+0000","last_peered":"2024-04-21T09:29:07.223843+0000","last_clean":"2024-04-21T09:29:07.223843+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T09:29:07.223843+0000","last_undegraded":"2024-04-21T09:29:07.223843+0000","last_fullsized":"2024-04-21T09:29:07.223843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":480,"num_write_kb":91602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"67'2106","reported_seq":6021,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.496934+0000","last_change":"2024-04-21T09:28:44.227226+0000","last_active":"2024-04-21T09:29:36.496934+0000","last_peered":"2024-04-21T09:29:36.496934+0000","last_clean":"2024-04-21T09:29:36.496934+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T09:29:36.496934+0000","last_undegraded":"2024-04-21T09:29:36.496934+0000","last_fullsized":"2024-04-21T09:29:36.496934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:05.033551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.480693611,"stat_sum":{"num_bytes":3592250,"num_objects":46,"num_object_clones":1,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":1,"num_read":1146,"num_read_kb":42643,"num_write":1207,"num_write_kb":60731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"67'777","reported_seq":895,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:52.366874+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T09:28:52.366874+0000","last_peered":"2024-04-21T09:28:52.366874+0000","last_clean":"2024-04-21T09:28:52.366874+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T09:28:52.366874+0000","last_undegraded":"2024-04-21T09:28:52.366874+0000","last_fullsized":"2024-04-21T09:28:52.366874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":819,"num_write_kb":74968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"67'484","reported_seq":603,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:21.182417+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T09:29:21.182417+0000","last_peered":"2024-04-21T09:29:21.182417+0000","last_clean":"2024-04-21T09:29:21.182417+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T09:29:21.182417+0000","last_undegraded":"2024-04-21T09:29:21.182417+0000","last_fullsized":"2024-04-21T09:29:21.182417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":515,"num_write_kb":58268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"67'2356","reported_seq":6347,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.260102+0000","last_change":"2024-04-21T09:28:45.660108+0000","last_active":"2024-04-21T09:29:36.260102+0000","last_peered":"2024-04-21T09:29:36.260102+0000","last_clean":"2024-04-21T09:29:36.260102+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T09:29:36.260102+0000","last_undegraded":"2024-04-21T09:29:36.260102+0000","last_fullsized":"2024-04-21T09:29:36.260102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2356,"log_dups_size":0,"ondisk_log_size":2356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:34:03.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9155152749999997,"stat_sum":{"num_bytes":451226,"num_objects":32,"num_object_clones":1,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":1,"num_read":1252,"num_read_kb":46571,"num_write":1378,"num_write_kb":62029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"67'633","reported_seq":752,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.224340+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T09:29:07.224340+0000","last_peered":"2024-04-21T09:29:07.224340+0000","last_clean":"2024-04-21T09:29:07.224340+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T09:29:07.224340+0000","last_undegraded":"2024-04-21T09:29:07.224340+0000","last_fullsized":"2024-04-21T09:29:07.224340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":691,"num_write_kb":79355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"67'2079","reported_seq":5751,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.772518+0000","last_change":"2024-04-21T09:28:44.135791+0000","last_active":"2024-04-21T09:29:40.772518+0000","last_peered":"2024-04-21T09:29:40.772518+0000","last_clean":"2024-04-21T09:29:40.772518+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T09:29:40.772518+0000","last_undegraded":"2024-04-21T09:29:40.772518+0000","last_fullsized":"2024-04-21T09:29:40.772518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:59:45.792713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.389896875,"stat_sum":{"num_bytes":622844,"num_objects":43,"num_object_clones":2,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":2,"num_read":869,"num_read_kb":53696,"num_write":1245,"num_write_kb":66193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"67'549","reported_seq":912,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.766497+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T09:29:40.766497+0000","last_peered":"2024-04-21T09:29:40.766497+0000","last_clean":"2024-04-21T09:29:40.766497+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T09:29:40.766497+0000","last_undegraded":"2024-04-21T09:29:40.766497+0000","last_fullsized":"2024-04-21T09:29:40.766497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17381537,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":278,"num_read_kb":760,"num_write":598,"num_write_kb":63071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"67'2026","reported_seq":4972,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.345887+0000","last_change":"2024-04-21T09:28:44.761232+0000","last_active":"2024-04-21T09:29:36.345887+0000","last_peered":"2024-04-21T09:29:36.345887+0000","last_clean":"2024-04-21T09:29:36.345887+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T09:29:36.345887+0000","last_undegraded":"2024-04-21T09:29:36.345887+0000","last_fullsized":"2024-04-21T09:29:36.345887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:40:27.856651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.9933246900000001,"stat_sum":{"num_bytes":100042,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":120,"num_read_kb":21461,"num_write":1227,"num_write_kb":33815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"67'791","reported_seq":910,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.654947+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T09:29:38.654947+0000","last_peered":"2024-04-21T09:29:38.654947+0000","last_clean":"2024-04-21T09:29:38.654947+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T09:29:38.654947+0000","last_undegraded":"2024-04-21T09:29:38.654947+0000","last_fullsized":"2024-04-21T09:29:38.654947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":816,"num_write_kb":86913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"67'2489","reported_seq":5809,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.372829+0000","last_change":"2024-04-21T09:28:45.691870+0000","last_active":"2024-04-21T09:29:36.372829+0000","last_peered":"2024-04-21T09:29:36.372829+0000","last_clean":"2024-04-21T09:29:36.372829+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T09:29:36.372829+0000","last_undegraded":"2024-04-21T09:29:36.372829+0000","last_fullsized":"2024-04-21T09:29:36.372829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2489,"log_dups_size":0,"ondisk_log_size":2489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:05:07.065915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9408307699999998,"stat_sum":{"num_bytes":1449396,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":672,"num_read_kb":58563,"num_write":1348,"num_write_kb":71949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"67'1849","reported_seq":1968,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:39.777016+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T09:29:39.777016+0000","last_peered":"2024-04-21T09:29:39.777016+0000","last_clean":"2024-04-21T09:29:39.777016+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T09:29:39.777016+0000","last_undegraded":"2024-04-21T09:29:39.777016+0000","last_fullsized":"2024-04-21T09:29:39.777016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360218,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1905,"num_write_kb":67672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"67'2123","reported_seq":5702,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.485509+0000","last_change":"2024-04-21T09:28:45.933043+0000","last_active":"2024-04-21T09:29:36.485509+0000","last_peered":"2024-04-21T09:29:36.485509+0000","last_clean":"2024-04-21T09:29:36.485509+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T09:29:36.485509+0000","last_undegraded":"2024-04-21T09:29:36.485509+0000","last_fullsized":"2024-04-21T09:29:36.485509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:16:42.323653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1303453910000001,"stat_sum":{"num_bytes":423452,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":795,"num_read_kb":38871,"num_write":1238,"num_write_kb":53480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"67'1067","reported_seq":1186,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.723360+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T09:29:07.723360+0000","last_peered":"2024-04-21T09:29:07.723360+0000","last_clean":"2024-04-21T09:29:07.723360+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T09:29:07.723360+0000","last_undegraded":"2024-04-21T09:29:07.723360+0000","last_fullsized":"2024-04-21T09:29:07.723360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1130,"num_write_kb":103837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'2101","reported_seq":5718,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.208961+0000","last_change":"2024-04-21T09:28:45.741835+0000","last_active":"2024-04-21T09:29:36.208961+0000","last_peered":"2024-04-21T09:29:36.208961+0000","last_clean":"2024-04-21T09:29:36.208961+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T09:29:36.208961+0000","last_undegraded":"2024-04-21T09:29:36.208961+0000","last_fullsized":"2024-04-21T09:29:36.208961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:27:55.140270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9990111659999998,"stat_sum":{"num_bytes":188023,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":820,"num_read_kb":25651,"num_write":1244,"num_write_kb":31755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"67'610","reported_seq":729,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:52.368405+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T09:28:52.368405+0000","last_peered":"2024-04-21T09:28:52.368405+0000","last_clean":"2024-04-21T09:28:52.368405+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T09:28:52.368405+0000","last_undegraded":"2024-04-21T09:28:52.368405+0000","last_fullsized":"2024-04-21T09:28:52.368405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":652,"num_write_kb":66576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"67'2320","reported_seq":5647,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.793411+0000","last_change":"2024-04-21T09:28:44.348594+0000","last_active":"2024-04-21T09:29:40.793411+0000","last_peered":"2024-04-21T09:29:40.793411+0000","last_clean":"2024-04-21T09:29:40.793411+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T09:29:40.793411+0000","last_undegraded":"2024-04-21T09:29:40.793411+0000","last_fullsized":"2024-04-21T09:29:40.793411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:29:44.651816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5804545169999999,"stat_sum":{"num_bytes":382601,"num_objects":50,"num_object_clones":3,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":3,"num_read":625,"num_read_kb":42400,"num_write":1277,"num_write_kb":58726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"67'295","reported_seq":414,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:52.365785+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T09:28:52.365785+0000","last_peered":"2024-04-21T09:28:52.365785+0000","last_clean":"2024-04-21T09:28:52.365785+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T09:28:52.365785+0000","last_undegraded":"2024-04-21T09:28:52.365785+0000","last_fullsized":"2024-04-21T09:28:52.365785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":356,"num_write_kb":50157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"67'2173","reported_seq":5524,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.242250+0000","last_change":"2024-04-21T09:28:45.921094+0000","last_active":"2024-04-21T09:29:36.242250+0000","last_peered":"2024-04-21T09:29:36.242250+0000","last_clean":"2024-04-21T09:29:36.242250+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T09:29:36.242250+0000","last_undegraded":"2024-04-21T09:29:36.242250+0000","last_fullsized":"2024-04-21T09:29:36.242250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2173,"log_dups_size":0,"ondisk_log_size":2173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:11.310198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1185256849999998,"stat_sum":{"num_bytes":4826271,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":569,"num_read_kb":33153,"num_write":1288,"num_write_kb":50022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"67'316","reported_seq":435,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.651166+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T09:29:38.651166+0000","last_peered":"2024-04-21T09:29:38.651166+0000","last_clean":"2024-04-21T09:29:38.651166+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T09:29:38.651166+0000","last_undegraded":"2024-04-21T09:29:38.651166+0000","last_fullsized":"2024-04-21T09:29:38.651166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":357,"num_write_kb":54084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"67'2022","reported_seq":5059,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.696741+0000","last_change":"2024-04-21T09:28:44.018196+0000","last_active":"2024-04-21T09:29:35.696741+0000","last_peered":"2024-04-21T09:29:35.696741+0000","last_clean":"2024-04-21T09:29:35.696741+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T09:29:35.696741+0000","last_undegraded":"2024-04-21T09:29:35.696741+0000","last_fullsized":"2024-04-21T09:29:35.696741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:25:52.475787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.2319400950000001,"stat_sum":{"num_bytes":175769,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":219,"num_read_kb":19620,"num_write":1194,"num_write_kb":32859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"67'598","reported_seq":717,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.226647+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T09:29:07.226647+0000","last_peered":"2024-04-21T09:29:07.226647+0000","last_clean":"2024-04-21T09:29:07.226647+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T09:29:07.226647+0000","last_undegraded":"2024-04-21T09:29:07.226647+0000","last_fullsized":"2024-04-21T09:29:07.226647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":690,"num_write_kb":70856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"67'2169","reported_seq":5335,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.557806+0000","last_change":"2024-04-21T09:28:45.882126+0000","last_active":"2024-04-21T09:29:03.557806+0000","last_peered":"2024-04-21T09:29:03.557806+0000","last_clean":"2024-04-21T09:29:03.557806+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T09:29:03.557806+0000","last_undegraded":"2024-04-21T09:29:03.557806+0000","last_fullsized":"2024-04-21T09:29:03.557806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2169,"log_dups_size":0,"ondisk_log_size":2169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:34:03.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0896541609999999,"stat_sum":{"num_bytes":192307,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":372,"num_read_kb":32968,"num_write":1304,"num_write_kb":44671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"67'377","reported_seq":497,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.171927+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T09:29:07.171927+0000","last_peered":"2024-04-21T09:29:07.171927+0000","last_clean":"2024-04-21T09:29:07.171927+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T09:29:07.171927+0000","last_undegraded":"2024-04-21T09:29:07.171927+0000","last_fullsized":"2024-04-21T09:29:07.171927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":419,"num_write_kb":58504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"67'2111","reported_seq":5197,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.663371+0000","last_change":"2024-04-21T09:28:44.790196+0000","last_active":"2024-04-21T09:29:36.663371+0000","last_peered":"2024-04-21T09:29:36.663371+0000","last_clean":"2024-04-21T09:29:36.663371+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T09:29:36.663371+0000","last_undegraded":"2024-04-21T09:29:36.663371+0000","last_fullsized":"2024-04-21T09:29:36.663371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:26:10.185168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.021994528,"stat_sum":{"num_bytes":201150,"num_objects":35,"num_object_clones":1,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":1,"num_read":302,"num_read_kb":21528,"num_write":1239,"num_write_kb":32478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"67'554","reported_seq":674,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:16.184473+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T09:29:16.184473+0000","last_peered":"2024-04-21T09:29:16.184473+0000","last_clean":"2024-04-21T09:29:16.184473+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T09:29:16.184473+0000","last_undegraded":"2024-04-21T09:29:16.184473+0000","last_fullsized":"2024-04-21T09:29:16.184473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":659,"num_write_kb":83174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"67'2028","reported_seq":5225,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.754248+0000","last_change":"2024-04-21T09:28:45.767404+0000","last_active":"2024-04-21T09:29:36.754248+0000","last_peered":"2024-04-21T09:29:36.754248+0000","last_clean":"2024-04-21T09:29:36.754248+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T09:29:36.754248+0000","last_undegraded":"2024-04-21T09:29:36.754248+0000","last_fullsized":"2024-04-21T09:29:36.754248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:20:02.733055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.023693121,"stat_sum":{"num_bytes":450958,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":387,"num_read_kb":33384,"num_write":1202,"num_write_kb":41219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"67'503","reported_seq":623,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:01.630809+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T09:29:01.630809+0000","last_peered":"2024-04-21T09:29:01.630809+0000","last_clean":"2024-04-21T09:29:01.630809+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T09:29:01.630809+0000","last_undegraded":"2024-04-21T09:29:01.630809+0000","last_fullsized":"2024-04-21T09:29:01.630809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753472,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":533,"num_write_kb":91123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"67'2016","reported_seq":4956,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.234979+0000","last_change":"2024-04-21T09:28:45.781503+0000","last_active":"2024-04-21T09:29:36.234979+0000","last_peered":"2024-04-21T09:29:36.234979+0000","last_clean":"2024-04-21T09:29:36.234979+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T09:29:36.234979+0000","last_undegraded":"2024-04-21T09:29:36.234979+0000","last_fullsized":"2024-04-21T09:29:36.234979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:56.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.038574713,"stat_sum":{"num_bytes":171335,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":107,"num_read_kb":16364,"num_write":1241,"num_write_kb":23403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"67'752","reported_seq":872,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:37.692030+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T09:29:37.692030+0000","last_peered":"2024-04-21T09:29:37.692030+0000","last_clean":"2024-04-21T09:29:37.692030+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T09:29:37.692030+0000","last_undegraded":"2024-04-21T09:29:37.692030+0000","last_fullsized":"2024-04-21T09:29:37.692030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":819,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"67'2111","reported_seq":5987,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:19.279975+0000","last_change":"2024-04-21T09:28:45.970660+0000","last_active":"2024-04-21T09:29:19.279975+0000","last_peered":"2024-04-21T09:29:19.279975+0000","last_clean":"2024-04-21T09:29:19.279975+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T09:29:19.279975+0000","last_undegraded":"2024-04-21T09:29:19.279975+0000","last_fullsized":"2024-04-21T09:29:19.279975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:29:21.002833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1656380820000001,"stat_sum":{"num_bytes":2080694,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1095,"num_read_kb":45996,"num_write":1231,"num_write_kb":65530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":278,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:51.738532+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T09:28:51.738532+0000","last_peered":"2024-04-21T09:28:51.738532+0000","last_clean":"2024-04-21T09:28:51.738532+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T09:28:51.738532+0000","last_undegraded":"2024-04-21T09:28:51.738532+0000","last_fullsized":"2024-04-21T09:28:51.738532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"67'398","reported_seq":519,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:00.701816+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T09:29:00.701816+0000","last_peered":"2024-04-21T09:29:00.701816+0000","last_clean":"2024-04-21T09:29:00.701816+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T09:29:00.701816+0000","last_undegraded":"2024-04-21T09:29:00.701816+0000","last_fullsized":"2024-04-21T09:29:00.701816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":417,"num_write_kb":66426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"67'2180","reported_seq":5306,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.808764+0000","last_change":"2024-04-21T09:28:44.175131+0000","last_active":"2024-04-21T09:29:40.808764+0000","last_peered":"2024-04-21T09:29:40.808764+0000","last_clean":"2024-04-21T09:29:40.808764+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T09:29:40.808764+0000","last_undegraded":"2024-04-21T09:29:40.808764+0000","last_fullsized":"2024-04-21T09:29:40.808764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2180,"log_dups_size":0,"ondisk_log_size":2180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:46:04.842358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.4289542820000001,"stat_sum":{"num_bytes":172528,"num_objects":49,"num_object_clones":3,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":3,"num_read":360,"num_read_kb":14678,"num_write":1265,"num_write_kb":25319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"67'453","reported_seq":574,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.678336+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T09:29:38.678336+0000","last_peered":"2024-04-21T09:29:38.678336+0000","last_clean":"2024-04-21T09:29:38.678336+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T09:29:38.678336+0000","last_undegraded":"2024-04-21T09:29:38.678336+0000","last_fullsized":"2024-04-21T09:29:38.678336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":532,"num_write_kb":66745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"67'2019","reported_seq":5193,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.954556+0000","last_change":"2024-04-21T09:28:44.294673+0000","last_active":"2024-04-21T09:29:35.954556+0000","last_peered":"2024-04-21T09:29:35.954556+0000","last_clean":"2024-04-21T09:29:35.954556+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T09:29:35.954556+0000","last_undegraded":"2024-04-21T09:29:35.954556+0000","last_fullsized":"2024-04-21T09:29:35.954556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:59:45.792713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5339399039999999,"stat_sum":{"num_bytes":897361,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":354,"num_read_kb":28451,"num_write":1217,"num_write_kb":46662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"67'2022","reported_seq":3669,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.417547+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T09:29:35.417547+0000","last_peered":"2024-04-21T09:29:35.417547+0000","last_clean":"2024-04-21T09:29:35.417547+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T09:29:35.417547+0000","last_undegraded":"2024-04-21T09:29:35.417547+0000","last_fullsized":"2024-04-21T09:29:35.417547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1567,"num_read_kb":5084,"num_write":2065,"num_write_kb":83961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'2194","reported_seq":5555,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.380080+0000","last_change":"2024-04-21T09:28:45.635990+0000","last_active":"2024-04-21T09:29:36.380080+0000","last_peered":"2024-04-21T09:29:36.380080+0000","last_clean":"2024-04-21T09:29:36.380080+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T09:29:36.380080+0000","last_undegraded":"2024-04-21T09:29:36.380080+0000","last_fullsized":"2024-04-21T09:29:36.380080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:42:25.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8917352620000001,"stat_sum":{"num_bytes":736379,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":582,"num_read_kb":35116,"num_write":1302,"num_write_kb":50330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"67'638","reported_seq":759,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.741011+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T09:29:07.741011+0000","last_peered":"2024-04-21T09:29:07.741011+0000","last_clean":"2024-04-21T09:29:07.741011+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T09:29:07.741011+0000","last_undegraded":"2024-04-21T09:29:07.741011+0000","last_fullsized":"2024-04-21T09:29:07.741011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":670,"num_write_kb":66558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"67'2107","reported_seq":5220,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.639436+0000","last_change":"2024-04-21T09:28:45.696608+0000","last_active":"2024-04-21T09:29:36.639436+0000","last_peered":"2024-04-21T09:29:36.639436+0000","last_clean":"2024-04-21T09:29:36.639436+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T09:29:36.639436+0000","last_undegraded":"2024-04-21T09:29:36.639436+0000","last_fullsized":"2024-04-21T09:29:36.639436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:57:56.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9541586510000002,"stat_sum":{"num_bytes":663798,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":305,"num_read_kb":34870,"num_write":1296,"num_write_kb":46820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"67'468","reported_seq":589,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.780231+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T09:29:38.780231+0000","last_peered":"2024-04-21T09:29:38.780231+0000","last_clean":"2024-04-21T09:29:38.780231+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T09:29:38.780231+0000","last_undegraded":"2024-04-21T09:29:38.780231+0000","last_fullsized":"2024-04-21T09:29:38.780231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":494,"num_write_kb":86782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"67'2128","reported_seq":6408,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.424893+0000","last_change":"2024-04-21T09:28:44.744877+0000","last_active":"2024-04-21T09:29:36.424893+0000","last_peered":"2024-04-21T09:29:36.424893+0000","last_clean":"2024-04-21T09:29:36.424893+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T09:29:36.424893+0000","last_undegraded":"2024-04-21T09:29:36.424893+0000","last_fullsized":"2024-04-21T09:29:36.424893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:47.126807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.9781578479999999,"stat_sum":{"num_bytes":325559,"num_objects":36,"num_object_clones":1,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":1475,"num_read_kb":39572,"num_write":1278,"num_write_kb":56824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"67'609","reported_seq":730,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:04.277545+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T09:29:04.277545+0000","last_peered":"2024-04-21T09:29:04.277545+0000","last_clean":"2024-04-21T09:29:04.277545+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T09:29:04.277545+0000","last_undegraded":"2024-04-21T09:29:04.277545+0000","last_fullsized":"2024-04-21T09:29:04.277545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":660,"num_write_kb":66902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"67'2094","reported_seq":5412,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.026596+0000","last_change":"2024-04-21T09:28:44.316999+0000","last_active":"2024-04-21T09:29:36.026596+0000","last_peered":"2024-04-21T09:29:36.026596+0000","last_clean":"2024-04-21T09:29:36.026596+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T09:29:36.026596+0000","last_undegraded":"2024-04-21T09:29:36.026596+0000","last_fullsized":"2024-04-21T09:29:36.026596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:56:20.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5495247060000001,"stat_sum":{"num_bytes":1540725,"num_objects":34,"num_object_clones":1,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":1,"num_read":519,"num_read_kb":31871,"num_write":1252,"num_write_kb":50089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"67'1449","reported_seq":1569,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:39.657134+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T09:29:39.657134+0000","last_peered":"2024-04-21T09:29:39.657134+0000","last_clean":"2024-04-21T09:29:39.657134+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T09:29:39.657134+0000","last_undegraded":"2024-04-21T09:29:39.657134+0000","last_fullsized":"2024-04-21T09:29:39.657134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1449,"log_dups_size":0,"ondisk_log_size":1449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":3452,"num_write_kb":59388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"67'2046","reported_seq":4952,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.690735+0000","last_change":"2024-04-21T09:28:44.214012+0000","last_active":"2024-04-21T09:29:36.690735+0000","last_peered":"2024-04-21T09:29:36.690735+0000","last_clean":"2024-04-21T09:29:36.690735+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T09:29:36.690735+0000","last_undegraded":"2024-04-21T09:29:36.690735+0000","last_fullsized":"2024-04-21T09:29:36.690735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:56:20.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.4643170409999999,"stat_sum":{"num_bytes":815334,"num_objects":49,"num_object_clones":1,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":1,"num_read":111,"num_read_kb":12886,"num_write":1195,"num_write_kb":26049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'380","reported_seq":500,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.658128+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T09:29:38.658128+0000","last_peered":"2024-04-21T09:29:38.658128+0000","last_clean":"2024-04-21T09:29:38.658128+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T09:29:38.658128+0000","last_undegraded":"2024-04-21T09:29:38.658128+0000","last_fullsized":"2024-04-21T09:29:38.658128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":409,"num_write_kb":49903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"67'2018","reported_seq":5055,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.252632+0000","last_change":"2024-04-21T09:28:44.178948+0000","last_active":"2024-04-21T09:29:36.252632+0000","last_peered":"2024-04-21T09:29:36.252632+0000","last_clean":"2024-04-21T09:29:36.252632+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T09:29:36.252632+0000","last_undegraded":"2024-04-21T09:29:36.252632+0000","last_fullsized":"2024-04-21T09:29:36.252632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2018,"log_dups_size":0,"ondisk_log_size":2018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:59:31.726512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.4317480490000001,"stat_sum":{"num_bytes":729374,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":203,"num_read_kb":7913,"num_write":1253,"num_write_kb":15412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"67'356","reported_seq":476,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:00.614877+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T09:29:00.614877+0000","last_peered":"2024-04-21T09:29:00.614877+0000","last_clean":"2024-04-21T09:29:00.614877+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T09:29:00.614877+0000","last_undegraded":"2024-04-21T09:29:00.614877+0000","last_fullsized":"2024-04-21T09:29:00.614877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":397,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"67'2127","reported_seq":5739,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.680789+0000","last_change":"2024-04-21T09:28:45.882121+0000","last_active":"2024-04-21T09:29:35.680789+0000","last_peered":"2024-04-21T09:29:35.680789+0000","last_clean":"2024-04-21T09:29:35.680789+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T09:29:35.680789+0000","last_undegraded":"2024-04-21T09:29:35.680789+0000","last_fullsized":"2024-04-21T09:29:35.680789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:59:21.088123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0848153780000001,"stat_sum":{"num_bytes":132963,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":812,"num_read_kb":26529,"num_write":1270,"num_write_kb":40669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"67'359","reported_seq":479,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:51.741494+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T09:28:51.741494+0000","last_peered":"2024-04-21T09:28:51.741494+0000","last_clean":"2024-04-21T09:28:51.741494+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T09:28:51.741494+0000","last_undegraded":"2024-04-21T09:28:51.741494+0000","last_fullsized":"2024-04-21T09:28:51.741494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":441,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"67'2237","reported_seq":5650,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.791499+0000","last_change":"2024-04-21T09:28:44.191551+0000","last_active":"2024-04-21T09:29:40.791499+0000","last_peered":"2024-04-21T09:29:40.791499+0000","last_clean":"2024-04-21T09:29:40.791499+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T09:29:40.791499+0000","last_undegraded":"2024-04-21T09:29:40.791499+0000","last_fullsized":"2024-04-21T09:29:40.791499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:35:53.764335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.445869871,"stat_sum":{"num_bytes":160945,"num_objects":45,"num_object_clones":2,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":2,"num_read":643,"num_read_kb":28195,"num_write":1321,"num_write_kb":52339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"67'555","reported_seq":675,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:00.620905+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T09:29:00.620905+0000","last_peered":"2024-04-21T09:29:00.620905+0000","last_clean":"2024-04-21T09:29:00.620905+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T09:29:00.620905+0000","last_undegraded":"2024-04-21T09:29:00.620905+0000","last_fullsized":"2024-04-21T09:29:00.620905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":590,"num_write_kb":74705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"67'2172","reported_seq":5432,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.182892+0000","last_change":"2024-04-21T09:28:43.578133+0000","last_active":"2024-04-21T09:29:36.182892+0000","last_peered":"2024-04-21T09:29:36.182892+0000","last_clean":"2024-04-21T09:29:36.182892+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T09:29:36.182892+0000","last_undegraded":"2024-04-21T09:29:36.182892+0000","last_fullsized":"2024-04-21T09:29:36.182892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2172,"log_dups_size":0,"ondisk_log_size":2172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:16:18.367372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.79564842000000002,"stat_sum":{"num_bytes":1395371,"num_objects":36,"num_object_clones":1,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":485,"num_read_kb":25033,"num_write":1280,"num_write_kb":33453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"67'752","reported_seq":872,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:14.279146+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T09:29:14.279146+0000","last_peered":"2024-04-21T09:29:14.279146+0000","last_clean":"2024-04-21T09:29:14.279146+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T09:29:14.279146+0000","last_undegraded":"2024-04-21T09:29:14.279146+0000","last_fullsized":"2024-04-21T09:29:14.279146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":804,"num_write_kb":83255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"67'2076","reported_seq":5236,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.519634+0000","last_change":"2024-04-21T09:28:45.901687+0000","last_active":"2024-04-21T09:29:03.519634+0000","last_peered":"2024-04-21T09:29:03.519634+0000","last_clean":"2024-04-21T09:29:03.519634+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T09:29:03.519634+0000","last_undegraded":"2024-04-21T09:29:03.519634+0000","last_fullsized":"2024-04-21T09:29:03.519634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2076,"log_dups_size":0,"ondisk_log_size":2076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:19:28.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0999314830000002,"stat_sum":{"num_bytes":1086074,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":349,"num_read_kb":27188,"num_write":1258,"num_write_kb":33779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"67'2079","reported_seq":5570,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.078888+0000","last_change":"2024-04-21T09:28:45.945101+0000","last_active":"2024-04-21T09:29:36.078888+0000","last_peered":"2024-04-21T09:29:36.078888+0000","last_clean":"2024-04-21T09:29:36.078888+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T09:29:36.078888+0000","last_undegraded":"2024-04-21T09:29:36.078888+0000","last_fullsized":"2024-04-21T09:29:36.078888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:05:07.065915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1423554660000002,"stat_sum":{"num_bytes":179048,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":699,"num_read_kb":42586,"num_write":1227,"num_write_kb":54777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"67'423","reported_seq":541,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.655227+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T09:29:38.655227+0000","last_peered":"2024-04-21T09:29:38.655227+0000","last_clean":"2024-04-21T09:29:38.655227+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T09:29:38.655227+0000","last_undegraded":"2024-04-21T09:29:38.655227+0000","last_fullsized":"2024-04-21T09:29:38.655227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":470,"num_write_kb":62370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"67'2258","reported_seq":5102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.782315+0000","last_change":"2024-04-21T09:28:43.971613+0000","last_active":"2024-04-21T09:29:40.782315+0000","last_peered":"2024-04-21T09:29:40.782315+0000","last_clean":"2024-04-21T09:29:40.782315+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T09:29:40.782315+0000","last_undegraded":"2024-04-21T09:29:40.782315+0000","last_fullsized":"2024-04-21T09:29:40.782315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:01:56.665478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.185004465,"stat_sum":{"num_bytes":690226,"num_objects":56,"num_object_clones":2,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":2,"num_read":99,"num_read_kb":9295,"num_write":1329,"num_write_kb":26562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"67'706","reported_seq":824,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.224391+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T09:29:07.224391+0000","last_peered":"2024-04-21T09:29:07.224391+0000","last_clean":"2024-04-21T09:29:07.224391+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T09:29:07.224391+0000","last_undegraded":"2024-04-21T09:29:07.224391+0000","last_fullsized":"2024-04-21T09:29:07.224391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":740,"num_write_kb":107556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"67'2032","reported_seq":5718,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.458919+0000","last_change":"2024-04-21T09:28:45.672192+0000","last_active":"2024-04-21T09:29:03.458919+0000","last_peered":"2024-04-21T09:29:03.458919+0000","last_clean":"2024-04-21T09:29:03.458919+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T09:29:03.458919+0000","last_undegraded":"2024-04-21T09:29:03.458919+0000","last_fullsized":"2024-04-21T09:29:03.458919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2032,"log_dups_size":0,"ondisk_log_size":2032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:16:42.323653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9215196670000001,"stat_sum":{"num_bytes":460753,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":879,"num_read_kb":31992,"num_write":1204,"num_write_kb":36967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"67'626","reported_seq":747,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:51.747727+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T09:28:51.747727+0000","last_peered":"2024-04-21T09:28:51.747727+0000","last_clean":"2024-04-21T09:28:51.747727+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T09:28:51.747727+0000","last_undegraded":"2024-04-21T09:28:51.747727+0000","last_fullsized":"2024-04-21T09:28:51.747727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":667,"num_write_kb":62545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"67'2040","reported_seq":5128,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.588200+0000","last_change":"2024-04-21T09:28:45.704191+0000","last_active":"2024-04-21T09:29:36.588200+0000","last_peered":"2024-04-21T09:29:36.588200+0000","last_clean":"2024-04-21T09:29:36.588200+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T09:29:36.588200+0000","last_undegraded":"2024-04-21T09:29:36.588200+0000","last_fullsized":"2024-04-21T09:29:36.588200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:19:28.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9540837450000001,"stat_sum":{"num_bytes":129518,"num_objects":35,"num_object_clones":1,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":1,"num_read":270,"num_read_kb":25102,"num_write":1239,"num_write_kb":36876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"67'644","reported_seq":765,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.639693+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T09:29:07.639693+0000","last_peered":"2024-04-21T09:29:07.639693+0000","last_clean":"2024-04-21T09:29:07.639693+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T09:29:07.639693+0000","last_undegraded":"2024-04-21T09:29:07.639693+0000","last_fullsized":"2024-04-21T09:29:07.639693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":737,"num_write_kb":50570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":50927605,"num_objects":2418,"num_object_clones":50,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2418,"num_whiteouts":50,"num_read":38674,"num_read_kb":2025856,"num_write":80454,"num_write_kb":2887997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76849152,"data_stored":101855210,"data_compressed":30508016,"data_compressed_allocated":33341440,"data_compressed_original":70082560,"omap_allocated":0,"internal_metadata":0},"log_size":135812,"ondisk_log_size":135812,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":625561753,"num_objects":1538,"num_object_clones":0,"num_object_copies":3076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1538,"num_whiteouts":0,"num_read":3023,"num_read_kb":5844,"num_write":24984,"num_write_kb":2246854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1324,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227540992,"data_stored":1251130898,"data_compressed":172334250,"data_compressed_allocated":211615744,"data_compressed_original":1235263488,"omap_allocated":0,"internal_metadata":0},"log_size":21404,"ondisk_log_size":21404,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509828,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214980,"kb_used_data":45052,"kb_used_omap":1,"kb_used_meta":169918,"kb_avail":94156860,"statfs":{"total":96636764160,"available":96416624640,"internally_reserved":0,"allocated":46133248,"data_stored":196650298,"data_compressed":29084848,"data_compressed_allocated":35250176,"data_compressed_original":187887616,"omap_allocated":1593,"internal_metadata":173996487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509828,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169616,"kb_used_data":26056,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94202224,"statfs":{"total":96636764160,"available":96463077376,"internally_reserved":0,"allocated":26681344,"data_stored":118707546,"data_compressed":17859376,"data_compressed_allocated":21331968,"data_compressed_original":115421184,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509829,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165340,"kb_used_data":35668,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94206500,"statfs":{"total":96636764160,"available":96467456000,"internally_reserved":0,"allocated":36524032,"data_stored":170834582,"data_compressed":26330109,"data_compressed_allocated":31559680,"data_compressed_original":167571456,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509829,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237348,"kb_used_data":53596,"kb_used_omap":1,"kb_used_meta":183742,"kb_avail":94134492,"statfs":{"total":96636764160,"available":96393719808,"internally_reserved":0,"allocated":54882304,"data_stored":243120354,"data_compressed":36145809,"data_compressed_allocated":43544576,"data_compressed_original":234237952,"omap_allocated":1595,"internal_metadata":188152261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542531,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157972,"kb_used_data":28300,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94213868,"statfs":{"total":96636764160,"available":96475000832,"internally_reserved":0,"allocated":28979200,"data_stored":126490268,"data_compressed":18320081,"data_compressed_allocated":22302720,"data_compressed_original":121176064,"omap_allocated":1590,"internal_metadata":132774346},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542532,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198992,"kb_used_data":41544,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94172848,"statfs":{"total":96636764160,"available":96432996352,"internally_reserved":0,"allocated":42541056,"data_stored":180583845,"data_compressed":27544803,"data_compressed_allocated":33165312,"data_compressed_original":173215744,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143996,"kb_used_data":26804,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94227844,"statfs":{"total":96636764160,"available":96489312256,"internally_reserved":0,"allocated":27447296,"data_stored":108621838,"data_compressed":17225932,"data_compressed_allocated":20799488,"data_compressed_original":103698432,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207300,"kb_used_data":45756,"kb_used_omap":1,"kb_used_meta":161534,"kb_avail":94164540,"statfs":{"total":96636764160,"available":96424488960,"internally_reserved":0,"allocated":46854144,"data_stored":207868337,"data_compressed":29861034,"data_compressed_allocated":36425728,"data_compressed_original":199094272,"omap_allocated":1594,"internal_metadata":165411270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41443328,"data_stored":226492472,"data_compressed":31902653,"data_compressed_allocated":38887424,"data_compressed_original":223944704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28999680,"data_stored":160000001,"data_compressed":22336660,"data_compressed_allocated":27205632,"data_compressed_original":158212096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19116032,"data_stored":109052576,"data_compressed":14473114,"data_compressed_allocated":17641472,"data_compressed_original":107585536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33767424,"data_stored":184549958,"data_compressed":25119139,"data_compressed_allocated":31006720,"data_compressed_original":181792768,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35598336,"data_stored":193543649,"data_compressed":26239825,"data_compressed_allocated":32456704,"data_compressed_original":190418944,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29315072,"data_stored":163582614,"data_compressed":22746011,"data_compressed_allocated":27934720,"data_compressed_original":162209792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17940480,"data_stored":96468992,"data_compressed":13648580,"data_compressed_allocated":16875520,"data_compressed_original":95404032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21360640,"data_stored":117440636,"data_compressed":15868268,"data_compressed_allocated":19607552,"data_compressed_original":115695616,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12664832,"data_stored":16264816,"data_compressed":4243156,"data_compressed_allocated":4657152,"data_compressed_original":10293248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6684672,"data_stored":9881147,"data_compressed":3960011,"data_compressed_allocated":4308992,"data_compressed_original":8785920,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6791168,"data_stored":9291904,"data_compressed":3386262,"data_compressed_allocated":3690496,"data_compressed_original":7835648,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12263424,"data_stored":15931578,"data_compressed":4502859,"data_compressed_allocated":4911104,"data_compressed_original":10285056,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10481664,"data_stored":13961622,"data_compressed":3621209,"data_compressed_allocated":3969024,"data_compressed_original":8675328,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12386304,"data_stored":16047797,"data_compressed":4765354,"data_compressed_allocated":5185536,"data_compressed_original":10432512,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8732672,"data_stored":11789780,"data_compressed":3577352,"data_compressed_allocated":3923968,"data_compressed_original":8294400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6844416,"data_stored":8686566,"data_compressed":2451813,"data_compressed_allocated":2695168,"data_compressed_original":5480448,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T09:29:45.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T09:29:45.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f622785a640 1 Processor -- start 2024-04-21T09:29:45.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f622785a640 1 -- start start 2024-04-21T09:29:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f622785a640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f62200c7910 0x7f6220158d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f622785a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f622006f920 0x7f6220159290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f622785a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62200c73a0 con 0x7f62200b2c90 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f622785a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f622015c050 con 0x7f622006f920 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f622785a640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f622015ceb0 con 0x7f62200c7910 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6225df7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f622006f920 0x7f6220159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f62255f6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f62200b2c90 0x7f622006ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54770/0 (socket says 172.21.15.26:54770) 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6225df7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f622006f920 0x7f6220159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42892/0 (socket says 172.21.15.26:42892) 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f62255f6640 1 -- 172.21.15.26:0/4043754445 learned_addr learned my addr 172.21.15.26:0/4043754445 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6224df5640 1 --2- 172.21.15.26:0/4043754445 >> v2:172.21.15.169:3300/0 conn(0x7f62200c7910 0x7f6220158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:45.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6217fff640 1 -- 172.21.15.26:0/4043754445 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679133960 0 0) 0x7f62200c73a0 con 0x7f62200b2c90 2024-04-21T09:29:45.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6217fff640 1 -- 172.21.15.26:0/4043754445 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620c003530 con 0x7f62200b2c90 2024-04-21T09:29:45.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6225df7640 1 -- 172.21.15.26:0/4043754445 >> v2:172.21.15.169:3300/0 conn(0x7f62200c7910 msgr2=0x7f6220158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-21T09:29:45.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6225df7640 1 --2- 172.21.15.26:0/4043754445 >> v2:172.21.15.169:3300/0 conn(0x7f62200c7910 0x7f6220158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6225df7640 1 -- 172.21.15.26:0/4043754445 >> v1:172.21.15.26:6789/0 conn(0x7f62200b2c90 legacy=0x7f622006ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.346+0000 7f6225df7640 1 -- 172.21.15.26:0/4043754445 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622015c2a0 con 0x7f622006f920 2024-04-21T09:29:45.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f6225df7640 1 --2- 172.21.15.26:0/4043754445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f6220159290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62200cab50 tx=0x7f621801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7b8e5b09936da7 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:45.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f6217fff640 1 -- 172.21.15.26:0/4043754445 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180b4070 con 0x7f622006f920 2024-04-21T09:29:45.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f6217fff640 1 -- 172.21.15.26:0/4043754445 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62180af600 con 0x7f622006f920 2024-04-21T09:29:45.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f6217fff640 1 -- 172.21.15.26:0/4043754445 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62180af9d0 con 0x7f622006f920 2024-04-21T09:29:45.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- 172.21.15.26:0/4043754445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 msgr2=0x7f6220159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 --2- 172.21.15.26:0/4043754445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f6220159290 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62200cab50 tx=0x7f621801f110 comp rx=0 tx=0).stop 2024-04-21T09:29:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- 172.21.15.26:0/4043754445 shutdown_connections 2024-04-21T09:29:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 --2- 172.21.15.26:0/4043754445 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f6220159290 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 --2- 172.21.15.26:0/4043754445 >> v2:172.21.15.169:3300/0 conn(0x7f62200c7910 0x7f6220158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- 172.21.15.26:0/4043754445 >> 172.21.15.26:0/4043754445 conn(0x7f62200725c0 msgr2=0x7f62200729d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- 172.21.15.26:0/4043754445 shutdown_connections 2024-04-21T09:29:45.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- 172.21.15.26:0/4043754445 wait complete. 2024-04-21T09:29:45.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 Processor -- start 2024-04-21T09:29:45.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- start start 2024-04-21T09:29:45.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f622014dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62200b2c90 0x7f622006bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62200c7910 0x7f6220148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f622015cb40 con 0x7f622006f920 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 -- 0x7f622015c860 con 0x7f62200c7910 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.350+0000 7f622785a640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f62200b3070 con 0x7f62200b2c90 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f622014dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f622014dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42906/0 (socket says 172.21.15.26:42906) 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 -- 172.21.15.26:0/4252370307 learned_addr learned my addr 172.21.15.26:0/4252370307 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-21T09:29:45.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6224df5640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62200b2c90 0x7f622006bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6225df7640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62200c7910 0x7f6220148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 -- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62200b2c90 msgr2=0x7f622006bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62200b2c90 0x7f622006bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 -- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62200c7910 msgr2=0x7f6220148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62200c7910 0x7f6220148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 -- 172.21.15.26:0/4252370307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622014d410 con 0x7f622006f920 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f62255f6640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f622014dd80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c480 tx=0x7f621c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6215ffb640 1 -- 172.21.15.26:0/4252370307 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c017070 con 0x7f622006f920 2024-04-21T09:29:45.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6215ffb640 1 -- 172.21.15.26:0/4252370307 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621c005cf0 con 0x7f622006f920 2024-04-21T09:29:45.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6215ffb640 1 -- 172.21.15.26:0/4252370307 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f621c007290 con 0x7f622006f920 2024-04-21T09:29:45.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622014ca90 con 0x7f622006f920 2024-04-21T09:29:45.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622014cd50 con 0x7f622006f920 2024-04-21T09:29:45.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6220075ef0 con 0x7f622006f920 2024-04-21T09:29:45.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6215ffb640 1 -- 172.21.15.26:0/4252370307 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f621c01a070 con 0x7f622006f920 2024-04-21T09:29:45.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6215ffb640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6204068380 0x7f620406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6215ffb640 1 -- 172.21.15.26:0/4252370307 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5766+0+0 (secure 0 0 0) 0x7f621c085dd0 con 0x7f622006f920 2024-04-21T09:29:45.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6224df5640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6204068380 0x7f620406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-21T09:29:45.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.354+0000 7f6224df5640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6204068380 0x7f620406a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f622015b6b0 tx=0x7f6210008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-21T09:29:45.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.358+0000 7f6215ffb640 1 -- 172.21.15.26:0/4252370307 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f621c0563e0 con 0x7f622006f920 2024-04-21T09:29:45.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.518+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 --> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f622014e2c0 con 0x7f6204068380 2024-04-21T09:29:45.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.534+0000 7f6215ffb640 1 -- 172.21.15.26:0/4252370307 <== mgr.4110 v2:172.21.15.169:6832/1629244554 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+256918 (secure 0 0 0) 0x7f622014e2c0 con 0x7f6204068380 2024-04-21T09:29:45.538 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-21T09:29:45.541 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-21T09:29:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6204068380 msgr2=0x7f620406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6204068380 0x7f620406a840 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f622015b6b0 tx=0x7f6210008040 comp rx=0 tx=0).stop 2024-04-21T09:29:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 msgr2=0x7f622014dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-21T09:29:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f622014dd80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f621c00c480 tx=0x7f621c00c940 comp rx=0 tx=0).stop 2024-04-21T09:29:45.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 shutdown_connections 2024-04-21T09:29:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f62200c7910 0x7f6220148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f62200b2c90 0x7f622006bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.169:6832/1629244554,v1:172.21.15.169:6833/1629244554] conn(0x7f6204068380 0x7f620406a840 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 --2- 172.21.15.26:0/4252370307 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f622006f920 0x7f622014dd80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 >> 172.21.15.26:0/4252370307 conn(0x7f62200725c0 msgr2=0x7f6220151c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-21T09:29:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 shutdown_connections 2024-04-21T09:29:45.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.538+0000 7f622785a640 1 -- 172.21.15.26:0/4252370307 wait complete. 2024-04-21T09:29:45.559 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":1024,"stamp":"2024-04-21T09:29:43.843814+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":677079726,"num_objects":3958,"num_object_clones":50,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3958,"num_whiteouts":50,"num_read":41813,"num_read_kb":2031800,"num_write":105597,"num_write_kb":5137267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1324,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157333,"ondisk_log_size":157333,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1495544,"kb_used_data":302776,"kb_used_omap":12,"kb_used_meta":1192691,"kb_avail":753479176,"statfs":{"total":773094113280,"available":771562676224,"internally_reserved":0,"allocated":310042624,"data_stored":1352877068,"data_compressed":202371992,"data_compressed_allocated":244379648,"data_compressed_original":1302302720,"omap_allocated":12751,"internal_metadata":1221316145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7920650,"num_objects":226,"num_object_clones":50,"num_object_copies":452,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":226,"num_whiteouts":50,"num_read":7,"num_read_kb":13,"num_write":306,"num_write_kb":8054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004590"},"pg_stats":[{"pgid":"3.3f","version":"67'1976","reported_seq":5166,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.338469+0000","last_change":"2024-04-21T09:28:45.808023+0000","last_active":"2024-04-21T09:29:36.338469+0000","last_peered":"2024-04-21T09:29:36.338469+0000","last_clean":"2024-04-21T09:29:36.338469+0000","last_became_active":"2024-04-21T08:57:44.312023+0000","last_became_peered":"2024-04-21T08:57:44.312023+0000","last_unstale":"2024-04-21T09:29:36.338469+0000","last_undegraded":"2024-04-21T09:29:36.338469+0000","last_fullsized":"2024-04-21T09:29:36.338469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:27:26.225041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0643233040000002,"stat_sum":{"num_bytes":502677,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":352,"num_read_kb":22087,"num_write":1205,"num_write_kb":31680,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"67'1967","reported_seq":5124,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.891517+0000","last_change":"2024-04-21T09:28:45.682471+0000","last_active":"2024-04-21T09:29:36.891517+0000","last_peered":"2024-04-21T09:29:36.891517+0000","last_clean":"2024-04-21T09:29:36.891517+0000","last_became_active":"2024-04-21T08:57:44.306841+0000","last_became_peered":"2024-04-21T08:57:44.306841+0000","last_unstale":"2024-04-21T09:29:36.891517+0000","last_undegraded":"2024-04-21T09:29:36.891517+0000","last_fullsized":"2024-04-21T09:29:36.891517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":1967,"log_dups_size":0,"ondisk_log_size":1967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:34:15.568475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9328418279999999,"stat_sum":{"num_bytes":505908,"num_objects":27,"num_object_clones":1,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":1,"num_read":340,"num_read_kb":38857,"num_write":1145,"num_write_kb":55958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"67'2118","reported_seq":5325,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.721312+0000","last_change":"2024-04-21T09:28:45.603908+0000","last_active":"2024-04-21T09:29:36.721312+0000","last_peered":"2024-04-21T09:29:36.721312+0000","last_clean":"2024-04-21T09:29:36.721312+0000","last_became_active":"2024-04-21T08:57:44.282871+0000","last_became_peered":"2024-04-21T08:57:44.282871+0000","last_unstale":"2024-04-21T09:29:36.721312+0000","last_undegraded":"2024-04-21T09:29:36.721312+0000","last_fullsized":"2024-04-21T09:29:36.721312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2118,"log_dups_size":0,"ondisk_log_size":2118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:22:47.835176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.860021943,"stat_sum":{"num_bytes":4940571,"num_objects":41,"num_object_clones":1,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":1,"num_read":403,"num_read_kb":42077,"num_write":1289,"num_write_kb":62942,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"67'2146","reported_seq":5472,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.792866+0000","last_change":"2024-04-21T09:28:44.726765+0000","last_active":"2024-04-21T09:29:40.792866+0000","last_peered":"2024-04-21T09:29:40.792866+0000","last_clean":"2024-04-21T09:29:40.792866+0000","last_became_active":"2024-04-21T08:57:44.297465+0000","last_became_peered":"2024-04-21T08:57:44.297465+0000","last_unstale":"2024-04-21T09:29:40.792866+0000","last_undegraded":"2024-04-21T09:29:40.792866+0000","last_fullsized":"2024-04-21T09:29:40.792866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2146,"log_dups_size":0,"ondisk_log_size":2146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:41:04.840117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.959635896,"stat_sum":{"num_bytes":441508,"num_objects":37,"num_object_clones":2,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":547,"num_read_kb":34802,"num_write":1270,"num_write_kb":47093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"67'2298","reported_seq":5638,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.647029+0000","last_change":"2024-04-21T09:28:45.663584+0000","last_active":"2024-04-21T09:29:36.647029+0000","last_peered":"2024-04-21T09:29:36.647029+0000","last_clean":"2024-04-21T09:29:36.647029+0000","last_became_active":"2024-04-21T08:57:44.312710+0000","last_became_peered":"2024-04-21T08:57:44.312710+0000","last_unstale":"2024-04-21T09:29:36.647029+0000","last_undegraded":"2024-04-21T09:29:36.647029+0000","last_fullsized":"2024-04-21T09:29:36.647029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2298,"log_dups_size":0,"ondisk_log_size":2298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:08:37.989572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.921205912,"stat_sum":{"num_bytes":156079,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":599,"num_read_kb":39674,"num_write":1344,"num_write_kb":54131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"67'2003","reported_seq":5102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.598512+0000","last_change":"2024-04-21T09:28:44.691139+0000","last_active":"2024-04-21T09:29:35.598512+0000","last_peered":"2024-04-21T09:29:35.598512+0000","last_clean":"2024-04-21T09:29:35.598512+0000","last_became_active":"2024-04-21T08:57:44.291483+0000","last_became_peered":"2024-04-21T08:57:44.291483+0000","last_unstale":"2024-04-21T09:29:35.598512+0000","last_undegraded":"2024-04-21T09:29:35.598512+0000","last_fullsized":"2024-04-21T09:29:35.598512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2003,"log_dups_size":0,"ondisk_log_size":2003,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:21:53.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.924815653,"stat_sum":{"num_bytes":1113393,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":288,"num_read_kb":38543,"num_write":1179,"num_write_kb":50375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"67'2110","reported_seq":5924,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.324414+0000","last_change":"2024-04-21T09:28:43.594707+0000","last_active":"2024-04-21T09:29:36.324414+0000","last_peered":"2024-04-21T09:29:36.324414+0000","last_clean":"2024-04-21T09:29:36.324414+0000","last_became_active":"2024-04-21T08:58:32.691443+0000","last_became_peered":"2024-04-21T08:58:32.691443+0000","last_unstale":"2024-04-21T09:29:36.324414+0000","last_undegraded":"2024-04-21T09:29:36.324414+0000","last_fullsized":"2024-04-21T09:29:36.324414+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:49:04.800718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.80746012599999994,"stat_sum":{"num_bytes":568893,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1027,"num_read_kb":52226,"num_write":1264,"num_write_kb":62955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"67'2006","reported_seq":5980,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.869122+0000","last_change":"2024-04-21T09:28:45.614210+0000","last_active":"2024-04-21T09:29:36.869122+0000","last_peered":"2024-04-21T09:29:36.869122+0000","last_clean":"2024-04-21T09:29:36.869122+0000","last_became_active":"2024-04-21T08:57:44.315677+0000","last_became_peered":"2024-04-21T08:57:44.315677+0000","last_unstale":"2024-04-21T09:29:36.869122+0000","last_undegraded":"2024-04-21T09:29:36.869122+0000","last_fullsized":"2024-04-21T09:29:36.869122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:06:23.576776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8701777609999999,"stat_sum":{"num_bytes":537300,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":1150,"num_read_kb":33023,"num_write":1229,"num_write_kb":54712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"67'2150","reported_seq":5388,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.824051+0000","last_change":"2024-04-21T09:28:44.075556+0000","last_active":"2024-04-21T09:29:36.824051+0000","last_peered":"2024-04-21T09:29:36.824051+0000","last_clean":"2024-04-21T09:29:36.824051+0000","last_became_active":"2024-04-21T08:57:44.304749+0000","last_became_peered":"2024-04-21T08:57:44.304749+0000","last_unstale":"2024-04-21T09:29:36.824051+0000","last_undegraded":"2024-04-21T09:29:36.824051+0000","last_fullsized":"2024-04-21T09:29:36.824051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2150,"log_dups_size":0,"ondisk_log_size":2150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:44:27.626872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.288225602,"stat_sum":{"num_bytes":780489,"num_objects":33,"num_object_clones":1,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":459,"num_read_kb":22355,"num_write":1259,"num_write_kb":31073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"67'2045","reported_seq":4954,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:13.996098+0000","last_change":"2024-04-21T09:28:45.793666+0000","last_active":"2024-04-21T09:29:13.996098+0000","last_peered":"2024-04-21T09:29:13.996098+0000","last_clean":"2024-04-21T09:29:13.996098+0000","last_became_active":"2024-04-21T08:57:44.307553+0000","last_became_peered":"2024-04-21T08:57:44.307553+0000","last_unstale":"2024-04-21T09:29:13.996098+0000","last_undegraded":"2024-04-21T09:29:13.996098+0000","last_fullsized":"2024-04-21T09:29:13.996098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:59:26.035577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0506586059999998,"stat_sum":{"num_bytes":886801,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":115,"num_read_kb":25524,"num_write":1193,"num_write_kb":38490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"67'2190","reported_seq":5535,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:13.996052+0000","last_change":"2024-04-21T09:28:45.729189+0000","last_active":"2024-04-21T09:29:13.996052+0000","last_peered":"2024-04-21T09:29:13.996052+0000","last_clean":"2024-04-21T09:29:13.996052+0000","last_became_active":"2024-04-21T08:57:44.311982+0000","last_became_peered":"2024-04-21T08:57:44.311982+0000","last_unstale":"2024-04-21T09:29:13.996052+0000","last_undegraded":"2024-04-21T09:29:13.996052+0000","last_fullsized":"2024-04-21T09:29:13.996052+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2190,"log_dups_size":0,"ondisk_log_size":2190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:20:55.197831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9863790639999999,"stat_sum":{"num_bytes":512628,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":582,"num_read_kb":27956,"num_write":1285,"num_write_kb":35490,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"67'2136","reported_seq":5478,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.536784+0000","last_change":"2024-04-21T09:28:45.754426+0000","last_active":"2024-04-21T09:29:36.536784+0000","last_peered":"2024-04-21T09:29:36.536784+0000","last_clean":"2024-04-21T09:29:36.536784+0000","last_became_active":"2024-04-21T08:57:44.315014+0000","last_became_peered":"2024-04-21T08:57:44.315014+0000","last_unstale":"2024-04-21T09:29:36.536784+0000","last_undegraded":"2024-04-21T09:29:36.536784+0000","last_fullsized":"2024-04-21T09:29:36.536784+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2136,"log_dups_size":0,"ondisk_log_size":2136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:14:29.919258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0119082499999998,"stat_sum":{"num_bytes":124574,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":573,"num_read_kb":30723,"num_write":1237,"num_write_kb":59298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"67'2104","reported_seq":5571,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:39.772658+0000","last_change":"2024-04-21T09:28:44.334415+0000","last_active":"2024-04-21T09:29:39.772658+0000","last_peered":"2024-04-21T09:29:39.772658+0000","last_clean":"2024-04-21T09:29:39.772658+0000","last_became_active":"2024-04-21T08:57:44.320410+0000","last_became_peered":"2024-04-21T08:57:44.320410+0000","last_unstale":"2024-04-21T09:29:39.772658+0000","last_undegraded":"2024-04-21T09:29:39.772658+0000","last_fullsized":"2024-04-21T09:29:39.772658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:05.033551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.565899868,"stat_sum":{"num_bytes":469288,"num_objects":52,"num_object_clones":2,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":2,"num_read":685,"num_read_kb":43798,"num_write":1205,"num_write_kb":56104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"67'2110","reported_seq":5862,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.794436+0000","last_change":"2024-04-21T09:28:44.286645+0000","last_active":"2024-04-21T09:29:40.794436+0000","last_peered":"2024-04-21T09:29:40.794436+0000","last_clean":"2024-04-21T09:29:40.794436+0000","last_became_active":"2024-04-21T08:57:44.314717+0000","last_became_peered":"2024-04-21T08:57:44.314717+0000","last_unstale":"2024-04-21T09:29:40.794436+0000","last_undegraded":"2024-04-21T09:29:40.794436+0000","last_fullsized":"2024-04-21T09:29:40.794436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2110,"log_dups_size":0,"ondisk_log_size":2110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:36:24.613204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.525286513,"stat_sum":{"num_bytes":304275,"num_objects":32,"num_object_clones":3,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":3,"num_read":963,"num_read_kb":23936,"num_write":1250,"num_write_kb":37373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"67'2141","reported_seq":6625,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.766621+0000","last_change":"2024-04-21T09:28:45.623954+0000","last_active":"2024-04-21T09:29:36.766621+0000","last_peered":"2024-04-21T09:29:36.766621+0000","last_clean":"2024-04-21T09:29:36.766621+0000","last_became_active":"2024-04-21T08:57:44.284898+0000","last_became_peered":"2024-04-21T08:57:44.284898+0000","last_unstale":"2024-04-21T09:29:36.766621+0000","last_undegraded":"2024-04-21T09:29:36.766621+0000","last_fullsized":"2024-04-21T09:29:36.766621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2141,"log_dups_size":0,"ondisk_log_size":2141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:21:00.996466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8799607360000001,"stat_sum":{"num_bytes":417227,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":1695,"num_read_kb":52415,"num_write":1270,"num_write_kb":61138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"67'2100","reported_seq":6185,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:04.038636+0000","last_change":"2024-04-21T09:28:45.850347+0000","last_active":"2024-04-21T09:29:04.038636+0000","last_peered":"2024-04-21T09:29:04.038636+0000","last_clean":"2024-04-21T09:29:04.038636+0000","last_became_active":"2024-04-21T08:57:44.288309+0000","last_became_peered":"2024-04-21T08:57:44.288309+0000","last_unstale":"2024-04-21T09:29:04.038636+0000","last_undegraded":"2024-04-21T09:29:04.038636+0000","last_fullsized":"2024-04-21T09:29:04.038636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2100,"log_dups_size":0,"ondisk_log_size":2100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:42:25.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0582485780000002,"stat_sum":{"num_bytes":1249894,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":1288,"num_read_kb":34743,"num_write":1255,"num_write_kb":54320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"67'2199","reported_seq":5083,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.974803+0000","last_change":"2024-04-21T09:28:45.958125+0000","last_active":"2024-04-21T09:29:35.974803+0000","last_peered":"2024-04-21T09:29:35.974803+0000","last_clean":"2024-04-21T09:29:35.974803+0000","last_became_active":"2024-04-21T08:57:44.320046+0000","last_became_peered":"2024-04-21T08:57:44.320046+0000","last_unstale":"2024-04-21T09:29:35.974803+0000","last_undegraded":"2024-04-21T09:29:35.974803+0000","last_fullsized":"2024-04-21T09:29:35.974803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2199,"log_dups_size":0,"ondisk_log_size":2199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:13.513878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1537557870000001,"stat_sum":{"num_bytes":141554,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":112,"num_read_kb":17137,"num_write":1304,"num_write_kb":31670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"67'2059","reported_seq":5991,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.802839+0000","last_change":"2024-04-21T09:28:43.599747+0000","last_active":"2024-04-21T09:29:40.802839+0000","last_peered":"2024-04-21T09:29:40.802839+0000","last_clean":"2024-04-21T09:29:40.802839+0000","last_became_active":"2024-04-21T08:57:44.301440+0000","last_became_peered":"2024-04-21T08:57:44.301440+0000","last_unstale":"2024-04-21T09:29:40.802839+0000","last_undegraded":"2024-04-21T09:29:40.802839+0000","last_fullsized":"2024-04-21T09:29:40.802839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:49:28.524290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.81275123299999996,"stat_sum":{"num_bytes":768636,"num_objects":39,"num_object_clones":3,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":3,"num_read":1145,"num_read_kb":44755,"num_write":1183,"num_write_kb":52539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"67'2213","reported_seq":6399,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.742921+0000","last_change":"2024-04-21T09:28:45.983997+0000","last_active":"2024-04-21T09:29:35.742921+0000","last_peered":"2024-04-21T09:29:35.742921+0000","last_clean":"2024-04-21T09:29:35.742921+0000","last_became_active":"2024-04-21T08:57:44.288999+0000","last_became_peered":"2024-04-21T08:57:44.288999+0000","last_unstale":"2024-04-21T09:29:35.742921+0000","last_undegraded":"2024-04-21T09:29:35.742921+0000","last_fullsized":"2024-04-21T09:29:35.742921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2213,"log_dups_size":0,"ondisk_log_size":2213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:21:48.421213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.178589391,"stat_sum":{"num_bytes":222526,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1423,"num_read_kb":51823,"num_write":1303,"num_write_kb":61673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"67'2122","reported_seq":5055,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:18.996867+0000","last_change":"2024-04-21T09:28:45.715848+0000","last_active":"2024-04-21T09:29:18.996867+0000","last_peered":"2024-04-21T09:29:18.996867+0000","last_clean":"2024-04-21T09:29:18.996867+0000","last_became_active":"2024-04-21T08:57:44.314628+0000","last_became_peered":"2024-04-21T08:57:44.314628+0000","last_unstale":"2024-04-21T09:29:18.996867+0000","last_undegraded":"2024-04-21T09:29:18.996867+0000","last_fullsized":"2024-04-21T09:29:18.996867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2122,"log_dups_size":0,"ondisk_log_size":2122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:28:46.278685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.973257233,"stat_sum":{"num_bytes":457598,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":140,"num_read_kb":25252,"num_write":1260,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"67'2103","reported_seq":4972,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.810038+0000","last_change":"2024-04-21T09:28:44.201893+0000","last_active":"2024-04-21T09:29:40.810038+0000","last_peered":"2024-04-21T09:29:40.810038+0000","last_clean":"2024-04-21T09:29:40.810038+0000","last_became_active":"2024-04-21T08:57:44.298563+0000","last_became_peered":"2024-04-21T08:57:44.298563+0000","last_unstale":"2024-04-21T09:29:40.810038+0000","last_undegraded":"2024-04-21T09:29:40.810038+0000","last_fullsized":"2024-04-21T09:29:40.810038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2103,"log_dups_size":0,"ondisk_log_size":2103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:36:24.613204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.455701914,"stat_sum":{"num_bytes":448493,"num_objects":42,"num_object_clones":2,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":2,"num_read":86,"num_read_kb":5325,"num_write":1236,"num_write_kb":17334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"67'2219","reported_seq":5255,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.696596+0000","last_change":"2024-04-21T09:28:44.030220+0000","last_active":"2024-04-21T09:29:36.696596+0000","last_peered":"2024-04-21T09:29:36.696596+0000","last_clean":"2024-04-21T09:29:36.696596+0000","last_became_active":"2024-04-21T08:57:44.292346+0000","last_became_peered":"2024-04-21T08:57:44.292346+0000","last_unstale":"2024-04-21T09:29:36.696596+0000","last_undegraded":"2024-04-21T09:29:36.696596+0000","last_fullsized":"2024-04-21T09:29:36.696596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2219,"log_dups_size":0,"ondisk_log_size":2219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:14:28.530777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.2438301680000001,"stat_sum":{"num_bytes":94707,"num_objects":29,"num_object_clones":1,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":1,"num_read":274,"num_read_kb":28972,"num_write":1307,"num_write_kb":44070,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"67'2062","reported_seq":5414,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.883671+0000","last_change":"2024-04-21T09:28:45.578589+0000","last_active":"2024-04-21T09:29:36.883671+0000","last_peered":"2024-04-21T09:29:36.883671+0000","last_clean":"2024-04-21T09:29:36.883671+0000","last_became_active":"2024-04-21T08:57:44.290606+0000","last_became_peered":"2024-04-21T08:57:44.290606+0000","last_unstale":"2024-04-21T09:29:36.883671+0000","last_undegraded":"2024-04-21T09:29:36.883671+0000","last_fullsized":"2024-04-21T09:29:36.883671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:35.516268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8341122309999998,"stat_sum":{"num_bytes":200823,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":552,"num_read_kb":30111,"num_write":1222,"num_write_kb":38022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"67'2083","reported_seq":5187,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.698787+0000","last_change":"2024-04-21T09:28:45.850276+0000","last_active":"2024-04-21T09:29:03.698787+0000","last_peered":"2024-04-21T09:29:03.698787+0000","last_clean":"2024-04-21T09:29:03.698787+0000","last_became_active":"2024-04-21T08:57:44.283070+0000","last_became_peered":"2024-04-21T08:57:44.283070+0000","last_unstale":"2024-04-21T09:29:03.698787+0000","last_undegraded":"2024-04-21T09:29:03.698787+0000","last_fullsized":"2024-04-21T09:29:03.698787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2083,"log_dups_size":0,"ondisk_log_size":2083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:08:35.516268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.057834615,"stat_sum":{"num_bytes":660086,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":300,"num_read_kb":20512,"num_write":1241,"num_write_kb":34965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"67'2054","reported_seq":6083,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.862211+0000","last_change":"2024-04-21T09:28:45.708941+0000","last_active":"2024-04-21T09:29:36.862211+0000","last_peered":"2024-04-21T09:29:36.862211+0000","last_clean":"2024-04-21T09:29:36.862211+0000","last_became_active":"2024-04-21T08:57:44.303505+0000","last_became_peered":"2024-04-21T08:57:44.303505+0000","last_unstale":"2024-04-21T09:29:36.862211+0000","last_undegraded":"2024-04-21T09:29:36.862211+0000","last_fullsized":"2024-04-21T09:29:36.862211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:11.310198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9586817540000001,"stat_sum":{"num_bytes":1445526,"num_objects":44,"num_object_clones":1,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":1,"num_read":1219,"num_read_kb":60063,"num_write":1227,"num_write_kb":71441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"67'2177","reported_seq":5205,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.815972+0000","last_change":"2024-04-21T09:28:44.774942+0000","last_active":"2024-04-21T09:29:40.815972+0000","last_peered":"2024-04-21T09:29:40.815972+0000","last_clean":"2024-04-21T09:29:40.815972+0000","last_became_active":"2024-04-21T08:57:44.304948+0000","last_became_peered":"2024-04-21T08:57:44.304948+0000","last_unstale":"2024-04-21T09:29:40.815972+0000","last_undegraded":"2024-04-21T09:29:40.815972+0000","last_fullsized":"2024-04-21T09:29:40.815972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2177,"log_dups_size":0,"ondisk_log_size":2177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:29:49.619769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.007323854,"stat_sum":{"num_bytes":512918,"num_objects":40,"num_object_clones":3,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":3,"num_read":235,"num_read_kb":26618,"num_write":1322,"num_write_kb":39117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"67'1959","reported_seq":5516,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.746559+0000","last_change":"2024-04-21T09:28:44.334410+0000","last_active":"2024-04-21T09:29:36.746559+0000","last_peered":"2024-04-21T09:29:36.746559+0000","last_clean":"2024-04-21T09:29:36.746559+0000","last_became_active":"2024-04-21T08:57:44.310783+0000","last_became_peered":"2024-04-21T08:57:44.310783+0000","last_unstale":"2024-04-21T09:29:36.746559+0000","last_undegraded":"2024-04-21T09:29:36.746559+0000","last_fullsized":"2024-04-21T09:29:36.746559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:49.352592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5644472729999999,"stat_sum":{"num_bytes":2949062,"num_objects":40,"num_object_clones":1,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":1,"num_read":716,"num_read_kb":28488,"num_write":1192,"num_write_kb":51795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"67'2069","reported_seq":5037,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.835617+0000","last_change":"2024-04-21T09:28:44.316505+0000","last_active":"2024-04-21T09:29:35.835617+0000","last_peered":"2024-04-21T09:29:35.835617+0000","last_clean":"2024-04-21T09:29:35.835617+0000","last_became_active":"2024-04-21T08:57:44.320128+0000","last_became_peered":"2024-04-21T08:57:44.320128+0000","last_unstale":"2024-04-21T09:29:35.835617+0000","last_undegraded":"2024-04-21T09:29:35.835617+0000","last_fullsized":"2024-04-21T09:29:35.835617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2069,"log_dups_size":0,"ondisk_log_size":2069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:59:31.726512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5495412690000001,"stat_sum":{"num_bytes":1001324,"num_objects":44,"num_object_clones":1,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":1,"num_read":167,"num_read_kb":32562,"num_write":1243,"num_write_kb":41375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"67'2271","reported_seq":5890,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.267783+0000","last_change":"2024-04-21T09:28:45.648220+0000","last_active":"2024-04-21T09:29:36.267783+0000","last_peered":"2024-04-21T09:29:36.267783+0000","last_clean":"2024-04-21T09:29:36.267783+0000","last_became_active":"2024-04-21T08:57:44.291844+0000","last_became_peered":"2024-04-21T08:57:44.291844+0000","last_unstale":"2024-04-21T09:29:36.267783+0000","last_undegraded":"2024-04-21T09:29:36.267783+0000","last_fullsized":"2024-04-21T09:29:36.267783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2271,"log_dups_size":0,"ondisk_log_size":2271,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:59:21.088123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9028510230000002,"stat_sum":{"num_bytes":617957,"num_objects":42,"num_object_clones":1,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":1,"num_read":867,"num_read_kb":32016,"num_write":1336,"num_write_kb":41863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"67'2070","reported_seq":4992,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.410703+0000","last_change":"2024-04-21T09:28:45.908865+0000","last_active":"2024-04-21T09:29:03.410703+0000","last_peered":"2024-04-21T09:29:03.410703+0000","last_clean":"2024-04-21T09:29:03.410703+0000","last_became_active":"2024-04-21T08:57:44.299769+0000","last_became_peered":"2024-04-21T08:57:44.299769+0000","last_unstale":"2024-04-21T09:29:03.410703+0000","last_undegraded":"2024-04-21T09:29:03.410703+0000","last_fullsized":"2024-04-21T09:29:03.410703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:34:15.568475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1077100120000001,"stat_sum":{"num_bytes":495958,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":113,"num_read_kb":16753,"num_write":1234,"num_write_kb":25261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"67'2203","reported_seq":5597,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.387979+0000","last_change":"2024-04-21T09:28:43.573426+0000","last_active":"2024-04-21T09:29:36.387979+0000","last_peered":"2024-04-21T09:29:36.387979+0000","last_clean":"2024-04-21T09:29:36.387979+0000","last_became_active":"2024-04-21T08:57:44.295197+0000","last_became_peered":"2024-04-21T08:57:44.295197+0000","last_unstale":"2024-04-21T09:29:36.387979+0000","last_undegraded":"2024-04-21T09:29:36.387979+0000","last_fullsized":"2024-04-21T09:29:36.387979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2203,"log_dups_size":0,"ondisk_log_size":2203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:10:15.081587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.79063146299999998,"stat_sum":{"num_bytes":284339,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":606,"num_read_kb":35939,"num_write":1331,"num_write_kb":55388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"67'2125","reported_seq":5852,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.797142+0000","last_change":"2024-04-21T09:28:44.716171+0000","last_active":"2024-04-21T09:29:40.797142+0000","last_peered":"2024-04-21T09:29:40.797142+0000","last_clean":"2024-04-21T09:29:40.797142+0000","last_became_active":"2024-04-21T08:57:44.317033+0000","last_became_peered":"2024-04-21T08:57:44.317033+0000","last_unstale":"2024-04-21T09:29:40.797142+0000","last_undegraded":"2024-04-21T09:29:40.797142+0000","last_fullsized":"2024-04-21T09:29:40.797142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2125,"log_dups_size":0,"ondisk_log_size":2125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:10:21.917758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.950351495,"stat_sum":{"num_bytes":563723,"num_objects":44,"num_object_clones":4,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":4,"num_read":921,"num_read_kb":31125,"num_write":1290,"num_write_kb":49562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"67'2187","reported_seq":6187,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.789067+0000","last_change":"2024-04-21T09:28:44.057277+0000","last_active":"2024-04-21T09:29:40.789067+0000","last_peered":"2024-04-21T09:29:40.789067+0000","last_clean":"2024-04-21T09:29:40.789067+0000","last_became_active":"2024-04-21T08:57:44.292895+0000","last_became_peered":"2024-04-21T08:57:44.292895+0000","last_unstale":"2024-04-21T09:29:40.789067+0000","last_undegraded":"2024-04-21T09:29:40.789067+0000","last_fullsized":"2024-04-21T09:29:40.789067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2187,"log_dups_size":0,"ondisk_log_size":2187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:06:22.193296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.2705725050000001,"stat_sum":{"num_bytes":1126596,"num_objects":32,"num_object_clones":2,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":2,"num_read":1237,"num_read_kb":21520,"num_write":1295,"num_write_kb":35547,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"67'411","reported_seq":529,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.223843+0000","last_change":"2024-04-21T08:57:43.259441+0000","last_active":"2024-04-21T09:29:07.223843+0000","last_peered":"2024-04-21T09:29:07.223843+0000","last_clean":"2024-04-21T09:29:07.223843+0000","last_became_active":"2024-04-21T08:57:43.258596+0000","last_became_peered":"2024-04-21T08:57:43.258596+0000","last_unstale":"2024-04-21T09:29:07.223843+0000","last_undegraded":"2024-04-21T09:29:07.223843+0000","last_fullsized":"2024-04-21T09:29:07.223843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":55,"num_read_kb":0,"num_write":480,"num_write_kb":91602,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"67'2106","reported_seq":6021,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.496934+0000","last_change":"2024-04-21T09:28:44.227226+0000","last_active":"2024-04-21T09:29:36.496934+0000","last_peered":"2024-04-21T09:29:36.496934+0000","last_clean":"2024-04-21T09:29:36.496934+0000","last_became_active":"2024-04-21T08:57:44.307697+0000","last_became_peered":"2024-04-21T08:57:44.307697+0000","last_unstale":"2024-04-21T09:29:36.496934+0000","last_undegraded":"2024-04-21T09:29:36.496934+0000","last_fullsized":"2024-04-21T09:29:36.496934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:12:05.033551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.480693611,"stat_sum":{"num_bytes":3592250,"num_objects":46,"num_object_clones":1,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":1,"num_read":1146,"num_read_kb":42643,"num_write":1207,"num_write_kb":60731,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"67'777","reported_seq":895,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:52.366874+0000","last_change":"2024-04-21T08:57:43.260995+0000","last_active":"2024-04-21T09:28:52.366874+0000","last_peered":"2024-04-21T09:28:52.366874+0000","last_clean":"2024-04-21T09:28:52.366874+0000","last_became_active":"2024-04-21T08:57:43.260418+0000","last_became_peered":"2024-04-21T08:57:43.260418+0000","last_unstale":"2024-04-21T09:28:52.366874+0000","last_undegraded":"2024-04-21T09:28:52.366874+0000","last_fullsized":"2024-04-21T09:28:52.366874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":777,"log_dups_size":0,"ondisk_log_size":777,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":819,"num_write_kb":74968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"67'484","reported_seq":603,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:21.182417+0000","last_change":"2024-04-21T08:57:43.256718+0000","last_active":"2024-04-21T09:29:21.182417+0000","last_peered":"2024-04-21T09:29:21.182417+0000","last_clean":"2024-04-21T09:29:21.182417+0000","last_became_active":"2024-04-21T08:57:43.256274+0000","last_became_peered":"2024-04-21T08:57:43.256274+0000","last_unstale":"2024-04-21T09:29:21.182417+0000","last_undegraded":"2024-04-21T09:29:21.182417+0000","last_fullsized":"2024-04-21T09:29:21.182417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":515,"num_write_kb":58268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"67'2356","reported_seq":6347,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.260102+0000","last_change":"2024-04-21T09:28:45.660108+0000","last_active":"2024-04-21T09:29:36.260102+0000","last_peered":"2024-04-21T09:29:36.260102+0000","last_clean":"2024-04-21T09:29:36.260102+0000","last_became_active":"2024-04-21T08:57:44.305692+0000","last_became_peered":"2024-04-21T08:57:44.305692+0000","last_unstale":"2024-04-21T09:29:36.260102+0000","last_undegraded":"2024-04-21T09:29:36.260102+0000","last_fullsized":"2024-04-21T09:29:36.260102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2356,"log_dups_size":0,"ondisk_log_size":2356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:34:03.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9155152749999997,"stat_sum":{"num_bytes":451226,"num_objects":32,"num_object_clones":1,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":1,"num_read":1252,"num_read_kb":46571,"num_write":1378,"num_write_kb":62029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"67'633","reported_seq":752,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.224340+0000","last_change":"2024-04-21T08:57:43.250597+0000","last_active":"2024-04-21T09:29:07.224340+0000","last_peered":"2024-04-21T09:29:07.224340+0000","last_clean":"2024-04-21T09:29:07.224340+0000","last_became_active":"2024-04-21T08:57:43.250208+0000","last_became_peered":"2024-04-21T08:57:43.250208+0000","last_unstale":"2024-04-21T09:29:07.224340+0000","last_undegraded":"2024-04-21T09:29:07.224340+0000","last_fullsized":"2024-04-21T09:29:07.224340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":633,"log_dups_size":0,"ondisk_log_size":633,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":45,"num_read_kb":0,"num_write":691,"num_write_kb":79355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"67'2079","reported_seq":5751,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.772518+0000","last_change":"2024-04-21T09:28:44.135791+0000","last_active":"2024-04-21T09:29:40.772518+0000","last_peered":"2024-04-21T09:29:40.772518+0000","last_clean":"2024-04-21T09:29:40.772518+0000","last_became_active":"2024-04-21T08:57:44.282321+0000","last_became_peered":"2024-04-21T08:57:44.282321+0000","last_unstale":"2024-04-21T09:29:40.772518+0000","last_undegraded":"2024-04-21T09:29:40.772518+0000","last_fullsized":"2024-04-21T09:29:40.772518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:59:45.792713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.389896875,"stat_sum":{"num_bytes":622844,"num_objects":43,"num_object_clones":2,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":2,"num_read":869,"num_read_kb":53696,"num_write":1245,"num_write_kb":66193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"67'549","reported_seq":912,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.766497+0000","last_change":"2024-04-21T08:57:43.251141+0000","last_active":"2024-04-21T09:29:40.766497+0000","last_peered":"2024-04-21T09:29:40.766497+0000","last_clean":"2024-04-21T09:29:40.766497+0000","last_became_active":"2024-04-21T08:57:43.250614+0000","last_became_peered":"2024-04-21T08:57:43.250614+0000","last_unstale":"2024-04-21T09:29:40.766497+0000","last_undegraded":"2024-04-21T09:29:40.766497+0000","last_fullsized":"2024-04-21T09:29:40.766497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":549,"log_dups_size":0,"ondisk_log_size":549,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17381537,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":278,"num_read_kb":760,"num_write":598,"num_write_kb":63071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"67'2026","reported_seq":4972,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.345887+0000","last_change":"2024-04-21T09:28:44.761232+0000","last_active":"2024-04-21T09:29:36.345887+0000","last_peered":"2024-04-21T09:29:36.345887+0000","last_clean":"2024-04-21T09:29:36.345887+0000","last_became_active":"2024-04-21T08:57:44.304939+0000","last_became_peered":"2024-04-21T08:57:44.304939+0000","last_unstale":"2024-04-21T09:29:36.345887+0000","last_undegraded":"2024-04-21T09:29:36.345887+0000","last_fullsized":"2024-04-21T09:29:36.345887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:40:27.856651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.9933246900000001,"stat_sum":{"num_bytes":100042,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":120,"num_read_kb":21461,"num_write":1227,"num_write_kb":33815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"67'791","reported_seq":910,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.654947+0000","last_change":"2024-04-21T08:57:43.249060+0000","last_active":"2024-04-21T09:29:38.654947+0000","last_peered":"2024-04-21T09:29:38.654947+0000","last_clean":"2024-04-21T09:29:38.654947+0000","last_became_active":"2024-04-21T08:57:43.248403+0000","last_became_peered":"2024-04-21T08:57:43.248403+0000","last_unstale":"2024-04-21T09:29:38.654947+0000","last_undegraded":"2024-04-21T09:29:38.654947+0000","last_fullsized":"2024-04-21T09:29:38.654947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":791,"log_dups_size":0,"ondisk_log_size":791,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:45:47.089103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":816,"num_write_kb":86913,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"67'2489","reported_seq":5809,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.372829+0000","last_change":"2024-04-21T09:28:45.691870+0000","last_active":"2024-04-21T09:29:36.372829+0000","last_peered":"2024-04-21T09:29:36.372829+0000","last_clean":"2024-04-21T09:29:36.372829+0000","last_became_active":"2024-04-21T08:57:44.304850+0000","last_became_peered":"2024-04-21T08:57:44.304850+0000","last_unstale":"2024-04-21T09:29:36.372829+0000","last_undegraded":"2024-04-21T09:29:36.372829+0000","last_fullsized":"2024-04-21T09:29:36.372829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2489,"log_dups_size":0,"ondisk_log_size":2489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:05:07.065915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9408307699999998,"stat_sum":{"num_bytes":1449396,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":672,"num_read_kb":58563,"num_write":1348,"num_write_kb":71949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"67'1849","reported_seq":1968,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:39.777016+0000","last_change":"2024-04-21T08:57:43.253516+0000","last_active":"2024-04-21T09:29:39.777016+0000","last_peered":"2024-04-21T09:29:39.777016+0000","last_clean":"2024-04-21T09:29:39.777016+0000","last_became_active":"2024-04-21T08:57:43.253047+0000","last_became_peered":"2024-04-21T08:57:43.253047+0000","last_unstale":"2024-04-21T09:29:39.777016+0000","last_undegraded":"2024-04-21T09:29:39.777016+0000","last_fullsized":"2024-04-21T09:29:39.777016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1849,"log_dups_size":0,"ondisk_log_size":1849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:18:24.005208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360218,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":1905,"num_write_kb":67672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":43,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"67'2123","reported_seq":5702,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.485509+0000","last_change":"2024-04-21T09:28:45.933043+0000","last_active":"2024-04-21T09:29:36.485509+0000","last_peered":"2024-04-21T09:29:36.485509+0000","last_clean":"2024-04-21T09:29:36.485509+0000","last_became_active":"2024-04-21T08:57:44.296312+0000","last_became_peered":"2024-04-21T08:57:44.296312+0000","last_unstale":"2024-04-21T09:29:36.485509+0000","last_undegraded":"2024-04-21T09:29:36.485509+0000","last_fullsized":"2024-04-21T09:29:36.485509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2123,"log_dups_size":0,"ondisk_log_size":2123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:16:42.323653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1303453910000001,"stat_sum":{"num_bytes":423452,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":795,"num_read_kb":38871,"num_write":1238,"num_write_kb":53480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"67'1067","reported_seq":1186,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.723360+0000","last_change":"2024-04-21T08:57:43.255977+0000","last_active":"2024-04-21T09:29:07.723360+0000","last_peered":"2024-04-21T09:29:07.723360+0000","last_clean":"2024-04-21T09:29:07.723360+0000","last_became_active":"2024-04-21T08:57:43.255291+0000","last_became_peered":"2024-04-21T08:57:43.255291+0000","last_unstale":"2024-04-21T09:29:07.723360+0000","last_undegraded":"2024-04-21T09:29:07.723360+0000","last_fullsized":"2024-04-21T09:29:07.723360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1067,"log_dups_size":0,"ondisk_log_size":1067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:40:33.251152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33555104,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":1130,"num_write_kb":103837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"67'2101","reported_seq":5718,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.208961+0000","last_change":"2024-04-21T09:28:45.741835+0000","last_active":"2024-04-21T09:29:36.208961+0000","last_peered":"2024-04-21T09:29:36.208961+0000","last_clean":"2024-04-21T09:29:36.208961+0000","last_became_active":"2024-04-21T08:57:44.321566+0000","last_became_peered":"2024-04-21T08:57:44.321566+0000","last_unstale":"2024-04-21T09:29:36.208961+0000","last_undegraded":"2024-04-21T09:29:36.208961+0000","last_fullsized":"2024-04-21T09:29:36.208961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:27:55.140270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9990111659999998,"stat_sum":{"num_bytes":188023,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":820,"num_read_kb":25651,"num_write":1244,"num_write_kb":31755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"67'610","reported_seq":729,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:52.368405+0000","last_change":"2024-04-21T08:57:43.264777+0000","last_active":"2024-04-21T09:28:52.368405+0000","last_peered":"2024-04-21T09:28:52.368405+0000","last_clean":"2024-04-21T09:28:52.368405+0000","last_became_active":"2024-04-21T08:57:43.264293+0000","last_became_peered":"2024-04-21T08:57:43.264293+0000","last_unstale":"2024-04-21T09:28:52.368405+0000","last_undegraded":"2024-04-21T09:28:52.368405+0000","last_fullsized":"2024-04-21T09:28:52.368405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":610,"log_dups_size":0,"ondisk_log_size":610,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:24:45.713680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":37,"num_read_kb":0,"num_write":652,"num_write_kb":66576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"67'2320","reported_seq":5647,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.793411+0000","last_change":"2024-04-21T09:28:44.348594+0000","last_active":"2024-04-21T09:29:40.793411+0000","last_peered":"2024-04-21T09:29:40.793411+0000","last_clean":"2024-04-21T09:29:40.793411+0000","last_became_active":"2024-04-21T08:57:44.309666+0000","last_became_peered":"2024-04-21T08:57:44.309666+0000","last_unstale":"2024-04-21T09:29:40.793411+0000","last_undegraded":"2024-04-21T09:29:40.793411+0000","last_fullsized":"2024-04-21T09:29:40.793411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2320,"log_dups_size":0,"ondisk_log_size":2320,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:29:44.651816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5804545169999999,"stat_sum":{"num_bytes":382601,"num_objects":50,"num_object_clones":3,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":3,"num_read":625,"num_read_kb":42400,"num_write":1277,"num_write_kb":58726,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"67'295","reported_seq":414,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:52.365785+0000","last_change":"2024-04-21T08:57:43.251772+0000","last_active":"2024-04-21T09:28:52.365785+0000","last_peered":"2024-04-21T09:28:52.365785+0000","last_clean":"2024-04-21T09:28:52.365785+0000","last_became_active":"2024-04-21T08:57:43.251367+0000","last_became_peered":"2024-04-21T08:57:43.251367+0000","last_unstale":"2024-04-21T09:28:52.365785+0000","last_undegraded":"2024-04-21T09:28:52.365785+0000","last_fullsized":"2024-04-21T09:28:52.365785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":295,"log_dups_size":0,"ondisk_log_size":295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":356,"num_write_kb":50157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"67'2173","reported_seq":5524,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.242250+0000","last_change":"2024-04-21T09:28:45.921094+0000","last_active":"2024-04-21T09:29:36.242250+0000","last_peered":"2024-04-21T09:29:36.242250+0000","last_clean":"2024-04-21T09:29:36.242250+0000","last_became_active":"2024-04-21T08:57:44.320218+0000","last_became_peered":"2024-04-21T08:57:44.320218+0000","last_unstale":"2024-04-21T09:29:36.242250+0000","last_undegraded":"2024-04-21T09:29:36.242250+0000","last_fullsized":"2024-04-21T09:29:36.242250+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2173,"log_dups_size":0,"ondisk_log_size":2173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:11.310198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1185256849999998,"stat_sum":{"num_bytes":4826271,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":569,"num_read_kb":33153,"num_write":1288,"num_write_kb":50022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"67'316","reported_seq":435,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.651166+0000","last_change":"2024-04-21T08:57:43.254814+0000","last_active":"2024-04-21T09:29:38.651166+0000","last_peered":"2024-04-21T09:29:38.651166+0000","last_clean":"2024-04-21T09:29:38.651166+0000","last_became_active":"2024-04-21T08:57:43.253989+0000","last_became_peered":"2024-04-21T08:57:43.253989+0000","last_unstale":"2024-04-21T09:29:38.651166+0000","last_undegraded":"2024-04-21T09:29:38.651166+0000","last_fullsized":"2024-04-21T09:29:38.651166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:05:47.974132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":357,"num_write_kb":54084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":42,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"67'2022","reported_seq":5059,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.696741+0000","last_change":"2024-04-21T09:28:44.018196+0000","last_active":"2024-04-21T09:29:35.696741+0000","last_peered":"2024-04-21T09:29:35.696741+0000","last_clean":"2024-04-21T09:29:35.696741+0000","last_became_active":"2024-04-21T08:57:44.283581+0000","last_became_peered":"2024-04-21T08:57:44.283581+0000","last_unstale":"2024-04-21T09:29:35.696741+0000","last_undegraded":"2024-04-21T09:29:35.696741+0000","last_fullsized":"2024-04-21T09:29:35.696741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:25:52.475787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.2319400950000001,"stat_sum":{"num_bytes":175769,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":219,"num_read_kb":19620,"num_write":1194,"num_write_kb":32859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"67'598","reported_seq":717,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.226647+0000","last_change":"2024-04-21T08:57:43.251250+0000","last_active":"2024-04-21T09:29:07.226647+0000","last_peered":"2024-04-21T09:29:07.226647+0000","last_clean":"2024-04-21T09:29:07.226647+0000","last_became_active":"2024-04-21T08:57:43.250899+0000","last_became_peered":"2024-04-21T08:57:43.250899+0000","last_unstale":"2024-04-21T09:29:07.226647+0000","last_undegraded":"2024-04-21T09:29:07.226647+0000","last_fullsized":"2024-04-21T09:29:07.226647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":59,"num_read_kb":0,"num_write":690,"num_write_kb":70856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"67'2169","reported_seq":5335,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.557806+0000","last_change":"2024-04-21T09:28:45.882126+0000","last_active":"2024-04-21T09:29:03.557806+0000","last_peered":"2024-04-21T09:29:03.557806+0000","last_clean":"2024-04-21T09:29:03.557806+0000","last_became_active":"2024-04-21T08:57:44.288573+0000","last_became_peered":"2024-04-21T08:57:44.288573+0000","last_unstale":"2024-04-21T09:29:03.557806+0000","last_undegraded":"2024-04-21T09:29:03.557806+0000","last_fullsized":"2024-04-21T09:29:03.557806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2169,"log_dups_size":0,"ondisk_log_size":2169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:34:03.972837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0896541609999999,"stat_sum":{"num_bytes":192307,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":372,"num_read_kb":32968,"num_write":1304,"num_write_kb":44671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"67'377","reported_seq":497,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.171927+0000","last_change":"2024-04-21T08:57:43.263679+0000","last_active":"2024-04-21T09:29:07.171927+0000","last_peered":"2024-04-21T09:29:07.171927+0000","last_clean":"2024-04-21T09:29:07.171927+0000","last_became_active":"2024-04-21T08:57:43.257829+0000","last_became_peered":"2024-04-21T08:57:43.257829+0000","last_unstale":"2024-04-21T09:29:07.171927+0000","last_undegraded":"2024-04-21T09:29:07.171927+0000","last_fullsized":"2024-04-21T09:29:07.171927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:48:42.398266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777238,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":419,"num_write_kb":58504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"67'2111","reported_seq":5197,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.663371+0000","last_change":"2024-04-21T09:28:44.790196+0000","last_active":"2024-04-21T09:29:36.663371+0000","last_peered":"2024-04-21T09:29:36.663371+0000","last_clean":"2024-04-21T09:29:36.663371+0000","last_became_active":"2024-04-21T08:57:44.320739+0000","last_became_peered":"2024-04-21T08:57:44.320739+0000","last_unstale":"2024-04-21T09:29:36.663371+0000","last_undegraded":"2024-04-21T09:29:36.663371+0000","last_fullsized":"2024-04-21T09:29:36.663371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:26:10.185168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.021994528,"stat_sum":{"num_bytes":201150,"num_objects":35,"num_object_clones":1,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":1,"num_read":302,"num_read_kb":21528,"num_write":1239,"num_write_kb":32478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"67'554","reported_seq":674,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:16.184473+0000","last_change":"2024-04-21T08:57:43.254313+0000","last_active":"2024-04-21T09:29:16.184473+0000","last_peered":"2024-04-21T09:29:16.184473+0000","last_clean":"2024-04-21T09:29:16.184473+0000","last_became_active":"2024-04-21T08:57:43.253893+0000","last_became_peered":"2024-04-21T08:57:43.253893+0000","last_unstale":"2024-04-21T09:29:16.184473+0000","last_undegraded":"2024-04-21T09:29:16.184473+0000","last_fullsized":"2024-04-21T09:29:16.184473+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:58:07.910670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":71,"num_read_kb":0,"num_write":659,"num_write_kb":83174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"67'2028","reported_seq":5225,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.754248+0000","last_change":"2024-04-21T09:28:45.767404+0000","last_active":"2024-04-21T09:29:36.754248+0000","last_peered":"2024-04-21T09:29:36.754248+0000","last_clean":"2024-04-21T09:29:36.754248+0000","last_became_active":"2024-04-21T08:57:44.312881+0000","last_became_peered":"2024-04-21T08:57:44.312881+0000","last_unstale":"2024-04-21T09:29:36.754248+0000","last_undegraded":"2024-04-21T09:29:36.754248+0000","last_fullsized":"2024-04-21T09:29:36.754248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:20:02.733055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.023693121,"stat_sum":{"num_bytes":450958,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":387,"num_read_kb":33384,"num_write":1202,"num_write_kb":41219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"67'503","reported_seq":623,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:01.630809+0000","last_change":"2024-04-21T08:57:43.252963+0000","last_active":"2024-04-21T09:29:01.630809+0000","last_peered":"2024-04-21T09:29:01.630809+0000","last_clean":"2024-04-21T09:29:01.630809+0000","last_became_active":"2024-04-21T08:57:43.252363+0000","last_became_peered":"2024-04-21T08:57:43.252363+0000","last_unstale":"2024-04-21T09:29:01.630809+0000","last_undegraded":"2024-04-21T09:29:01.630809+0000","last_fullsized":"2024-04-21T09:29:01.630809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:22:56.547188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37753472,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":533,"num_write_kb":91123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":30,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"67'2016","reported_seq":4956,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.234979+0000","last_change":"2024-04-21T09:28:45.781503+0000","last_active":"2024-04-21T09:29:36.234979+0000","last_peered":"2024-04-21T09:29:36.234979+0000","last_clean":"2024-04-21T09:29:36.234979+0000","last_became_active":"2024-04-21T08:57:44.314736+0000","last_became_peered":"2024-04-21T08:57:44.314736+0000","last_unstale":"2024-04-21T09:29:36.234979+0000","last_undegraded":"2024-04-21T09:29:36.234979+0000","last_fullsized":"2024-04-21T09:29:36.234979+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2016,"log_dups_size":0,"ondisk_log_size":2016,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:32:56.396220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.038574713,"stat_sum":{"num_bytes":171335,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":107,"num_read_kb":16364,"num_write":1241,"num_write_kb":23403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"67'752","reported_seq":872,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:37.692030+0000","last_change":"2024-04-21T08:57:43.261085+0000","last_active":"2024-04-21T09:29:37.692030+0000","last_peered":"2024-04-21T09:29:37.692030+0000","last_clean":"2024-04-21T09:29:37.692030+0000","last_became_active":"2024-04-21T08:57:43.259187+0000","last_became_peered":"2024-04-21T08:57:43.259187+0000","last_unstale":"2024-04-21T09:29:37.692030+0000","last_undegraded":"2024-04-21T09:29:37.692030+0000","last_fullsized":"2024-04-21T09:29:37.692030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":819,"num_write_kb":66549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":48,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"67'2111","reported_seq":5987,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:19.279975+0000","last_change":"2024-04-21T09:28:45.970660+0000","last_active":"2024-04-21T09:29:19.279975+0000","last_peered":"2024-04-21T09:29:19.279975+0000","last_clean":"2024-04-21T09:29:19.279975+0000","last_became_active":"2024-04-21T08:57:44.298188+0000","last_became_peered":"2024-04-21T08:57:44.298188+0000","last_unstale":"2024-04-21T09:29:19.279975+0000","last_undegraded":"2024-04-21T09:29:19.279975+0000","last_fullsized":"2024-04-21T09:29:19.279975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2111,"log_dups_size":0,"ondisk_log_size":2111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:29:21.002833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1656380820000001,"stat_sum":{"num_bytes":2080694,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":1095,"num_read_kb":45996,"num_write":1231,"num_write_kb":65530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":278,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:51.738532+0000","last_change":"2024-04-21T08:57:38.183659+0000","last_active":"2024-04-21T09:28:51.738532+0000","last_peered":"2024-04-21T09:28:51.738532+0000","last_clean":"2024-04-21T09:28:51.738532+0000","last_became_active":"2024-04-21T08:57:38.181340+0000","last_became_peered":"2024-04-21T08:57:38.181340+0000","last_unstale":"2024-04-21T09:28:51.738532+0000","last_undegraded":"2024-04-21T09:28:51.738532+0000","last_fullsized":"2024-04-21T09:28:51.738532+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:36.159634+0000","last_clean_scrub_stamp":"2024-04-21T08:57:36.159634+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:33:31.927423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"67'398","reported_seq":519,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:00.701816+0000","last_change":"2024-04-21T08:57:43.257800+0000","last_active":"2024-04-21T09:29:00.701816+0000","last_peered":"2024-04-21T09:29:00.701816+0000","last_clean":"2024-04-21T09:29:00.701816+0000","last_became_active":"2024-04-21T08:57:43.257247+0000","last_became_peered":"2024-04-21T08:57:43.257247+0000","last_unstale":"2024-04-21T09:29:00.701816+0000","last_undegraded":"2024-04-21T09:29:00.701816+0000","last_fullsized":"2024-04-21T09:29:00.701816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":417,"num_write_kb":66426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":31,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"67'2180","reported_seq":5306,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.808764+0000","last_change":"2024-04-21T09:28:44.175131+0000","last_active":"2024-04-21T09:29:40.808764+0000","last_peered":"2024-04-21T09:29:40.808764+0000","last_clean":"2024-04-21T09:29:40.808764+0000","last_became_active":"2024-04-21T08:57:44.289133+0000","last_became_peered":"2024-04-21T08:57:44.289133+0000","last_unstale":"2024-04-21T09:29:40.808764+0000","last_undegraded":"2024-04-21T09:29:40.808764+0000","last_fullsized":"2024-04-21T09:29:40.808764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2180,"log_dups_size":0,"ondisk_log_size":2180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:46:04.842358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.4289542820000001,"stat_sum":{"num_bytes":172528,"num_objects":49,"num_object_clones":3,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":3,"num_read":360,"num_read_kb":14678,"num_write":1265,"num_write_kb":25319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"67'453","reported_seq":574,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.678336+0000","last_change":"2024-04-21T08:57:43.254988+0000","last_active":"2024-04-21T09:29:38.678336+0000","last_peered":"2024-04-21T09:29:38.678336+0000","last_clean":"2024-04-21T09:29:38.678336+0000","last_became_active":"2024-04-21T08:57:43.253947+0000","last_became_peered":"2024-04-21T08:57:43.253947+0000","last_unstale":"2024-04-21T09:29:38.678336+0000","last_undegraded":"2024-04-21T09:29:38.678336+0000","last_fullsized":"2024-04-21T09:29:38.678336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":39,"num_read_kb":0,"num_write":532,"num_write_kb":66745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"67'2019","reported_seq":5193,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.954556+0000","last_change":"2024-04-21T09:28:44.294673+0000","last_active":"2024-04-21T09:29:35.954556+0000","last_peered":"2024-04-21T09:29:35.954556+0000","last_clean":"2024-04-21T09:29:35.954556+0000","last_became_active":"2024-04-21T08:57:44.305452+0000","last_became_peered":"2024-04-21T08:57:44.305452+0000","last_unstale":"2024-04-21T09:29:35.954556+0000","last_undegraded":"2024-04-21T09:29:35.954556+0000","last_fullsized":"2024-04-21T09:29:35.954556+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:59:45.792713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5339399039999999,"stat_sum":{"num_bytes":897361,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":354,"num_read_kb":28451,"num_write":1217,"num_write_kb":46662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"67'2022","reported_seq":3669,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.417547+0000","last_change":"2024-04-21T08:57:43.252593+0000","last_active":"2024-04-21T09:29:35.417547+0000","last_peered":"2024-04-21T09:29:35.417547+0000","last_clean":"2024-04-21T09:29:35.417547+0000","last_became_active":"2024-04-21T08:57:43.252188+0000","last_became_peered":"2024-04-21T08:57:43.252188+0000","last_unstale":"2024-04-21T09:29:35.417547+0000","last_undegraded":"2024-04-21T09:29:35.417547+0000","last_fullsized":"2024-04-21T09:29:35.417547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T19:45:29.574529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":1567,"num_read_kb":5084,"num_write":2065,"num_write_kb":83961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'2194","reported_seq":5555,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.380080+0000","last_change":"2024-04-21T09:28:45.635990+0000","last_active":"2024-04-21T09:29:36.380080+0000","last_peered":"2024-04-21T09:29:36.380080+0000","last_clean":"2024-04-21T09:29:36.380080+0000","last_became_active":"2024-04-21T08:57:44.297941+0000","last_became_peered":"2024-04-21T08:57:44.297941+0000","last_unstale":"2024-04-21T09:29:36.380080+0000","last_undegraded":"2024-04-21T09:29:36.380080+0000","last_fullsized":"2024-04-21T09:29:36.380080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2194,"log_dups_size":0,"ondisk_log_size":2194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:42:25.639352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.8917352620000001,"stat_sum":{"num_bytes":736379,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":582,"num_read_kb":35116,"num_write":1302,"num_write_kb":50330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"67'638","reported_seq":759,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.741011+0000","last_change":"2024-04-21T08:57:43.260927+0000","last_active":"2024-04-21T09:29:07.741011+0000","last_peered":"2024-04-21T09:29:07.741011+0000","last_clean":"2024-04-21T09:29:07.741011+0000","last_became_active":"2024-04-21T08:57:43.258958+0000","last_became_peered":"2024-04-21T08:57:43.258958+0000","last_unstale":"2024-04-21T09:29:07.741011+0000","last_undegraded":"2024-04-21T09:29:07.741011+0000","last_fullsized":"2024-04-21T09:29:07.741011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":638,"log_dups_size":0,"ondisk_log_size":638,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:13:44.721154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":44,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":670,"num_write_kb":66558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"67'2107","reported_seq":5220,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.639436+0000","last_change":"2024-04-21T09:28:45.696608+0000","last_active":"2024-04-21T09:29:36.639436+0000","last_peered":"2024-04-21T09:29:36.639436+0000","last_clean":"2024-04-21T09:29:36.639436+0000","last_became_active":"2024-04-21T08:57:44.312237+0000","last_became_peered":"2024-04-21T08:57:44.312237+0000","last_unstale":"2024-04-21T09:29:36.639436+0000","last_undegraded":"2024-04-21T09:29:36.639436+0000","last_fullsized":"2024-04-21T09:29:36.639436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:57:56.708969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9541586510000002,"stat_sum":{"num_bytes":663798,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":305,"num_read_kb":34870,"num_write":1296,"num_write_kb":46820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"67'468","reported_seq":589,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.780231+0000","last_change":"2024-04-21T08:57:43.253305+0000","last_active":"2024-04-21T09:29:38.780231+0000","last_peered":"2024-04-21T09:29:38.780231+0000","last_clean":"2024-04-21T09:29:38.780231+0000","last_became_active":"2024-04-21T08:57:43.252732+0000","last_became_peered":"2024-04-21T08:57:43.252732+0000","last_unstale":"2024-04-21T09:29:38.780231+0000","last_undegraded":"2024-04-21T09:29:38.780231+0000","last_fullsized":"2024-04-21T09:29:38.780231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":494,"num_write_kb":86782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":34,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"67'2128","reported_seq":6408,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.424893+0000","last_change":"2024-04-21T09:28:44.744877+0000","last_active":"2024-04-21T09:29:36.424893+0000","last_peered":"2024-04-21T09:29:36.424893+0000","last_clean":"2024-04-21T09:29:36.424893+0000","last_became_active":"2024-04-21T08:57:44.318119+0000","last_became_peered":"2024-04-21T08:57:44.318119+0000","last_unstale":"2024-04-21T09:29:36.424893+0000","last_undegraded":"2024-04-21T09:29:36.424893+0000","last_fullsized":"2024-04-21T09:29:36.424893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2128,"log_dups_size":0,"ondisk_log_size":2128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:58:47.126807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.9781578479999999,"stat_sum":{"num_bytes":325559,"num_objects":36,"num_object_clones":1,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":1475,"num_read_kb":39572,"num_write":1278,"num_write_kb":56824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"67'609","reported_seq":730,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:04.277545+0000","last_change":"2024-04-21T08:57:43.254601+0000","last_active":"2024-04-21T09:29:04.277545+0000","last_peered":"2024-04-21T09:29:04.277545+0000","last_clean":"2024-04-21T09:29:04.277545+0000","last_became_active":"2024-04-21T08:57:43.253044+0000","last_became_peered":"2024-04-21T08:57:43.253044+0000","last_unstale":"2024-04-21T09:29:04.277545+0000","last_undegraded":"2024-04-21T09:29:04.277545+0000","last_fullsized":"2024-04-21T09:29:04.277545+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":609,"log_dups_size":0,"ondisk_log_size":609,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T15:40:46.371787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":660,"num_write_kb":66902,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"67'2094","reported_seq":5412,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.026596+0000","last_change":"2024-04-21T09:28:44.316999+0000","last_active":"2024-04-21T09:29:36.026596+0000","last_peered":"2024-04-21T09:29:36.026596+0000","last_clean":"2024-04-21T09:29:36.026596+0000","last_became_active":"2024-04-21T08:57:44.304816+0000","last_became_peered":"2024-04-21T08:57:44.304816+0000","last_unstale":"2024-04-21T09:29:36.026596+0000","last_undegraded":"2024-04-21T09:29:36.026596+0000","last_fullsized":"2024-04-21T09:29:36.026596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:56:20.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.5495247060000001,"stat_sum":{"num_bytes":1540725,"num_objects":34,"num_object_clones":1,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":1,"num_read":519,"num_read_kb":31871,"num_write":1252,"num_write_kb":50089,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"67'1449","reported_seq":1569,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:39.657134+0000","last_change":"2024-04-21T08:57:43.254946+0000","last_active":"2024-04-21T09:29:39.657134+0000","last_peered":"2024-04-21T09:29:39.657134+0000","last_clean":"2024-04-21T09:29:39.657134+0000","last_became_active":"2024-04-21T08:57:43.254370+0000","last_became_peered":"2024-04-21T08:57:43.254370+0000","last_unstale":"2024-04-21T09:29:39.657134+0000","last_undegraded":"2024-04-21T09:29:39.657134+0000","last_fullsized":"2024-04-21T09:29:39.657134+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":1449,"log_dups_size":0,"ondisk_log_size":1449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:31:37.503388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":3452,"num_write_kb":59388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":47,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"67'2046","reported_seq":4952,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.690735+0000","last_change":"2024-04-21T09:28:44.214012+0000","last_active":"2024-04-21T09:29:36.690735+0000","last_peered":"2024-04-21T09:29:36.690735+0000","last_clean":"2024-04-21T09:29:36.690735+0000","last_became_active":"2024-04-21T08:57:44.310094+0000","last_became_peered":"2024-04-21T08:57:44.310094+0000","last_unstale":"2024-04-21T09:29:36.690735+0000","last_undegraded":"2024-04-21T09:29:36.690735+0000","last_fullsized":"2024-04-21T09:29:36.690735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:56:20.930162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.4643170409999999,"stat_sum":{"num_bytes":815334,"num_objects":49,"num_object_clones":1,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":1,"num_read":111,"num_read_kb":12886,"num_write":1195,"num_write_kb":26049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"67'380","reported_seq":500,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.658128+0000","last_change":"2024-04-21T08:57:43.261105+0000","last_active":"2024-04-21T09:29:38.658128+0000","last_peered":"2024-04-21T09:29:38.658128+0000","last_clean":"2024-04-21T09:29:38.658128+0000","last_became_active":"2024-04-21T08:57:43.260694+0000","last_became_peered":"2024-04-21T08:57:43.260694+0000","last_unstale":"2024-04-21T09:29:38.658128+0000","last_undegraded":"2024-04-21T09:29:38.658128+0000","last_fullsized":"2024-04-21T09:29:38.658128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:27:01.707451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":409,"num_write_kb":49903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"67'2018","reported_seq":5055,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.252632+0000","last_change":"2024-04-21T09:28:44.178948+0000","last_active":"2024-04-21T09:29:36.252632+0000","last_peered":"2024-04-21T09:29:36.252632+0000","last_clean":"2024-04-21T09:29:36.252632+0000","last_became_active":"2024-04-21T08:57:44.292686+0000","last_became_peered":"2024-04-21T08:57:44.292686+0000","last_unstale":"2024-04-21T09:29:36.252632+0000","last_undegraded":"2024-04-21T09:29:36.252632+0000","last_fullsized":"2024-04-21T09:29:36.252632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2018,"log_dups_size":0,"ondisk_log_size":2018,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:59:31.726512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.4317480490000001,"stat_sum":{"num_bytes":729374,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":203,"num_read_kb":7913,"num_write":1253,"num_write_kb":15412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"67'356","reported_seq":476,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:00.614877+0000","last_change":"2024-04-21T08:57:43.249546+0000","last_active":"2024-04-21T09:29:00.614877+0000","last_peered":"2024-04-21T09:29:00.614877+0000","last_clean":"2024-04-21T09:29:00.614877+0000","last_became_active":"2024-04-21T08:57:43.248319+0000","last_became_peered":"2024-04-21T08:57:43.248319+0000","last_unstale":"2024-04-21T09:29:00.614877+0000","last_undegraded":"2024-04-21T09:29:00.614877+0000","last_fullsized":"2024-04-21T09:29:00.614877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":356,"log_dups_size":0,"ondisk_log_size":356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T10:43:36.525258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":41,"num_read_kb":0,"num_write":397,"num_write_kb":41986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"67'2127","reported_seq":5739,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:35.680789+0000","last_change":"2024-04-21T09:28:45.882121+0000","last_active":"2024-04-21T09:29:35.680789+0000","last_peered":"2024-04-21T09:29:35.680789+0000","last_clean":"2024-04-21T09:29:35.680789+0000","last_became_active":"2024-04-21T08:57:44.291000+0000","last_became_peered":"2024-04-21T08:57:44.291000+0000","last_unstale":"2024-04-21T09:29:35.680789+0000","last_undegraded":"2024-04-21T09:29:35.680789+0000","last_fullsized":"2024-04-21T09:29:35.680789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2127,"log_dups_size":0,"ondisk_log_size":2127,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:59:21.088123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0848153780000001,"stat_sum":{"num_bytes":132963,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":812,"num_read_kb":26529,"num_write":1270,"num_write_kb":40669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"67'359","reported_seq":479,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:51.741494+0000","last_change":"2024-04-21T08:57:43.245644+0000","last_active":"2024-04-21T09:28:51.741494+0000","last_peered":"2024-04-21T09:28:51.741494+0000","last_clean":"2024-04-21T09:28:51.741494+0000","last_became_active":"2024-04-21T08:57:43.245248+0000","last_became_peered":"2024-04-21T08:57:43.245248+0000","last_unstale":"2024-04-21T09:28:51.741494+0000","last_undegraded":"2024-04-21T09:28:51.741494+0000","last_fullsized":"2024-04-21T09:28:51.741494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:23:10.756185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":53,"num_read_kb":0,"num_write":441,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":51,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"67'2237","reported_seq":5650,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.791499+0000","last_change":"2024-04-21T09:28:44.191551+0000","last_active":"2024-04-21T09:29:40.791499+0000","last_peered":"2024-04-21T09:29:40.791499+0000","last_clean":"2024-04-21T09:29:40.791499+0000","last_became_active":"2024-04-21T08:57:44.298160+0000","last_became_peered":"2024-04-21T08:57:44.298160+0000","last_unstale":"2024-04-21T09:29:40.791499+0000","last_undegraded":"2024-04-21T09:29:40.791499+0000","last_fullsized":"2024-04-21T09:29:40.791499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2237,"log_dups_size":0,"ondisk_log_size":2237,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T09:35:53.764335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.445869871,"stat_sum":{"num_bytes":160945,"num_objects":45,"num_object_clones":2,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":2,"num_read":643,"num_read_kb":28195,"num_write":1321,"num_write_kb":52339,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"67'555","reported_seq":675,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:00.620905+0000","last_change":"2024-04-21T08:57:43.258308+0000","last_active":"2024-04-21T09:29:00.620905+0000","last_peered":"2024-04-21T09:29:00.620905+0000","last_clean":"2024-04-21T09:29:00.620905+0000","last_became_active":"2024-04-21T08:57:43.257792+0000","last_became_peered":"2024-04-21T08:57:43.257792+0000","last_unstale":"2024-04-21T09:29:00.620905+0000","last_undegraded":"2024-04-21T09:29:00.620905+0000","last_fullsized":"2024-04-21T09:29:00.620905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":555,"log_dups_size":0,"ondisk_log_size":555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T11:55:06.981188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":40,"num_read_kb":0,"num_write":590,"num_write_kb":74705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"67'2172","reported_seq":5432,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.182892+0000","last_change":"2024-04-21T09:28:43.578133+0000","last_active":"2024-04-21T09:29:36.182892+0000","last_peered":"2024-04-21T09:29:36.182892+0000","last_clean":"2024-04-21T09:29:36.182892+0000","last_became_active":"2024-04-21T08:57:44.317393+0000","last_became_peered":"2024-04-21T08:57:44.317393+0000","last_unstale":"2024-04-21T09:29:36.182892+0000","last_undegraded":"2024-04-21T09:29:36.182892+0000","last_fullsized":"2024-04-21T09:29:36.182892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2172,"log_dups_size":0,"ondisk_log_size":2172,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T14:16:18.367372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.79564842000000002,"stat_sum":{"num_bytes":1395371,"num_objects":36,"num_object_clones":1,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":485,"num_read_kb":25033,"num_write":1280,"num_write_kb":33453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"67'752","reported_seq":872,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:14.279146+0000","last_change":"2024-04-21T08:57:43.257891+0000","last_active":"2024-04-21T09:29:14.279146+0000","last_peered":"2024-04-21T09:29:14.279146+0000","last_clean":"2024-04-21T09:29:14.279146+0000","last_became_active":"2024-04-21T08:57:43.257379+0000","last_became_peered":"2024-04-21T08:57:43.257379+0000","last_unstale":"2024-04-21T09:29:14.279146+0000","last_undegraded":"2024-04-21T09:29:14.279146+0000","last_fullsized":"2024-04-21T09:29:14.279146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":752,"log_dups_size":0,"ondisk_log_size":752,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:35:46.949715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":36,"num_read_kb":0,"num_write":804,"num_write_kb":83255,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":37,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"67'2076","reported_seq":5236,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.519634+0000","last_change":"2024-04-21T09:28:45.901687+0000","last_active":"2024-04-21T09:29:03.519634+0000","last_peered":"2024-04-21T09:29:03.519634+0000","last_clean":"2024-04-21T09:29:03.519634+0000","last_became_active":"2024-04-21T08:57:44.298841+0000","last_became_peered":"2024-04-21T08:57:44.298841+0000","last_unstale":"2024-04-21T09:29:03.519634+0000","last_undegraded":"2024-04-21T09:29:03.519634+0000","last_fullsized":"2024-04-21T09:29:03.519634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2076,"log_dups_size":0,"ondisk_log_size":2076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:19:28.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.0999314830000002,"stat_sum":{"num_bytes":1086074,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":349,"num_read_kb":27188,"num_write":1258,"num_write_kb":33779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"67'2079","reported_seq":5570,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.078888+0000","last_change":"2024-04-21T09:28:45.945101+0000","last_active":"2024-04-21T09:29:36.078888+0000","last_peered":"2024-04-21T09:29:36.078888+0000","last_clean":"2024-04-21T09:29:36.078888+0000","last_became_active":"2024-04-21T08:57:44.320483+0000","last_became_peered":"2024-04-21T08:57:44.320483+0000","last_unstale":"2024-04-21T09:29:36.078888+0000","last_undegraded":"2024-04-21T09:29:36.078888+0000","last_fullsized":"2024-04-21T09:29:36.078888+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T13:05:07.065915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":3.1423554660000002,"stat_sum":{"num_bytes":179048,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":699,"num_read_kb":42586,"num_write":1227,"num_write_kb":54777,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"67'423","reported_seq":541,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:38.655227+0000","last_change":"2024-04-21T08:57:43.249660+0000","last_active":"2024-04-21T09:29:38.655227+0000","last_peered":"2024-04-21T09:29:38.655227+0000","last_clean":"2024-04-21T09:29:38.655227+0000","last_became_active":"2024-04-21T08:57:43.248515+0000","last_became_peered":"2024-04-21T08:57:43.248515+0000","last_unstale":"2024-04-21T09:29:38.655227+0000","last_undegraded":"2024-04-21T09:29:38.655227+0000","last_fullsized":"2024-04-21T09:29:38.655227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:53:05.774612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":470,"num_write_kb":62370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":33,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"67'2258","reported_seq":5102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:40.782315+0000","last_change":"2024-04-21T09:28:43.971613+0000","last_active":"2024-04-21T09:29:40.782315+0000","last_peered":"2024-04-21T09:29:40.782315+0000","last_clean":"2024-04-21T09:29:40.782315+0000","last_became_active":"2024-04-21T08:57:44.315489+0000","last_became_peered":"2024-04-21T08:57:44.315489+0000","last_unstale":"2024-04-21T09:29:40.782315+0000","last_undegraded":"2024-04-21T09:29:40.782315+0000","last_fullsized":"2024-04-21T09:29:40.782315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2258,"log_dups_size":0,"ondisk_log_size":2258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:01:56.665478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":1.185004465,"stat_sum":{"num_bytes":690226,"num_objects":56,"num_object_clones":2,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":2,"num_read":99,"num_read_kb":9295,"num_write":1329,"num_write_kb":26562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"67'706","reported_seq":824,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.224391+0000","last_change":"2024-04-21T08:57:43.257932+0000","last_active":"2024-04-21T09:29:07.224391+0000","last_peered":"2024-04-21T09:29:07.224391+0000","last_clean":"2024-04-21T09:29:07.224391+0000","last_became_active":"2024-04-21T08:57:43.257421+0000","last_became_peered":"2024-04-21T08:57:43.257421+0000","last_unstale":"2024-04-21T09:29:07.224391+0000","last_undegraded":"2024-04-21T09:29:07.224391+0000","last_fullsized":"2024-04-21T09:29:07.224391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":706,"log_dups_size":0,"ondisk_log_size":706,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T17:28:15.907719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":740,"num_write_kb":107556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"67'2032","reported_seq":5718,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:03.458919+0000","last_change":"2024-04-21T09:28:45.672192+0000","last_active":"2024-04-21T09:29:03.458919+0000","last_peered":"2024-04-21T09:29:03.458919+0000","last_clean":"2024-04-21T09:29:03.458919+0000","last_became_active":"2024-04-21T08:57:44.302576+0000","last_became_peered":"2024-04-21T08:57:44.302576+0000","last_unstale":"2024-04-21T09:29:03.458919+0000","last_undegraded":"2024-04-21T09:29:03.458919+0000","last_fullsized":"2024-04-21T09:29:03.458919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2032,"log_dups_size":0,"ondisk_log_size":2032,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T12:16:42.323653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9215196670000001,"stat_sum":{"num_bytes":460753,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":879,"num_read_kb":31992,"num_write":1204,"num_write_kb":36967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"67'626","reported_seq":747,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:28:51.747727+0000","last_change":"2024-04-21T08:57:43.248085+0000","last_active":"2024-04-21T09:28:51.747727+0000","last_peered":"2024-04-21T09:28:51.747727+0000","last_clean":"2024-04-21T09:28:51.747727+0000","last_became_active":"2024-04-21T08:57:43.247418+0000","last_became_peered":"2024-04-21T08:57:43.247418+0000","last_unstale":"2024-04-21T09:28:51.747727+0000","last_undegraded":"2024-04-21T09:28:51.747727+0000","last_fullsized":"2024-04-21T09:28:51.747727+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":626,"log_dups_size":0,"ondisk_log_size":626,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T18:03:16.833057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":42,"num_read_kb":0,"num_write":667,"num_write_kb":62545,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"67'2040","reported_seq":5128,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:36.588200+0000","last_change":"2024-04-21T09:28:45.704191+0000","last_active":"2024-04-21T09:29:36.588200+0000","last_peered":"2024-04-21T09:29:36.588200+0000","last_clean":"2024-04-21T09:29:36.588200+0000","last_became_active":"2024-04-21T08:57:44.301650+0000","last_became_peered":"2024-04-21T08:57:44.301650+0000","last_unstale":"2024-04-21T09:29:36.588200+0000","last_undegraded":"2024-04-21T09:29:36.588200+0000","last_fullsized":"2024-04-21T09:29:36.588200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:43.216267+0000","last_clean_scrub_stamp":"2024-04-21T08:57:43.216267+0000","objects_scrubbed":0,"log_size":2040,"log_dups_size":0,"ondisk_log_size":2040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T16:19:28.773035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":2.9540837450000001,"stat_sum":{"num_bytes":129518,"num_objects":35,"num_object_clones":1,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":1,"num_read":270,"num_read_kb":25102,"num_write":1239,"num_write_kb":36876,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"67'644","reported_seq":765,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-21T09:29:07.639693+0000","last_change":"2024-04-21T08:57:43.248503+0000","last_active":"2024-04-21T09:29:07.639693+0000","last_peered":"2024-04-21T09:29:07.639693+0000","last_clean":"2024-04-21T09:29:07.639693+0000","last_became_active":"2024-04-21T08:57:43.247781+0000","last_became_peered":"2024-04-21T08:57:43.247781+0000","last_unstale":"2024-04-21T09:29:07.639693+0000","last_undegraded":"2024-04-21T09:29:07.639693+0000","last_fullsized":"2024-04-21T09:29:07.639693+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-21T08:57:42.205467+0000","last_clean_scrub_stamp":"2024-04-21T08:57:42.205467+0000","objects_scrubbed":0,"log_size":644,"log_dups_size":0,"ondisk_log_size":644,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-22T20:38:11.154425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360710,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":46,"num_read_kb":0,"num_write":737,"num_write_kb":50570,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":50927605,"num_objects":2418,"num_object_clones":50,"num_object_copies":4836,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2418,"num_whiteouts":50,"num_read":38674,"num_read_kb":2025856,"num_write":80454,"num_write_kb":2887997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":76849152,"data_stored":101855210,"data_compressed":30508016,"data_compressed_allocated":33341440,"data_compressed_original":70082560,"omap_allocated":0,"internal_metadata":0},"log_size":135812,"ondisk_log_size":135812,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":625561753,"num_objects":1538,"num_object_clones":0,"num_object_copies":3076,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1538,"num_whiteouts":0,"num_read":3023,"num_read_kb":5844,"num_write":24984,"num_write_kb":2246854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1324,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":227540992,"data_stored":1251130898,"data_compressed":172334250,"data_compressed_allocated":211615744,"data_compressed_original":1235263488,"omap_allocated":0,"internal_metadata":0},"log_size":21404,"ondisk_log_size":21404,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66876,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509828,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214980,"kb_used_data":45052,"kb_used_omap":1,"kb_used_meta":169918,"kb_avail":94156860,"statfs":{"total":96636764160,"available":96416624640,"internally_reserved":0,"allocated":46133248,"data_stored":196650298,"data_compressed":29084848,"data_compressed_allocated":35250176,"data_compressed_original":187887616,"omap_allocated":1593,"internal_metadata":173996487},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509828,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169616,"kb_used_data":26056,"kb_used_omap":1,"kb_used_meta":143550,"kb_avail":94202224,"statfs":{"total":96636764160,"available":96463077376,"internally_reserved":0,"allocated":26681344,"data_stored":118707546,"data_compressed":17859376,"data_compressed_allocated":21331968,"data_compressed_original":115421184,"omap_allocated":1595,"internal_metadata":146995653},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509829,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":165340,"kb_used_data":35668,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94206500,"statfs":{"total":96636764160,"available":96467456000,"internally_reserved":0,"allocated":36524032,"data_stored":170834582,"data_compressed":26330109,"data_compressed_allocated":31559680,"data_compressed_original":167571456,"omap_allocated":1595,"internal_metadata":132774341},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509829,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":237348,"kb_used_data":53596,"kb_used_omap":1,"kb_used_meta":183742,"kb_avail":94134492,"statfs":{"total":96636764160,"available":96393719808,"internally_reserved":0,"allocated":54882304,"data_stored":243120354,"data_compressed":36145809,"data_compressed_allocated":43544576,"data_compressed_original":234237952,"omap_allocated":1595,"internal_metadata":188152261},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542531,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":157972,"kb_used_data":28300,"kb_used_omap":1,"kb_used_meta":129662,"kb_avail":94213868,"statfs":{"total":96636764160,"available":96475000832,"internally_reserved":0,"allocated":28979200,"data_stored":126490268,"data_compressed":18320081,"data_compressed_allocated":22302720,"data_compressed_original":121176064,"omap_allocated":1590,"internal_metadata":132774346},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542532,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198992,"kb_used_data":41544,"kb_used_omap":1,"kb_used_meta":157438,"kb_avail":94172848,"statfs":{"total":96636764160,"available":96432996352,"internally_reserved":0,"allocated":42541056,"data_stored":180583845,"data_compressed":27544803,"data_compressed_allocated":33165312,"data_compressed_original":173215744,"omap_allocated":1595,"internal_metadata":161216965},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575237,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":143996,"kb_used_data":26804,"kb_used_omap":1,"kb_used_meta":117182,"kb_avail":94227844,"statfs":{"total":96636764160,"available":96489312256,"internally_reserved":0,"allocated":27447296,"data_stored":108621838,"data_compressed":17225932,"data_compressed_allocated":20799488,"data_compressed_original":103698432,"omap_allocated":1594,"internal_metadata":119994822},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":207300,"kb_used_data":45756,"kb_used_omap":1,"kb_used_meta":161534,"kb_avail":94164540,"statfs":{"total":96636764160,"available":96424488960,"internally_reserved":0,"allocated":46854144,"data_stored":207868337,"data_compressed":29861034,"data_compressed_allocated":36425728,"data_compressed_original":199094272,"omap_allocated":1594,"internal_metadata":165411270},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33438,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":41443328,"data_stored":226492472,"data_compressed":31902653,"data_compressed_allocated":38887424,"data_compressed_original":223944704,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28999680,"data_stored":160000001,"data_compressed":22336660,"data_compressed_allocated":27205632,"data_compressed_original":158212096,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19116032,"data_stored":109052576,"data_compressed":14473114,"data_compressed_allocated":17641472,"data_compressed_original":107585536,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":33767424,"data_stored":184549958,"data_compressed":25119139,"data_compressed_allocated":31006720,"data_compressed_original":181792768,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":35598336,"data_stored":193543649,"data_compressed":26239825,"data_compressed_allocated":32456704,"data_compressed_original":190418944,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29315072,"data_stored":163582614,"data_compressed":22746011,"data_compressed_allocated":27934720,"data_compressed_original":162209792,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17940480,"data_stored":96468992,"data_compressed":13648580,"data_compressed_allocated":16875520,"data_compressed_original":95404032,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":21360640,"data_stored":117440636,"data_compressed":15868268,"data_compressed_allocated":19607552,"data_compressed_original":115695616,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12664832,"data_stored":16264816,"data_compressed":4243156,"data_compressed_allocated":4657152,"data_compressed_original":10293248,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6684672,"data_stored":9881147,"data_compressed":3960011,"data_compressed_allocated":4308992,"data_compressed_original":8785920,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6791168,"data_stored":9291904,"data_compressed":3386262,"data_compressed_allocated":3690496,"data_compressed_original":7835648,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12263424,"data_stored":15931578,"data_compressed":4502859,"data_compressed_allocated":4911104,"data_compressed_original":10285056,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10481664,"data_stored":13961622,"data_compressed":3621209,"data_compressed_allocated":3969024,"data_compressed_original":8675328,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12386304,"data_stored":16047797,"data_compressed":4765354,"data_compressed_allocated":5185536,"data_compressed_original":10432512,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8732672,"data_stored":11789780,"data_compressed":3577352,"data_compressed_allocated":3923968,"data_compressed_original":8294400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6844416,"data_stored":8686566,"data_compressed":2451813,"data_compressed_allocated":2695168,"data_compressed_original":5480448,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-21T09:29:45.562 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-21T09:29:45.562 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-21T09:29:45.597 INFO:tasks.ceph.osd.0:Sent signal 15 2024-04-21T09:29:45.597 INFO:tasks.ceph.osd.1:Sent signal 15 2024-04-21T09:29:45.597 INFO:tasks.ceph.osd.2:Sent signal 15 2024-04-21T09:29:45.598 INFO:tasks.ceph.osd.3:Sent signal 15 2024-04-21T09:29:45.598 INFO:tasks.ceph.osd.4:Sent signal 15 2024-04-21T09:29:45.598 INFO:tasks.ceph.osd.5:Sent signal 15 2024-04-21T09:29:45.599 INFO:tasks.ceph.osd.6:Sent signal 15 2024-04-21T09:29:45.599 INFO:tasks.ceph.osd.7:Sent signal 15 2024-04-21T09:29:45.599 INFO:tasks.ceph.mds.a:Sent signal 15 2024-04-21T09:29:45.599 INFO:tasks.ceph.mds.c:Sent signal 15 2024-04-21T09:29:45.600 INFO:tasks.ceph.mds.e:Sent signal 15 2024-04-21T09:29:45.600 INFO:tasks.ceph.mds.b:Sent signal 15 2024-04-21T09:29:45.600 INFO:tasks.ceph.mds.d:Sent signal 15 2024-04-21T09:29:45.600 INFO:tasks.ceph.mds.f:Sent signal 15 2024-04-21T09:29:45.601 INFO:tasks.ceph.mon.a:Sent signal 15 2024-04-21T09:29:45.601 INFO:tasks.ceph.mon.b:Sent signal 15 2024-04-21T09:29:45.601 INFO:tasks.ceph.mon.c:Sent signal 15 2024-04-21T09:29:45.601 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-04-21T09:29:45.602 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-04-21T09:29:45.602 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-21T09:29:45.600+0000 7fb150c84640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 27884) UID: 0 2024-04-21T09:29:45.602 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-21T09:29:45.600+0000 7fb150c84640 -1 osd.4 67 *** Got signal Terminated *** 2024-04-21T09:29:45.603 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-04-21T09:29:45.600+0000 7fb150c84640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.603 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f32ac9f3640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 27883) UID: 0 2024-04-21T09:29:45.603 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f32ac9f3640 -1 osd.5 67 *** Got signal Terminated *** 2024-04-21T09:29:45.603 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f32ac9f3640 -1 osd.5 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.604 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f6c9742f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 27887) UID: 0 2024-04-21T09:29:45.604 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f6c9742f640 -1 osd.6 67 *** Got signal Terminated *** 2024-04-21T09:29:45.604 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f6c9742f640 -1 osd.6 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.604 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f9e19c14640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 27889) UID: 0 2024-04-21T09:29:45.604 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f9e19c14640 -1 osd.7 67 *** Got signal Terminated *** 2024-04-21T09:29:45.605 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f9e19c14640 -1 osd.7 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.605 INFO:tasks.ceph.mds.b.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f4b797fa640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 31500) UID: 0 2024-04-21T09:29:45.605 INFO:tasks.ceph.mds.b.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f4b797fa640 -1 mds.b *** got signal Terminated *** 2024-04-21T09:29:45.605 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f41f8546640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i f (PID: 31504) UID: 0 2024-04-21T09:29:45.606 INFO:tasks.ceph.mds.f.smithi169.stderr:2024-04-21T09:29:45.600+0000 7f41f8546640 -1 mds.f *** got signal Terminated *** 2024-04-21T09:29:45.606 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-04-21T09:29:45.600+0000 7fe70a6a7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 31502) UID: 0 2024-04-21T09:29:45.606 INFO:tasks.ceph.mds.d.smithi169.stderr:2024-04-21T09:29:45.600+0000 7fe70a6a7640 -1 mds.d *** got signal Terminated *** 2024-04-21T09:29:45.606 INFO:tasks.ceph.mon.b.smithi169.stderr:2024-04-21T09:29:45.604+0000 7f5445a29640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 27569) UID: 0 2024-04-21T09:29:45.607 INFO:tasks.ceph.mon.b.smithi169.stderr:2024-04-21T09:29:45.604+0000 7f5445a29640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-21T09:29:45.607 INFO:tasks.ceph.mon.c.smithi169.stderr:2024-04-21T09:29:45.604+0000 7f3c65ba8640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 27572) UID: 0 2024-04-21T09:29:45.607 INFO:tasks.ceph.mon.c.smithi169.stderr:2024-04-21T09:29:45.604+0000 7f3c65ba8640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-21T09:29:45.608 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T09:29:45.604+0000 7f1ce6e37640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 27574) UID: 0 2024-04-21T09:29:45.608 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-04-21T09:29:45.604+0000 7f1ce6e37640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-21T09:29:45.608 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f81b4a9f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 27556) UID: 0 2024-04-21T09:29:45.608 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f81b4a9f640 -1 osd.1 67 *** Got signal Terminated *** 2024-04-21T09:29:45.609 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f81b4a9f640 -1 osd.1 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.609 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f8fb0e22640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 27449) UID: 0 2024-04-21T09:29:45.609 INFO:tasks.ceph.mon.a.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f8fb0e22640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-21T09:29:45.609 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f2ced4bc640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 27557) UID: 0 2024-04-21T09:29:45.610 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f2ced4bc640 -1 osd.2 67 *** Got signal Terminated *** 2024-04-21T09:29:45.610 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f2ced4bc640 -1 osd.2 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.610 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f5463b51640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 27560) UID: 0 2024-04-21T09:29:45.610 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f5463b51640 -1 osd.3 67 *** Got signal Terminated *** 2024-04-21T09:29:45.611 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f5463b51640 -1 osd.3 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.611 INFO:tasks.ceph.mds.a.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f0fb9075640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 31135) UID: 0 2024-04-21T09:29:45.611 INFO:tasks.ceph.mds.a.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f0fb9075640 -1 mds.a *** got signal Terminated *** 2024-04-21T09:29:45.611 INFO:tasks.ceph.mds.c.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f083f9d4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 31137) UID: 0 2024-04-21T09:29:45.612 INFO:tasks.ceph.mds.c.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f083f9d4640 -1 mds.c *** got signal Terminated *** 2024-04-21T09:29:45.612 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-21T09:29:45.602+0000 7ff9e01d6640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 27553) UID: 0 2024-04-21T09:29:45.612 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-21T09:29:45.602+0000 7ff9e01d6640 -1 osd.0 67 *** Got signal Terminated *** 2024-04-21T09:29:45.612 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-21T09:29:45.602+0000 7ff9e01d6640 -1 osd.0 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-21T09:29:45.613 INFO:tasks.ceph.mds.e.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f55227c4640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mds -f --cluster ceph -i e (PID: 31139) UID: 0 2024-04-21T09:29:45.613 INFO:tasks.ceph.mds.e.smithi026.stderr:2024-04-21T09:29:45.602+0000 7f55227c4640 -1 mds.e *** got signal Terminated *** 2024-04-21T09:29:45.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.718+0000 7f44cc1a0640 1 Processor -- start 2024-04-21T09:29:45.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.718+0000 7f44cc1a0640 1 -- start start 2024-04-21T09:29:45.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44cc1a0640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 0x7f44c4158e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44cc1a0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 0x7f44c415ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44cc1a0640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44c414e1e0 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44cc1a0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44c415a800 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44cc1a0640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44c41589e0 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 msgr2=0x7f44c415ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 0x7f44c415ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 msgr2=0x7f44c4158e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44c414e1e0 legacy=0x7f44c406de70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:45.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.722+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 0x7f44c4158e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:45.803 INFO:tasks.ceph.mgr.y.smithi026.stderr:daemon-helper: command crashed with signal 15 2024-04-21T09:29:45.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.926+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 msgr2=0x7f44c415ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:45.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.926+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44c414e1e0 legacy=0x7f44c406de70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:45.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.926+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 0x7f44c415ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:45.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.926+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 msgr2=0x7f44c4158e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:45.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:45.926+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 0x7f44c4158e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:46.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:46.330+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 msgr2=0x7f44c415ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:46.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:46.330+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44c414e1e0 legacy=0x7f44c406de70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:46.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:46.330+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 msgr2=0x7f44c4158e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:46.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:46.330+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 0x7f44c415ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:46.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:46.330+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 0x7f44c4158e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:47.134+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 msgr2=0x7f44c415ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:47.134+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 0x7f44c415ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:47.134+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 msgr2=0x7f44c4158e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:47.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:47.134+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44c414e1e0 legacy=0x7f44c406de70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:47.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:47.134+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 0x7f44c4158e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 msgr2=0x7f44c4158e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44c41589e0 0x7f44c4158e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:48.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 msgr2=0x7f44c415ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44c415a800 0x7f44c415ac90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44c414e1e0 legacy=0x7f44c406de70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 0x7f44a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a8004190 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a80036d0 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 msgr2=0x7f44a8003b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:48.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.722+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 0x7f44a8003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:48.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.926+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:48.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.926+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 msgr2=0x7f44a8003b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:48.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:48.926+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 0x7f44a8003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:49.330+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:49.330+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 msgr2=0x7f44a8003b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:49.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:49.330+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 0x7f44a8003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:50.134+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:50.134+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 msgr2=0x7f44a8003b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:50.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:50.134+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 0x7f44a8003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:51.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 msgr2=0x7f44a8003b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:51.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80036d0 0x7f44a8003b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:51.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:51.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:29:51.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:51.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 0x7f44a800cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8004190 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800c650 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 msgr2=0x7f44a800cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 0x7f44a800cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:51.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.726+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.930+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.930+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 msgr2=0x7f44a800cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.930+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.930+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 0x7f44a800cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:51.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:51.930+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:52.334+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:52.334+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 msgr2=0x7f44a800cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:52.334+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:52.334+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 0x7f44a800cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:52.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:52.334+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:53.138+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:29:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:53.138+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 msgr2=0x7f44a800cb00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:53.138+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:53.138+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 0x7f44a800cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:53.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:53.138+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:54.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:54.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:54.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 msgr2=0x7f44a800cb00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800c650 0x7f44a800cb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8004190 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a800f310 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800fec0 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:54.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.722+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800f310 legacy=0x7f44a800f720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:54.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.926+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:54.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.926+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:54.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:54.926+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800f310 legacy=0x7f44a800f720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:55.330+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:55.330+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:55.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:55.330+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800f310 legacy=0x7f44a800f720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:56.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:56.134+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:56.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:56.134+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:56.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:56.134+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800f310 legacy=0x7f44a800f720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:29:57.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:57.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:29:57.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800f310 legacy=0x7f44a800f720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:29:57.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:57.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:29:57.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:57.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:29:57.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800fec0 2024-04-21T09:29:57.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:29:57.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44a800fc30 con 0x7f44a800cb20 2024-04-21T09:29:57.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:57.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:57.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:57.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:57.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:57.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.726+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:29:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.929+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.929+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.929+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.929+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.929+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:57.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:57.929+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:29:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:58.333+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:58.333+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:58.333+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:58.333+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:58.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:58.333+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:58.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:58.333+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:29:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:59.137+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:29:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:59.137+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:59.137+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:29:59.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:59.137+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:29:59.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:59.137+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:29:59.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:29:59.137+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:00.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800cb20 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a80154d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a80154d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8016160 2024-04-21T09:30:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a8015c50 2024-04-21T09:30:00.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016160 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:00.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.725+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:00.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.929+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016160 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:00.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:00.929+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:01.333+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016160 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:01.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:01.333+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:02.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:02.137+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016160 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:02.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:02.137+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:03.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:30:03.596 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:30:03.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a800a870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:03.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016160 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a8014bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a8015c50 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800fec0 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:03.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:03.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:03.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.721+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.925+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.925+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.925+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.925+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:03.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:03.925+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:04.329+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:04.329+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:04.329+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:04.329+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:04.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:04.329+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:05.133+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:05.133+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:05.133+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:05.133+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:05.135 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:05.133+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:06.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:06.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:06.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:06.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800fec0 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:06.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:06.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:06.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a800ca60 2024-04-21T09:30:06.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016160 2024-04-21T09:30:06.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.721+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:06.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.725+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:06.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.725+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:06.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.929+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:06.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.929+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:06.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:06.929+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:07.333+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:07.333+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:07.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:07.333+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:08.137+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:08.137+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:08.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:08.137+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:09.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:09.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:09.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a800ca60 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8015c50 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8003b40 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:09.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.725+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.929+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.929+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.929+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:09.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:09.929+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:10.333+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:10.333+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:10.333+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:10.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:10.333+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:11.137+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:11.137+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:11.137+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:11.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:11.137+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:12.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:12.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:12.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8015110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ca60 legacy=0x7f44a80124b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 0x7f44a8014bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016160 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a800fe90 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:12.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:12.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.725+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.929+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.929+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.929+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:12.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:12.929+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:13.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:13.333+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:13.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:13.333+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:13.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:13.333+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:13.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:13.333+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:14.137+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:14.137+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:14.137+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:14.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:14.137+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 msgr2=0x7f44a8014bd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800fe90 0x7f44a8014bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:15.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 0x7f44a8019ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016160 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44a800fc30 con 0x7f44a800a850 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 msgr2=0x7f44a8019ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:15.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:15.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:15.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 0x7f44a8019ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:15.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.725+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:15.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.929+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:15.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.929+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:15.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.929+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 msgr2=0x7f44a8019ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:15.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.929+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:15.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.929+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 0x7f44a8019ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:15.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:15.929+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:16.333+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:16.333+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:16.333+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 msgr2=0x7f44a8019ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:16.333+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:16.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:16.333+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 0x7f44a8019ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:16.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:16.333+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:17.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:17.137+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:17.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:17.137+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:17.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:17.137+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 msgr2=0x7f44a8019ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:17.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:17.137+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:17.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:17.137+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 0x7f44a8019ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:17.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:17.137+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 msgr2=0x7f44a8019ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800a850 0x7f44a8019ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a8015c50 2024-04-21T09:30:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a800cb00 2024-04-21T09:30:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.729+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800cb00 legacy=0x7f44a8017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:18.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.933+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:18.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:18.933+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800cb00 legacy=0x7f44a8017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:19.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:19.337+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:19.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:19.337+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800cb00 legacy=0x7f44a8017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:20.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:20.141+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:20.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:20.141+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800cb00 legacy=0x7f44a8017290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:21.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a800cb00 legacy=0x7f44a8017290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8015c50 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a80114b0 2024-04-21T09:30:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016160 2024-04-21T09:30:21.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:30:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:21.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.729+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:21.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.933+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:21.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.933+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:21.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.933+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:21.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.933+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:21.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:21.933+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:22.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:22.337+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:22.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:22.337+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:22.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:22.337+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:22.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:22.337+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:22.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:22.337+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:23.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:23.141+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:23.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:23.141+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:23.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:23.141+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:23.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:23.141+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:23.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:23.141+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016160 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:24.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a8014fc0 2024-04-21T09:30:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a80153d0 2024-04-21T09:30:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:24.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.729+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:24.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.933+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:24.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.933+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:24.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:24.933+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:25.337+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:25.337+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:25.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:25.337+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:26.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:26.141+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:26.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:26.141+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:26.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:26.141+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8014fc0 2024-04-21T09:30:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a80114b0 2024-04-21T09:30:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a80153d0 2024-04-21T09:30:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:27.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a800a850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.725+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.929+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.929+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a800a850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.929+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:27.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:27.929+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:28.333+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:28.333+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a800a850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:28.333+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:28.333+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:29.137+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:29.136 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:29.137+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a800a850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:29.137+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:29.137 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:29.137+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:30.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:30.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:30.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a800a850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:30.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8014fc0 legacy=0x7f44a8016b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:30.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:30.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:30.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016130 2024-04-21T09:30:30.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:30:30.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:30.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:30.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:30.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.729+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.933+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.933+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.933+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:30.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:30.933+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:31.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:31.337+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:31.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:31.337+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:31.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:31.337+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:31.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:31.337+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:32.141+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:32.141+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:32.141+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:32.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:32.141+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:33.634 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:30:33.637 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:30:33.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:33.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:33.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:33.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:33.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:33.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:33.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:33.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:33.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016130 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a80153d0 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44a800fc30 con 0x7f44a8003b40 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:33.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.725+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:33.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.929+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:33.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.929+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:33.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.929+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:33.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.929+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:33.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.929+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:33.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:33.929+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:34.333+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:34.333+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:34.333+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:34.333+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:34.333+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:34.333+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:35.137+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:35.137+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:35.137+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:35.139 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:35.137+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:35.137+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:35.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:35.137+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:36.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:36.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a800a830 2024-04-21T09:30:36.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a80173c0 2024-04-21T09:30:36.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:36.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.729+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.933+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:36.933+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:37.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:37.337+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:37.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:37.337+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:38.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:38.141+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:38.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:38.141+0000 7f44c9f3c640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a800a830 2024-04-21T09:30:39.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a80173c0 2024-04-21T09:30:39.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a80153d0 2024-04-21T09:30:39.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:39.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:39.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:39.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.729+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.933+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.933+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.933+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:39.933+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:40.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:40.337+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:40.337+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:40.337+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:40.337+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:41.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:41.141+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:41.141+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:41.141+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:41.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:41.141+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:42.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:42.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80153d0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:42.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:42.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:42.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:42.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:42.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8003b40 2024-04-21T09:30:42.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8016130 2024-04-21T09:30:42.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:42.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:42.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:42.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.729+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:42.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.933+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:42.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.933+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:42.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.933+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:42.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:42.933+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:43.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:43.337+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:43.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:43.337+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:43.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:43.337+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:43.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:43.337+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:44.141+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:44.141+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:44.141+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:44.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:44.141+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:45.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a800f6f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:45.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a800f6f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:45.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:45.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:45.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a800a830 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a80173c0 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8003b40 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:45.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.729+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:45.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.933+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.933+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:45.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.933+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:45.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:45.933+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:46.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:46.337+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:46.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:46.337+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:46.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:46.337+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:46.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:46.337+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:47.141+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:47.141+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:47.141+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:47.141+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:48.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c110 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:48.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80173c0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a830 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8019b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 0x7f44a800b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800f6f0 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8016130 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:48.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 msgr2=0x7f44a800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:48.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 0x7f44a800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:48.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.729+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:48.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.933+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:48.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.933+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 msgr2=0x7f44a800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:48.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.933+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 0x7f44a800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:48.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:48.933+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:49.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:49.337+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 msgr2=0x7f44a800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:49.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:49.337+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:49.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:49.337+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 0x7f44a800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:49.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:49.337+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:50.141+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:50.140 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:50.141+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 msgr2=0x7f44a800b3a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:50.141+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 0x7f44a800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:50.141 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:50.141+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:51.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:51.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:51.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 msgr2=0x7f44a800b3a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800f6f0 0x7f44a800b3a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a8017260 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8016130 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8003b40 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8017260 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:51.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:51.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.733+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:51.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.937+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8017260 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:51.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.937+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:51.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.937+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:51.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:51.937+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:52.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:52.341+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8017260 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:52.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:52.341+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:52.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:52.341+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:52.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:52.341+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:53.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:53.145+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8017260 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:53.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:53.145+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:30:53.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:53.145+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:53.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:53.145+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:54.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8017260 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8019b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 0x7f44a8009810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800b780 2024-04-21T09:30:54.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a800b3a0 2024-04-21T09:30:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 msgr2=0x7f44a8009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 0x7f44a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:54.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.733+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.937+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 msgr2=0x7f44a8009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.937+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 0x7f44a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.937+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:54.937+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:55.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:55.341+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 msgr2=0x7f44a8009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:55.341+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 0x7f44a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:55.341+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:55.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:55.341+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:56.145+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 msgr2=0x7f44a8009810 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:30:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:56.145+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 0x7f44a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:56.145+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:56.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:56.145+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:30:57.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8019b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8019b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 msgr2=0x7f44a8009810 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:30:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800b780 0x7f44a8009810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:30:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:30:57.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:30:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a800b3a0 2024-04-21T09:30:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a8016130 2024-04-21T09:30:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8003b40 2024-04-21T09:30:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b3a0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:57.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.733+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:30:57.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.937+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b3a0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:57.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.937+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:57.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.937+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:57.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:57.937+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:30:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:58.341+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b3a0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:58.341+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:58.341+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:58.341+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:30:59.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:59.145+0000 7f44ca73d640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b3a0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:30:59.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:59.145+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:30:59.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:59.145+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:30:59.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:30:59.145+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:00.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b3a0 legacy=0x7f44a8016b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 0x7f44a8019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8017260 2024-04-21T09:31:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a800a7f0 2024-04-21T09:31:00.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:00.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.732+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:00.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.936+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:00.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.936+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:00.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.936+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:00.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:00.936+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:01.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:01.340+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:01.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:01.340+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:01.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:01.340+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:01.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:01.340+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:02.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:02.144+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:02.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:02.144+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:02.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:02.144+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:02.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:02.144+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8017260 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:31:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8016130 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8003b40 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a800a7f0 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.732+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:03.770 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:03.773 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:03.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.936+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:03.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.936+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:03.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.936+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:03.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.936+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:03.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:03.936+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:04.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:04.340+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:04.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:04.340+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:04.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:04.340+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:04.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:04.340+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:04.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:04.340+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:05.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:05.144+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:05.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:05.144+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:05.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:05.144+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:05.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:05.144+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:05.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:05.144+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:06.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:06.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:06.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:06.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:06.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:06.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8007590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a800bb60 2024-04-21T09:31:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800b3a0 2024-04-21T09:31:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800bb60 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:06.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.732+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.936+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800bb60 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.936+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:06.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:06.936+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:07.340+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800bb60 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:07.340+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:07.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:07.340+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:08.144+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800bb60 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:08.144+0000 7f44c973b640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:08.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:08.144+0000 7f44c973b640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:09.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 msgr2=0x7f44a8007590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:09.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a800b3a0 0x7f44a8007590 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:09.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800bb60 legacy=0x7f44a800ac90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:09.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:31:09.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:09.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:09.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8016130 2024-04-21T09:31:09.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800a7f0 2024-04-21T09:31:09.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:31:09.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:09.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:09.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:09.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:09.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.732+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:09.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.936+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:09.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.936+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:09.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.936+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:09.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.936+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:09.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:09.936+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:10.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:10.340+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:10.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:10.340+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:10.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:10.340+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:10.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:10.340+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:10.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:10.340+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:11.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:11.144+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:11.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:11.144+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:11.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:11.144+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:11.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:11.144+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:11.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:11.144+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:12.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:12.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:12.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:12.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:12.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:12.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:12.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a800ac40 2024-04-21T09:31:12.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8007630 2024-04-21T09:31:12.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ac40 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:12.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:12.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.732+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:12.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.936+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ac40 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:12.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.936+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:12.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:12.936+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:13.340+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ac40 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:13.340+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:13.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:13.340+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:14.144+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ac40 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:14.144+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:14.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:14.144+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:15.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800ac40 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:31:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8016130 2024-04-21T09:31:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4072890 con 0x7f44a80080e0 2024-04-21T09:31:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8003b40 2024-04-21T09:31:15.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.732+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.736+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.736+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:15.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.736+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:15.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.940+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:15.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.940+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:15.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.940+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:15.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:15.940+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:16.344+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:16.344+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:16.344+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:16.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:16.344+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:17.148+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:17.148+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:17.148+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:17.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:17.148+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:18.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8016130 legacy=0x7f44a800b020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:18.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8007630 2024-04-21T09:31:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a800a7f0 2024-04-21T09:31:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:18.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.736+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.940+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.940+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.940+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:18.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:18.940+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:19.344+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:19.344+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:19.344+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:19.344+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:20.148+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:20.148+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:20.148+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:20.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:20.148+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 msgr2=0x7f44a8007a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8007630 0x7f44a8007a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:21.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a8007a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a8016130 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a80080e0 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:21.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:21.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:21.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.736+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.940+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.940+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.940+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.940+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:21.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:21.940+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:22.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:22.344+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:22.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:22.344+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:22.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:22.344+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:22.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:22.344+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:22.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:22.344+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:23.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:23.148+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:23.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:23.148+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:23.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:23.148+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:23.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:23.148+0000 7f44ca73d640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:23.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:23.148+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:24.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:24.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:24.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:24.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a8016130 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a800b020 2024-04-21T09:31:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800a7f0 2024-04-21T09:31:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b020 legacy=0x7f44a8010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:24.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.736+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:24.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.940+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b020 legacy=0x7f44a8010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:24.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.940+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:24.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:24.940+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:25.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:25.344+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b020 legacy=0x7f44a8010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:25.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:25.344+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:25.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:25.344+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:26.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:26.148+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b020 legacy=0x7f44a8010340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:26.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:26.148+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:26.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:26.148+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:27.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800b020 legacy=0x7f44a8010340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:31:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a8007a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a80080e0 2024-04-21T09:31:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016130 2024-04-21T09:31:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:31:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.736+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.940+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.940+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.940+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:27.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.940+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:27.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:27.940+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:28.344+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:28.344+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:28.344+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:28.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:28.344+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:28.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:28.344+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:29.148+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:29.148+0000 7f44ca73d640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:29.148+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:29.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:29.148+0000 7f44ca73d640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:29.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:29.148+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:30.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:30.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:30.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:30.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8016130 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:30.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:30.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:30.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a8010310 2024-04-21T09:31:30.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a800a7f0 2024-04-21T09:31:30.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:30.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:30.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.736+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8010310 legacy=0x7f44a8010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:30.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.940+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:30.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.940+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8010310 legacy=0x7f44a8010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:30.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:30.940+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:31.344+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:31.344+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8010310 legacy=0x7f44a8010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:31.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:31.344+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:32.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:32.148+0000 7f44c9f3c640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:32.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:32.148+0000 7f44c973b640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8010310 legacy=0x7f44a8010720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:32.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:32.148+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 msgr2=0x7f44a8019a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:33.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a800a7f0 0x7f44a8019a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8010310 legacy=0x7f44a8010720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:31:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a80080e0 2024-04-21T09:31:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8016130 2024-04-21T09:31:33.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8003b40 2024-04-21T09:31:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:33.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.736+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:33.823 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:33.826 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.940+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.940+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.940+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.940+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:33.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:33.940+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:34.344+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:34.344+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:34.344+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:34.344+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:34.344+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:35.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:35.148+0000 7f44ca73d640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:35.148+0000 7f44ca73d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:35.148+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:35.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:35.148+0000 7f44c9f3c640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:35.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:35.148+0000 7f44c9f3c640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8003b40 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:36.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80080e0 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 0x7f44a8010e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a800a7f0 2024-04-21T09:31:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a8019a50 2024-04-21T09:31:36.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a7f0 legacy=0x7f44a80106f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 msgr2=0x7f44a8010e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:36.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.736+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 0x7f44a8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.940+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a7f0 legacy=0x7f44a80106f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.940+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 msgr2=0x7f44a8010e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:36.940+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 0x7f44a8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:37.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:37.344+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a7f0 legacy=0x7f44a80106f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:37.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:37.344+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 msgr2=0x7f44a8010e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:37.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:37.344+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 0x7f44a8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:38.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:38.148+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a7f0 legacy=0x7f44a80106f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:38.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:38.148+0000 7f44c973b640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 msgr2=0x7f44a8010e00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:38.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:38.148+0000 7f44c973b640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 0x7f44a8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:39.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 msgr2=0x7f44a8010e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:39.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a8019a50 0x7f44a8010e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:39.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a800a7f0 legacy=0x7f44a80106f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44ca73d640 1 -- reap_dead start 2024-04-21T09:31:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a800c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a8016700 con 0x7f44a8003b40 2024-04-21T09:31:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a80080e0 2024-04-21T09:31:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44bb7fe640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 -- 0x7f44c40725b0 con 0x7f44a8016130 2024-04-21T09:31:39.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8003b40 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:39.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.736+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:39.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.940+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:39.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.940+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8003b40 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:39.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.940+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:39.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.940+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:39.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:39.940+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:40.344+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8003b40 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:40.344+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:40.344+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:40.344+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:40.344+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:41.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:41.148+0000 7f44c9f3c640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8003b40 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.26:6789/0 2024-04-21T09:31:41.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:41.148+0000 7f44c973b640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.26:3300/0 2024-04-21T09:31:41.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:41.148+0000 7f44c973b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:41.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:41.148+0000 7f44ca73d640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3301/0 2024-04-21T09:31:41.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:41.148+0000 7f44ca73d640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:42.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 -- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 msgr2=0x7f44a8007a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:42.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f44a8016130 0x7f44a8007a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 -- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 msgr2=0x7f44a800c0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f44a80080e0 0x7f44a800c0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 -- >> v1:172.21.15.26:6789/0 conn(0x7f44a8003b40 legacy=0x7f44a8016a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 0x7f44a8010b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c4071ff0 con 0x7f44a80114b0 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44bb7fe640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 -- 0x7f44c40722d0 con 0x7f44a80106f0 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:42.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 msgr2=0x7f44a8010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:42.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.736+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 0x7f44a8010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-21T09:31:42.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.940+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:42.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.940+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 msgr2=0x7f44a8010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:42.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:42.940+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 0x7f44a8010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-21T09:31:43.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:43.344+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:43.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:43.344+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 msgr2=0x7f44a8010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:43.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:43.344+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 0x7f44a8010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-21T09:31:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:44.148+0000 7f44c9f3c640 1 -- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 msgr2=0x7f44a8010b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.169:3300/0 2024-04-21T09:31:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:44.148+0000 7f44c973b640 1 -- >> v1:172.21.15.169:6789/0 conn(0x7f44a80114b0 legacy=0x7f44a80138d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.169:6789/0 2024-04-21T09:31:44.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-21T09:31:44.148+0000 7f44c9f3c640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f44a80106f0 0x7f44a8010b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-21T09:31:45.623 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-21T09:31:45.624 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -110 (ETIMEDOUT) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1242, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-21T09:31:45.654 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-21T09:31:45.654 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-21T09:31:45.655 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.658 INFO:tasks.ceph.mds.a:Stopped 2024-04-21T09:31:45.658 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-21T09:31:45.659 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.659 INFO:tasks.ceph.mds.c:Stopped 2024-04-21T09:31:45.659 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-21T09:31:45.659 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.659 INFO:tasks.ceph.mds.e:Stopped 2024-04-21T09:31:45.660 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-21T09:31:45.660 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.660 INFO:tasks.ceph.mds.b:Stopped 2024-04-21T09:31:45.660 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-21T09:31:45.660 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.660 INFO:tasks.ceph.mds.d:Stopped 2024-04-21T09:31:45.661 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-21T09:31:45.661 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.661 INFO:tasks.ceph.mds.f:Stopped 2024-04-21T09:31:45.661 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-21T09:31:45.661 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-21T09:31:45.661 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.661 INFO:tasks.ceph.osd.0:Stopped 2024-04-21T09:31:45.662 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-21T09:31:45.662 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.662 INFO:tasks.ceph.osd.1:Stopped 2024-04-21T09:31:45.662 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-21T09:31:45.662 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.662 INFO:tasks.ceph.osd.2:Stopped 2024-04-21T09:31:45.663 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-21T09:31:45.663 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.663 INFO:tasks.ceph.osd.3:Stopped 2024-04-21T09:31:45.663 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-21T09:31:45.663 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.663 INFO:tasks.ceph.osd.4:Stopped 2024-04-21T09:31:45.664 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-21T09:31:45.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.664 INFO:tasks.ceph.osd.5:Stopped 2024-04-21T09:31:45.664 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-21T09:31:45.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.664 INFO:tasks.ceph.osd.6:Stopped 2024-04-21T09:31:45.664 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-21T09:31:45.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.665 INFO:tasks.ceph.osd.7:Stopped 2024-04-21T09:31:45.665 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-21T09:31:45.665 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-21T09:31:45.665 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T09:31:45.665 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -110 (ETIMEDOUT) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1242, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y' 2024-04-21T09:31:45.681 INFO:tasks.ceph.mgr.y:Stopped 2024-04-21T09:31:45.682 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-21T09:31:45.682 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.682 INFO:tasks.ceph.mgr.x:Stopped 2024-04-21T09:31:45.682 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-21T09:31:45.682 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-21T09:31:45.682 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.683 INFO:tasks.ceph.mon.a:Stopped 2024-04-21T09:31:45.683 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-21T09:31:45.683 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.685 INFO:tasks.ceph.mon.b:Stopped 2024-04-21T09:31:45.685 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-21T09:31:45.686 INFO:teuthology.orchestra.run:waiting for 300 2024-04-21T09:31:45.686 INFO:tasks.ceph.mon.c:Stopped 2024-04-21T09:31:45.686 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-21T09:31:45.686 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-21T09:31:45.721 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T09:31:45.722 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-21T09:31:45.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T09:31:45.973 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-21T09:31:46.169 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T09:31:46.169 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-21T09:31:46.352 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T09:31:46.352 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-21T09:31:46.538 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T09:31:46.539 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-21T09:31:46.768 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T09:31:46.768 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-21T09:31:46.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T09:31:46.925 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-21T09:31:47.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T09:31:47.088 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-21T09:31:47.263 INFO:tasks.ceph:Archiving mon data... 2024-04-21T09:31:47.265 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/data/mon.a.tgz 2024-04-21T09:31:47.265 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-04-21T09:31:47.271 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.yI9f6mcYOe 2024-04-21T09:31:47.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yI9f6mcYOe 2024-04-21T09:31:47.405 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.yI9f6mcYOe 2024-04-21T09:31:47.471 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.yI9f6mcYOe is 344KB 2024-04-21T09:31:47.533 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.yI9f6mcYOe 2024-04-21T09:31:47.539 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/data/mon.b.tgz 2024-04-21T09:31:47.539 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-21T09:31:47.545 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.7nmQxtEFGY 2024-04-21T09:31:47.545 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7nmQxtEFGY 2024-04-21T09:31:47.667 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.7nmQxtEFGY 2024-04-21T09:31:47.731 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.7nmQxtEFGY is 345KB 2024-04-21T09:31:47.792 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.7nmQxtEFGY 2024-04-21T09:31:47.798 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/data/mon.c.tgz 2024-04-21T09:31:47.798 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-04-21T09:31:47.847 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.a0hqyFGsh7 2024-04-21T09:31:47.847 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.a0hqyFGsh7 2024-04-21T09:31:47.980 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.a0hqyFGsh7 2024-04-21T09:31:48.043 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.a0hqyFGsh7 is 345KB 2024-04-21T09:31:48.105 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.a0hqyFGsh7 2024-04-21T09:31:48.109 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-21T09:31:48.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-21T09:31:48.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-21T09:31:48.171 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-21T09:31:48.211 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-21T09:31:48.211 INFO:tasks.ceph:Archiving crash dumps... 2024-04-21T09:31:48.213 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/remote/smithi026/crash 2024-04-21T09:31:48.214 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-21T09:31:48.228 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/remote/smithi169/crash 2024-04-21T09:31:48.229 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-21T09:31:48.267 INFO:tasks.ceph:Shutting down logrotate 2024-04-21T09:31:48.267 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:48.276 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:48.360 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:48.373 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-21T09:31:48.385 INFO:tasks.ceph:Compressing logs... 2024-04-21T09:31:48.386 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-21T09:31:48.416 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-21T09:31:48.428 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38394.log 2024-04-21T09:31:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36344.log 2024-04-21T09:31:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33193.log 2024-04-21T09:31:48.430 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38394.log.gz 2024-04-21T09:31:48.430 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37102.log 2024-04-21T09:31:48.430 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36344.log.gz 2024-04-21T09:31:48.431 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38764.log 2024-04-21T09:31:48.435 INFO:teuthology.orchestra.run.smithi026.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33193.log.gz 2024-04-21T09:31:48.435 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38286.log 2024-04-21T09:31:48.435 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38477.log 2024-04-21T09:31:48.435 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38764.log.gz 2024-04-21T09:31:48.435 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37102.log.gz 2024-04-21T09:31:48.435 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36996.log 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38286.log.gz 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38477.log.gz 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36664.log 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36996.log.gz 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.36664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36124.log 2024-04-21T09:31:48.436 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31681.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36664.log.gz 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38313.log 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38555.log 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36294.log 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38555.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36124.log.gz 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31822.log 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38313.log.gz 2024-04-21T09:31:48.437 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38555.log.gz 2024-04-21T09:31:48.438 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38922.log 2024-04-21T09:31:48.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27856.log 2024-04-21T09:31:48.466 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27736.log 2024-04-21T09:31:48.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27712.log 2024-04-21T09:31:48.466 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27736.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27856.log.gz 2024-04-21T09:31:48.466 INFO:teuthology.orchestra.run.smithi169.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.27736.log.gz 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27712.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27712.log.gz 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27832.log 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27784.log 2024-04-21T09:31:48.467 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27832.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-21T09:31:48.468 INFO:teuthology.orchestra.run.smithi169.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2024-04-21T09:31:48.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27784.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27832.log.gz 2024-04-21T09:31:48.468 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-21T09:31:48.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27760.log 2024-04-21T09:31:48.468 INFO:teuthology.orchestra.run.smithi169.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27784.log.gz 2024-04-21T09:31:48.468 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-21T09:31:48.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27808.log 2024-04-21T09:31:48.469 INFO:teuthology.orchestra.run.smithi169.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27760.log.gz 2024-04-21T09:31:48.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-21T09:31:48.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.27808.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27808.log.gz 2024-04-21T09:31:48.469 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-21T09:31:48.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-21T09:31:48.469 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.audit.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-21T09:31:48.470 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-21T09:31:48.470 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.d.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-21T09:31:48.470 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-21T09:31:48.470 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.b.log: 93.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-21T09:31:48.470 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-21T09:31:48.470 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.b.log: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-21T09:31:48.495 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36294.log: /var/log/ceph/ceph-client.admin.31822.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-21T09:31:48.495 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32959.log 2024-04-21T09:31:48.496 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38922.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31822.log.gz 2024-04-21T09:31:48.496 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.0.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38922.log.gz 2024-04-21T09:31:48.496 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36046.log 2024-04-21T09:31:48.496 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36294.log.gz 2024-04-21T09:31:48.496 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32907.log 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32959.log.gz 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33360.log 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36371.log 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32907.log: /var/log/ceph/ceph-client.admin.33360.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32907.log.gz 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36046.log.gz 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32359.log 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33141.log 2024-04-21T09:31:48.497 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36371.log: /var/log/ceph/ceph-client.admin.32359.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.33360.log.gz 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31834.log 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32359.log.gz 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33115.log 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr:gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33141.log.gz 90.9% -5 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- replaced with /var/log/ceph/ceph-client.admin.36371.log.gz 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr: -- /var/log/ceph/ceph-client.admin.31312.log 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31834.log: /var/log/ceph/ceph-client.admin.33115.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31834.log.gz 2024-04-21T09:31:48.498 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36450.log 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33115.log.gz 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31837.log 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31312.log.gz 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36187.log 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35412.log 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31837.log: /var/log/ceph/ceph-client.admin.36187.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31837.log.gz 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32044.log 2024-04-21T09:31:48.499 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36450.log.gz 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36187.log.gz 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31551.log 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35412.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32044.log: /var/log/ceph/ceph-client.admin.31551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35148.log 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32044.log.gz 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31551.log.gz 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.35412.log.gz 2024-04-21T09:31:48.500 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33089.log 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35304.log 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35148.log.gz 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35227.log 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33089.log: /var/log/ceph/ceph-client.admin.35304.log: gzip -5 --verbose 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33089.log.gz 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35304.log.gz 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr: -- /var/log/ceph/ceph-mon.a.log 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31577.log 2024-04-21T09:31:48.501 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35227.log.gz 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32333.log 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38813.log 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31577.log.gz 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-client.admin.32333.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32619.log 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38813.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32333.log.gz 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32489.log 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38813.log.gz 2024-04-21T09:31:48.502 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31390.log 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-client.admin.32489.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37232.log 91.6% -- replaced with /var/log/ceph/ceph-client.admin.32619.log.gz 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31390.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32489.log.gz 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31390.log.gz 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38660.log 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31144.log 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37232.log.gz 2024-04-21T09:31:48.503 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-client.admin.38660.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32411.log 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31144.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38660.log.gz 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31144.log.gz 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32463.log 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32038.log 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32411.log.gz 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph-client.admin.32463.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33063.log 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32038.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32463.log.gz 2024-04-21T09:31:48.504 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38551.log 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32038.log.gz 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32045.log 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33063.log.gz 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33297.log 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3%/var/log/ceph/ceph-client.admin.32045.log: -- replaced with /var/log/ceph/ceph-client.admin.38551.log.gz 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35385.log 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32045.log.gz 2024-04-21T09:31:48.505 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32028.log 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33297.log.gz 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39000.log 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32028.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35385.log.gz 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31707.log 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32028.log.gz 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27456.log 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39000.log.gz 2024-04-21T09:31:48.506 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32030.log 2024-04-21T09:31:48.507 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.27456.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31707.log.gz 2024-04-21T09:31:48.507 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37152.log 2024-04-21T09:31:48.507 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3%/var/log/ceph/ceph-client.admin.32030.log: -- replaced with /var/log/ceph/ceph-client.admin.27456.log.gz 2024-04-21T09:31:48.507 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32567.log 2024-04-21T09:31:48.507 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32030.log.gz 2024-04-21T09:31:48.507 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33219.log 2024-04-21T09:31:48.507 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32567.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37152.log.gz 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22650.log 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32567.log.gz 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33219.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.tmp-client.admin.22650.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33219.log.gz 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37075.log 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22650.log.gz 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31254.log 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-04-21T09:31:48.508 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31254.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37075.log.gz 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr: 95.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31603.log 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31254.log.gz 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32674.log: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31499.log 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz/var/log/ceph/ceph-client.admin.31603.log: 2024-04-21T09:31:48.509 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32985.log 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31603.log.gz 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38366.log 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32985.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.31499.log.gz /var/log/ceph/ceph-osd.1.log 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38366.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32985.log.gz 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37023.log 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.1.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38974.log 2024-04-21T09:31:48.510 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38366.log.gz 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35175.log 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31108.log 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38974.log: 91.1%/var/log/ceph/ceph-client.admin.35175.log: -- replaced with /var/log/ceph/ceph-client.admin.37023.log.gz 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38974.log.gz 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36097.log 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35175.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38758.log 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-21T09:31:48.511 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31108.log: /var/log/ceph/ceph-client.admin.36097.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31759.log 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31108.log.gz 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36097.log.gz 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38758.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38758.log.gz 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33011.log 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38896.log 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38420.log 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31759.log.gz 2024-04-21T09:31:48.512 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33011.log.gz 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36423.log 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38896.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38896.log.gz 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38420.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38420.log.gz 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38817.log 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31416.log 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38817.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36423.log.gz -5 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38706.log 2024-04-21T09:31:48.513 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32515.log 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38817.log.gz 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31416.log: /var/log/ceph/ceph-client.admin.38706.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31416.log.gz 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38706.log.gz 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31228.log 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31836.log 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1%/var/log/ceph/ceph-client.admin.31228.log: -- replaced with /var/log/ceph/ceph-client.admin.32515.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33245.log 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-21T09:31:48.514 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31228.log.gz 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31836.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31836.log.gz 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38714.log 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33245.log: gzip -5/var/log/ceph/ceph.log: --verbose -- /var/log/ceph/ceph-client.admin.32229.log 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38714.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33245.log.gz 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32047.log 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38714.log.gz 2024-04-21T09:31:48.515 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32229.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32229.log.gz 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39026.log 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31338.log 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32047.log: /var/log/ceph/ceph-client.admin.39026.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32047.log.gz 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36691.log 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz/var/log/ceph/ceph-client.admin.31338.log: 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31338.log.gz 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31472.log 2024-04-21T09:31:48.516 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-04-21T09:31:48.517 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36691.log: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.39026.log.gz/var/log/ceph/ceph-client.admin.31472.log: 2024-04-21T09:31:48.517 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31472.log.gz 2024-04-21T09:31:48.517 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.36691.log.gz 2024-04-21T09:31:48.518 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36267.log 2024-04-21T09:31:48.518 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31444.log 2024-04-21T09:31:48.518 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37179.log: /var/log/ceph/ceph-client.admin.36267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32043.log 2024-04-21T09:31:48.518 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31444.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36267.log.gz 2024-04-21T09:31:48.518 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31444.log.gz 2024-04-21T09:31:48.518 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-04-21T09:31:48.518 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36214.log 2024-04-21T09:31:48.519 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31825.log 2024-04-21T09:31:48.519 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32043.log: /var/log/ceph/ceph-client.admin.36214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32437.log 2024-04-21T09:31:48.519 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31825.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32043.log.gz 2024-04-21T09:31:48.519 INFO:teuthology.orchestra.run.smithi026.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33324.log 2024-04-21T09:31:48.519 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31825.log.gz 2024-04-21T09:31:48.520 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36214.log.gz 2024-04-21T09:31:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32437.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32437.log.gz 2024-04-21T09:31:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31733.log 2024-04-21T09:31:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31629.log 2024-04-21T09:31:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33324.log: /var/log/ceph/ceph-client.admin.31733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35331.log 2024-04-21T09:31:48.520 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31629.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33324.log.gz 2024-04-21T09:31:48.521 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31733.log.gz 2024-04-21T09:31:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32933.log 2024-04-21T09:31:48.521 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31629.log.gz 2024-04-21T09:31:48.521 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33167.log 2024-04-21T09:31:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38603.log 2024-04-21T09:31:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33167.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32933.log.gz 2024-04-21T09:31:48.522 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35331.log.gz 2024-04-21T09:31:48.522 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33167.log.gz 2024-04-21T09:31:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38948.log 2024-04-21T09:31:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-21T09:31:48.522 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38603.log: /var/log/ceph/ceph-client.admin.38948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27569.log 2024-04-21T09:31:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38603.log.gz 2024-04-21T09:31:48.523 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38948.log.gz 2024-04-21T09:31:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-21T09:31:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32255.log 2024-04-21T09:31:48.523 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.27569.log: 89.1%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-21T09:31:48.524 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27569.log.gz 2024-04-21T09:31:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-21T09:31:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32881.log 2024-04-21T09:31:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32255.log: /var/log/ceph/ceph-mds.a.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32255.log.gz 2024-04-21T09:31:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31364.log 2024-04-21T09:31:48.524 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32881.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32881.log.gz 2024-04-21T09:31:48.525 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33037.log 2024-04-21T09:31:48.536 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31364.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31364.log.gz 2024-04-21T09:31:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-04-21T09:31:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33037.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33037.log.gz 2024-04-21T09:31:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32385.log 2024-04-21T09:31:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37259.log: 94.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-21T09:31:48.537 INFO:teuthology.orchestra.run.smithi026.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-04-21T09:31:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32307.log 2024-04-21T09:31:48.537 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36743.log 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32385.log: /var/log/ceph/ceph-client.admin.32307.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32385.log.gz 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr: 94.3% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32307.log.gz 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31525.log 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38424.log 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36743.log: /var/log/ceph/ceph-client.admin.31525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35254.log 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38424.log: 89.6% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36743.log.gz 2024-04-21T09:31:48.538 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31525.log.gz 2024-04-21T09:31:48.539 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-04-21T09:31:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31827.log 2024-04-21T09:31:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31785.log 2024-04-21T09:31:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35254.log: /var/log/ceph/ceph-client.admin.31827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38628.log 2024-04-21T09:31:48.539 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31785.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31827.log.gz 2024-04-21T09:31:48.541 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31785.log.gz 2024-04-21T09:31:48.541 INFO:teuthology.orchestra.run.smithi026.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35254.log.gz 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38654.log 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32281.log 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38654.log: /var/log/ceph/ceph-client.admin.31655.log: 88.7% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38628.log.gz 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38654.log.gz 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32593.log 2024-04-21T09:31:48.542 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38476.log 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32541.log 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32593.log: /var/log/ceph/ceph-client.admin.38476.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32281.log.gz 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32593.log.gz 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32046.log 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36019.log 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.38476.log.gz 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32541.log: /var/log/ceph/ceph-client.admin.32046.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32541.log.gz 2024-04-21T09:31:48.543 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32046.log.gz 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31839.log 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32855.log 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36019.log: /var/log/ceph/ceph-client.admin.31839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38863.log 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32855.log: 88.4% 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31839.log.gz -- replaced with /var/log/ceph/ceph-client.admin.36019.log.gz 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32855.log.gz 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36770.log 2024-04-21T09:31:48.544 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31838.log 2024-04-21T09:31:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38863.log: /var/log/ceph/ceph-client.admin.36770.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-21T09:31:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.31838.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38863.log.gz 2024-04-21T09:31:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27675.log 2024-04-21T09:31:48.545 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31838.log.gz 2024-04-21T09:31:48.545 INFO:teuthology.orchestra.run.smithi026.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.36770.log.gz 2024-04-21T09:31:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.32802.log 2024-04-21T09:31:48.545 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.e.log: /var/log/ceph/ceph-client.admin.27675.log: /var/log/ceph/ceph-client.0.32802.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27675.log.gz 2024-04-21T09:31:48.546 INFO:teuthology.orchestra.run.smithi026.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-21T09:31:48.747 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.4.log: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-21T09:31:48.991 INFO:teuthology.orchestra.run.smithi169.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-21T09:31:49.077 INFO:teuthology.orchestra.run.smithi169.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-21T09:31:49.393 INFO:teuthology.orchestra.run.smithi026.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-21T09:31:58.942 INFO:teuthology.orchestra.run.smithi169.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-21T09:31:59.887 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-21T09:32:01.407 INFO:teuthology.orchestra.run.smithi026.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-21T09:32:02.673 INFO:teuthology.orchestra.run.smithi169.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-21T09:32:03.748 INFO:teuthology.orchestra.run.smithi026.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-21T09:32:04.042 INFO:teuthology.orchestra.run.smithi169.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-21T09:32:04.700 INFO:teuthology.orchestra.run.smithi169.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-21T09:32:04.701 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-04-21T09:32:04.702 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m16.272s 2024-04-21T09:32:04.702 INFO:teuthology.orchestra.run.smithi169.stderr:user 1m7.303s 2024-04-21T09:32:04.702 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m2.188s 2024-04-21T09:32:06.515 INFO:teuthology.orchestra.run.smithi026.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-21T09:32:10.121 INFO:teuthology.orchestra.run.smithi026.stderr: 91.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-21T09:33:33.813 INFO:teuthology.orchestra.run.smithi026.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.0.32802.log.gz 2024-04-21T09:33:33.815 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-21T09:33:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:real 1m45.395s 2024-04-21T09:33:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:user 2m49.451s 2024-04-21T09:33:33.815 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m5.026s 2024-04-21T09:33:33.816 INFO:tasks.ceph:Archiving logs... 2024-04-21T09:33:33.816 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/remote/smithi026/log 2024-04-21T09:33:33.817 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-21T09:33:54.584 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/remote/smithi169/log 2024-04-21T09:33:54.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-21T09:34:27.549 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -110 (ETIMEDOUT) During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1929, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph.py", line 1242, in osd_scrub_pgs stats = manager.get_pg_stats() File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi026 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-21T09:34:27.565 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-21T09:34:27.575 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 310, in task stop_all_quiescers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_leonid-s-usov_ceph-ceph_4f6bc5273643aaf5660909e85400647a8951c10b/qa/tasks/quiescer.py", line 263, in stop_all_quiescers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: Error quiescing root: -110 (ETIMEDOUT) 2024-04-21T09:34:27.588 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-21T09:34:27.588 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-21T09:34:27.600 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-21T09:34:27.665 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-21T09:34:27.677 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-21T09:34:27.678 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T09:34:27.681 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-21T09:34:27.690 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2024-04-21T09:34:27.690 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2024-04-21T09:34:27.690 INFO:teuthology.orchestra.run.smithi026.stdout:*hv01.front.sepi 44.4.53.2 2 u 1 64 377 0.091 -1.208 0.762 2024-04-21T09:34:27.691 INFO:teuthology.orchestra.run.smithi026.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.087 -1.102 0.757 2024-04-21T09:34:27.691 INFO:teuthology.orchestra.run.smithi026.stdout:+hv03.front.sepi 74.6.168.72 3 u 61 64 377 0.099 -2.279 0.673 2024-04-21T09:34:27.691 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-21T09:34:27.693 INFO:teuthology.orchestra.run.smithi169.stdout: remote refid st t when poll reach delay offset jitter 2024-04-21T09:34:27.693 INFO:teuthology.orchestra.run.smithi169.stdout:============================================================================== 2024-04-21T09:34:27.693 INFO:teuthology.orchestra.run.smithi169.stdout:*hv01.front.sepi 44.4.53.2 2 u 61 64 377 0.060 -4.173 1.670 2024-04-21T09:34:27.694 INFO:teuthology.orchestra.run.smithi169.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 377 0.091 -4.846 2.340 2024-04-21T09:34:27.694 INFO:teuthology.orchestra.run.smithi169.stdout:+hv03.front.sepi 74.6.168.72 3 u 61 64 377 0.082 -3.194 1.447 2024-04-21T09:34:27.694 INFO:teuthology.orchestra.run.smithi169.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-21T09:34:27.694 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-21T09:34:27.705 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-21T09:34:27.705 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-21T09:34:27.714 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-21T09:34:27.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-21T09:34:27.737 INFO:teuthology.task.internal:Duration was 2857.604969 seconds 2024-04-21T09:34:27.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-21T09:34:27.749 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-21T09:34:27.749 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-21T09:34:27.751 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-21T09:34:27.793 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-21T09:34:27.793 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-04-21T09:34:27.793 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-21T09:34:27.844 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-04-21T09:34:27.844 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-21T09:34:27.853 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-21T09:34:27.854 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-21T09:34:27.892 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-21T09:34:27.920 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-21T09:34:27.920 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-21T09:34:27.963 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-21T09:34:28.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-21T09:34:28.033 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-21T09:34:28.033 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-21T09:34:28.044 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-21T09:34:28.055 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-21T09:34:28.065 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-21T09:34:28.088 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-21T09:34:28.098 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-04-21T09:34:28.109 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-04-21T09:34:28.133 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-21T09:34:28.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T09:34:28.159 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-21T09:34:28.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-21T09:34:28.183 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-21T09:34:28.193 INFO:teuthology.task.internal:Transferring archived files... 2024-04-21T09:34:28.193 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/remote/smithi026 2024-04-21T09:34:28.194 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-21T09:34:28.225 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535/remote/smithi169 2024-04-21T09:34:28.225 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-21T09:34:28.246 INFO:teuthology.task.internal:Removing archive directory... 2024-04-21T09:34:28.246 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-21T09:34:28.264 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-21T09:34:28.291 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-21T09:34:28.301 INFO:teuthology.task.internal:Not uploading archives. 2024-04-21T09:34:28.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-21T09:34:28.335 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-21T09:34:28.335 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-21T09:34:28.337 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-21T09:34:28.342 INFO:teuthology.orchestra.run.smithi026.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 21 09:34 /home/ubuntu/cephtest 2024-04-21T09:34:28.343 INFO:teuthology.orchestra.run.smithi169.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 21 09:34 /home/ubuntu/cephtest 2024-04-21T09:34:28.344 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-21T09:34:28.356 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-21T09:34:28.367 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: Error quiescing root: -110 (ETIMEDOUT) 2024-04-21T09:34:28.367 INFO:teuthology.nuke:Checking targets against current locks 2024-04-21T09:34:28.392 DEBUG:teuthology.nuke:shortname: smithi026 2024-04-21T09:34:28.393 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T09:34:28.415 DEBUG:teuthology.nuke:shortname: smithi169 2024-04-21T09:34:28.415 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-21T09:34:28.419 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 08:37:36.079688', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCNM/4TvBgUnGLiSBW4AA32oHQQwI/zuXX2DrSrIHA5OjeWMGfseY/1ESxJ4QFMZ7LCRISZQe0wioqljW+q9Z/Q='} 2024-04-21T09:34:28.442 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-21_08:12:55-fs-wip-lusov-quiescer-distro-default-smithi/7666535', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-21 08:37:36.081123', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmmCnzLzJqcmy2jVfpo3zaQbZbOmN/O7S4RfzIgiu1Hh8VeBFhvrbdQbGdSQ9VgvNmU4snPn9+4G+SmQg1V7fQ='} 2024-04-21T09:34:28.473 INFO:teuthology.orchestra.console.smithi026:Power off 2024-04-21T09:34:28.474 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-21T09:34:28.490 INFO:teuthology.orchestra.console.smithi169:Power off 2024-04-21T09:34:28.491 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-21T09:34:28.507 DEBUG:teuthology.orchestra.console.smithi026:power off output: Chassis Power Control: Down/Off 2024-04-21T09:34:28.507 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T09:34:28.516 DEBUG:teuthology.orchestra.console.smithi169:power off output: Chassis Power Control: Down/Off 2024-04-21T09:34:28.517 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T09:34:28.532 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-21T09:34:28.541 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-21T09:34:32.534 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T09:34:32.543 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T09:34:32.645 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-21T09:34:32.653 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is on 2024-04-21T09:34:36.650 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T09:34:36.659 DEBUG:teuthology.orchestra.console.smithi169:pexpect command: ipmitool -H smithi169.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T09:34:36.762 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is on 2024-04-21T09:34:36.769 DEBUG:teuthology.orchestra.console.smithi169:check power output: Chassis Power is off 2024-04-21T09:34:36.870 INFO:teuthology.orchestra.console.smithi169:Power off completed 2024-04-21T09:34:40.765 DEBUG:teuthology.orchestra.console.smithi026:pexpect command: ipmitool -H smithi026.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-21T09:34:40.874 DEBUG:teuthology.orchestra.console.smithi026:check power output: Chassis Power is off 2024-04-21T09:34:40.975 INFO:teuthology.orchestra.console.smithi026:Power off completed 2024-04-21T09:34:41.082 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/none objectstore-ec/bluestore-comp overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} duration: 2857.604968547821 failure_reason: 'Command failed (workunit test fs/snaps/untar_snap_rm.sh) on smithi026 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4f6bc5273643aaf5660909e85400647a8951c10b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/untar_snap_rm.sh''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=97f757c031ca4505b78573172dba3452 status: fail success: false 2024-04-21T09:34:41.082 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-21T09:34:41.167 INFO:teuthology.run:FAIL